423A35C7/LLaMA-Factory
1
0
Fork 0
mirror of https://github.com/hiyouga/LLaMA-Factory.git synced 2025-12-17 12:20:37 +08:00
Code Issues Packages Projects Releases Wiki Activity

tiny fix

Browse Source 
Former-commit-id: 994f2a79831a1dea8425e3eff62f0bc8238b78d6
This commit is contained in:
hiyouga
2023-06-27 23:54:24 +08:00
parent 4f2c204f13
commit d21a64160d
4 changed files with 15 additions and 5 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
README.md
View File

@@ -208,6 +208,7 @@ accelerate launch src/train_XX.py # arguments (same as above)
compute_environment: LOCAL_MACHINE
deepspeed_config:
gradient_accumulation_steps: 4
gradient_clipping: 0.5
offload_optimizer_device: none
offload_param_device: none
zero3_init_flag: false