423A35C7/LLaMA-Factory
1
0
Fork 0
mirror of https://github.com/hiyouga/LLaMA-Factory.git synced 2026-04-22 04:46:00 +08:00
Code Issues Packages Projects Releases Wiki Activity

[v1] add deepspeed zero3 trigger for low memory usage weight loading (#10300)

Browse Source
This commit is contained in:
jiaqiw09
2026-04-21 14:09:52 +08:00
committed by GitHub
parent f5d739b132
commit 28a6ea1cdc
13 changed files with 160 additions and 18 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
examples/v1/train_freeze/train_freeze_sft.yaml
View File

@@ -29,7 +29,6 @@ micro_batch_size: 1
global_batch_size: 4
cutoff_len: 2048
learning_rate: 2.0e-5
bf16: false
max_steps: 10
### sample