423A35C7/LLaMA-Factory
1
0
Fork 0
mirror of https://github.com/hiyouga/LLaMA-Factory.git synced 2025-12-14 10:56:56 +08:00
Code Issues Packages Projects Releases Wiki Activity

add adam_mini to readme

Browse Source 
Former-commit-id: e2a28f51c6
This commit is contained in:
hiyouga
2024-08-09 20:02:03 +08:00
parent 792da85866
commit 5eacd17090
12 changed files with 94 additions and 34 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
examples/extras/galore/llama3_full_sft.yaml
View File

@@ -34,6 +34,7 @@ num_train_epochs: 3.0
lr_scheduler_type: cosine
warmup_ratio: 0.1
pure_bf16: true
ddp_timeout: 180000000
### eval
val_size: 0.1