mirror of
https://github.com/hiyouga/LLaMA-Factory.git
synced 2025-08-04 12:42:51 +08:00
Merge pull request #2903 from khazic/main
Updated README with new information Former-commit-id: a77303570994c3a3a2a0c2faae7fc089cac05629
This commit is contained in:
commit
a9d85cf3c6
@ -520,6 +520,7 @@ use_cpu: false
|
|||||||
```bash
|
```bash
|
||||||
deepspeed --num_gpus 8 src/train_bash.py \
|
deepspeed --num_gpus 8 src/train_bash.py \
|
||||||
--deepspeed ds_config.json \
|
--deepspeed ds_config.json \
|
||||||
|
--ddp_timeout 180000000 \
|
||||||
... # arguments (same as above)
|
... # arguments (same as above)
|
||||||
```
|
```
|
||||||
|
|
||||||
|
@ -519,7 +519,9 @@ use_cpu: false
|
|||||||
```bash
|
```bash
|
||||||
deepspeed --num_gpus 8 src/train_bash.py \
|
deepspeed --num_gpus 8 src/train_bash.py \
|
||||||
--deepspeed ds_config.json \
|
--deepspeed ds_config.json \
|
||||||
|
--ddp_timeout 180000000 \
|
||||||
... # 参数同上
|
... # 参数同上
|
||||||
|
|
||||||
```
|
```
|
||||||
|
|
||||||
<details><summary>使用 DeepSpeed ZeRO-2 进行全参数训练的 ds_config.json 示例</summary>
|
<details><summary>使用 DeepSpeed ZeRO-2 进行全参数训练的 ds_config.json 示例</summary>
|
||||||
|
Loading…
x
Reference in New Issue
Block a user