Merge pull request #2903 from khazic/main

Updated README with new information

Former-commit-id: a77303570994c3a3a2a0c2faae7fc089cac05629
This commit is contained in:
hoshi-hiyouga 2024-03-20 16:13:44 +08:00 committed by GitHub
commit a9d85cf3c6
2 changed files with 4 additions and 1 deletions

View File

@ -519,7 +519,8 @@ use_cpu: false
```bash ```bash
deepspeed --num_gpus 8 src/train_bash.py \ deepspeed --num_gpus 8 src/train_bash.py \
--deepspeed ds_config.json \ --deepspeed ds_config.json \
--ddp_timeout 180000000 \
... # arguments (same as above) ... # arguments (same as above)
``` ```

View File

@ -519,7 +519,9 @@ use_cpu: false
```bash ```bash
deepspeed --num_gpus 8 src/train_bash.py \ deepspeed --num_gpus 8 src/train_bash.py \
--deepspeed ds_config.json \ --deepspeed ds_config.json \
--ddp_timeout 180000000 \
... # 参数同上 ... # 参数同上
``` ```
<details><summary>使用 DeepSpeed ZeRO-2 进行全参数训练的 ds_config.json 示例</summary> <details><summary>使用 DeepSpeed ZeRO-2 进行全参数训练的 ds_config.json 示例</summary>