diff --git a/README.md b/README.md index a0588a5a..981a273f 100644 --- a/README.md +++ b/README.md @@ -519,7 +519,8 @@ use_cpu: false ```bash deepspeed --num_gpus 8 src/train_bash.py \ - --deepspeed ds_config.json \ + --deepspeed ds_config.json \ + --ddp_timeout 180000000 \ ... # arguments (same as above) ``` diff --git a/README_zh.md b/README_zh.md index 24ba3e12..6affad1e 100644 --- a/README_zh.md +++ b/README_zh.md @@ -519,7 +519,9 @@ use_cpu: false ```bash deepspeed --num_gpus 8 src/train_bash.py \ --deepspeed ds_config.json \ + --ddp_timeout 180000000 \ ... # 参数同上 + ```
使用 DeepSpeed ZeRO-2 进行全参数训练的 ds_config.json 示例