423A35C7/LLaMA-Factory
1
0
Fork 0
mirror of https://github.com/hiyouga/LLaMA-Factory.git synced 2025-08-02 11:42:49 +08:00
Code Issues Packages Projects Releases Wiki Activity

fix #2981

Browse Source 
Former-commit-id: b29d5560f1359a3868d917048aeba1a069ba12a9
This commit is contained in:
hiyouga 2024-03-26 17:53:04 +08:00
parent c311375b50
commit 300437a5e9
2 changed files with 2 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
examples/accelerate/fsdp_config.yaml
View File

@ -9,7 +9,7 @@ fsdp_config:
fsdp_forward_prefetch: false fsdp_forward_prefetch: false
fsdp_offload_params: true fsdp_offload_params: true
fsdp_sharding_strategy: FULL_SHARD fsdp_sharding_strategy: FULL_SHARD
fsdp_state_dict_type: SHARDED_STATE_DICT fsdp_state_dict_type: FULL_STATE_DICT
fsdp_sync_module_states: true fsdp_sync_module_states: true
fsdp_use_orig_params: false fsdp_use_orig_params: false
machine_rank: 0 machine_rank: 0

2
examples/fsdp_qlora/README.md
View File

@ -1,5 +1,5 @@
```bash ```bash
pip install git+https://github.com/huggingface/transformers.git pip install "transformers>=4.39.1"
pip install "accelerate>=0.28.0" pip install "accelerate>=0.28.0"
pip install "bitsandbytes>=0.43.0" pip install "bitsandbytes>=0.43.0"
``` ```