423A35C7/LLaMA-Factory
1
0
Fork 0
mirror of https://github.com/hiyouga/LLaMA-Factory.git synced 2025-12-17 04:10:36 +08:00
Code Issues Packages Projects Releases Wiki Activity

support fsdp + qlora

Browse Source
This commit is contained in:
hiyouga
2024-03-21 00:36:06 +08:00
parent 3271af2afc
commit 8408225162
19 changed files with 87 additions and 19 deletions
Download Patch File Download Diff File Expand all files Collapse all files

5
examples/fsdp_qlora/README.md Normal file
View File

@@ -0,0 +1,5 @@
```bash
pip install git+https://github.com/huggingface/transformers.git
pip install "accelerate>=0.28.0"
pip install "bitsandbytes>=0.43.0"
```