423A35C7/LLaMA-Factory
1
0
Fork 0
mirror of https://github.com/hiyouga/LLaMA-Factory.git synced 2025-08-22 22:02:51 +08:00
Code Issues Packages Projects Releases Wiki Activity

add the pre-built version of bitsandbytes library for windows user

Browse Source 
Former-commit-id: d3b30ecde31ef36c9cb1326666996aee838a55d2
This commit is contained in:
codemayq 2023-07-03 13:58:10 +08:00
parent 8a1cd612bc
commit 7925ffd3cd
1 changed files with 6 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

6
README.md
View File

@ -89,6 +89,12 @@ huggingface-cli login
And **powerful GPUs**!
If you want to enable LoRA(QLoRA) or Freeze quantization on Windows, you will be required to install a pre-built version of `bitsandbytes` library, which supports CUDA 11.1 to 12.1.
```
pip install https://github.com/jllllll/bitsandbytes-windows-webui/releases/download/wheels/bitsandbytes-0.39.1-py3-none-win_amd64.whl
```
## Getting Started
### Data Preparation (optional)