423A35C7/LLaMA-Factory
1
0
Fork 0
mirror of https://github.com/hiyouga/LLaMA-Factory.git synced 2026-03-08 04:35:58 +08:00
Code Issues Packages Projects Releases Wiki Activity

support vllm

Browse Source 
Former-commit-id: 889f6e910e654d8ec3922c2185042d737ffbf1c3
This commit is contained in:
hiyouga
2024-03-07 20:26:31 +08:00
parent a02d518edc
commit ddabd699ca
32 changed files with 752 additions and 316 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
examples/merge_lora/README.md
View File

@@ -1,3 +1,4 @@
Usage:
- `merge.sh` -> `quantize.sh`
- `merge.sh`: merge the lora weights
- `quantize.sh`: quantize the model with AutoGPTQ (must after merge.sh, optional)