423A35C7/LLaMA-Factory
1
0
Fork 0
mirror of https://github.com/hiyouga/LLaMA-Factory.git synced 2025-12-14 10:56:56 +08:00
Code Issues Packages Projects Releases Wiki Activity
Files
30765baa91b16d91f3e8b6dfb4128284bb133808
LLaMA-Factory/examples/merge_lora
History
hiyouga 34533b2f35 support vllm 
Former-commit-id: d07ad5cc1c
2024-03-07 20:26:31 +08:00
..
merge.sh
support vllm
2024-03-07 20:26:31 +08:00
quantize.sh
support vllm
2024-03-07 20:26:31 +08:00
README.md
support vllm
2024-03-07 20:26:31 +08:00

README.md

Usage:

  • merge.sh: merge the lora weights
  • quantize.sh: quantize the model with AutoGPTQ (must after merge.sh, optional)