423A35C7/LLaMA-Factory
1
0
Fork 0
mirror of https://github.com/hiyouga/LLaMA-Factory.git synced 2025-10-15 08:08:09 +08:00
Code Issues Packages Projects Releases Wiki Activity

fix #1217

Browse Source 
Former-commit-id: 065fc0a6f3f005bb87e1c5c126c8b6bb470ce700
This commit is contained in:
hiyouga 2023-10-19 15:52:24 +08:00
parent 215660c8da
commit b1bd8370c2
3 changed files with 5 additions and 4 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
README.md
View File

@ -368,8 +368,7 @@ python src/export_model.py \
--template default \
--finetuning_type lora \
--checkpoint_dir path_to_checkpoint \
--export_dir path_to_export \
--fp16
--export_dir path_to_export
```
### API Demo

3
README_zh.md
View File

@ -367,8 +367,7 @@ python src/export_model.py \
--template default \
--finetuning_type lora \
--checkpoint_dir path_to_checkpoint \
--output_dir path_to_export \
--fp16
--export_dir path_to_export
```
### API 服务

3
src/llmtuner/tuner/core/loader.py
View File

@ -240,4 +240,7 @@ def load_model_and_tokenizer(
trainable_params, all_param, 100 * trainable_params / all_param
))
if not is_trainable:
logger.info("This IS expected that the trainable params is 0 if you are using model for inference only.")
return model, tokenizer