423A35C7/LLaMA-Factory
1
0
Fork 0
mirror of https://github.com/hiyouga/LLaMA-Factory.git synced 2025-11-07 03:12:13 +08:00
Code Issues Packages Projects Releases Wiki Activity

fix #1217

Browse Source 
Former-commit-id: 065fc0a6f3f005bb87e1c5c126c8b6bb470ce700
This commit is contained in:
hiyouga 2023-10-19 15:52:24 +08:00
parent c7518f2c5b
commit d539e524fa
3 changed files with 5 additions and 4 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
README.md
View File

@ -368,8 +368,7 @@ python src/export_model.py \
--template default \ --template default \
--finetuning_type lora \ --finetuning_type lora \
--checkpoint_dir path_to_checkpoint \ --checkpoint_dir path_to_checkpoint \
--export_dir path_to_export \ --export_dir path_to_export
--fp16
``` ```
### API Demo ### API Demo

3
README_zh.md
View File

@ -367,8 +367,7 @@ python src/export_model.py \
--template default \ --template default \
--finetuning_type lora \ --finetuning_type lora \
--checkpoint_dir path_to_checkpoint \ --checkpoint_dir path_to_checkpoint \
--output_dir path_to_export \ --export_dir path_to_export
--fp16
``` ```
### API 服务 ### API 服务

3
src/llmtuner/tuner/core/loader.py
View File

@ -240,4 +240,7 @@ def load_model_and_tokenizer(
trainable_params, all_param, 100 * trainable_params / all_param trainable_params, all_param, 100 * trainable_params / all_param
)) ))
if not is_trainable:
logger.info("This IS expected that the trainable params is 0 if you are using model for inference only.")
return model, tokenizer return model, tokenizer