update readme

Former-commit-id: 725f7cd70fce502728f785282f1c0d59f23ff434
This commit is contained in:
hiyouga 2024-03-07 20:34:49 +08:00
parent 583d956bda
commit 1af71f548c
2 changed files with 2 additions and 2 deletions

View File

@ -577,7 +577,7 @@ CUDA_VISIBLE_DEVICES=0 python src/export_model.py \
### Inference with OpenAI-style API
```bash
CUDA_VISIBLE_DEVICES=0 python src/api_demo.py \
CUDA_VISIBLE_DEVICES=0 API_PORT=8000 python src/api_demo.py \
--model_name_or_path path_to_llama_model \
--adapter_name_or_path path_to_checkpoint \
--template default \

View File

@ -576,7 +576,7 @@ CUDA_VISIBLE_DEVICES=0 python src/export_model.py \
### 使用 OpenAI 风格 API 推理
```bash
CUDA_VISIBLE_DEVICES=0 python src/api_demo.py \
CUDA_VISIBLE_DEVICES=0 API_PORT=8000 python src/api_demo.py \
--model_name_or_path path_to_llama_model \
--adapter_name_or_path path_to_checkpoint \
--template default \