update readme

Former-commit-id: acd84ce5350ef985e3712a40442c6f7a54d08d40
This commit is contained in:
hiyouga 2024-06-15 05:13:16 +08:00
parent 19ea51e460
commit 4dcd124dbd
2 changed files with 2 additions and 2 deletions

View File

@ -463,7 +463,7 @@ docker-compose exec llamafactory bash
### Deploy with OpenAI-style API and vLLM ### Deploy with OpenAI-style API and vLLM
```bash ```bash
CUDA_VISIBLE_DEVICES=0,1 API_PORT=8000 llamafactory-cli api examples/inference/llama3_vllm.yaml API_PORT=8000 llamafactory-cli api examples/inference/llama3_vllm.yaml
``` ```
> [!TIP] > [!TIP]

View File

@ -463,7 +463,7 @@ docker-compose exec llamafactory bash
### 利用 vLLM 部署 OpenAI API ### 利用 vLLM 部署 OpenAI API
```bash ```bash
CUDA_VISIBLE_DEVICES=0,1 API_PORT=8000 llamafactory-cli api examples/inference/llama3_vllm.yaml API_PORT=8000 llamafactory-cli api examples/inference/llama3_vllm.yaml
``` ```
> [!TIP] > [!TIP]