fix streaming response in API

Former-commit-id: 72a17ae3b4fac2dc93b04a816f16f863120bc71b
This commit is contained in:
hiyouga
2023-07-05 22:42:31 +08:00
parent 82cbbc0e48
commit 83bc87e73f
3 changed files with 10 additions and 8 deletions

View File

@@ -88,7 +88,7 @@ huggingface-cli login
- 🤗Transformers, Datasets, Accelerate, PEFT and TRL
- jieba, rouge_chinese and nltk (used at evaluation)
- gradio and mdtex2html (used in web_demo.py)
- uvicorn and fastapi (used in api_demo.py)
- uvicorn, fastapi and sse_starlette (used in api_demo.py)
And **powerful GPUs**!