Commit Graph

2 Commits

Author SHA1 Message Date
hiyouga
1324d158f9 support batch infer in vllm 2024-12-04 13:50:00 +00:00
JieShen
961e8c2d2e add vllm_infer script 2024-11-29 14:22:20 +08:00