6 Commits

Author	SHA1	Message	Date
hoshi-hiyouga	1c7663d304	pin vllm version to 0.6.5 (#6629)	2025-01-14 02:44:02 +08:00
hoshi-hiyouga	e3e2c8c689	[inference] fix stop token for object detection (#6624) ... * fix stop token * update minicpm data pipeline * fix npu qlora examples	2025-01-13 21:34:20 +08:00
hiyouga	dd44c65d7f	update scripts	2025-01-03 10:50:32 +00:00
hiyouga	207f8b069c	support qwen2vl vllm infer	2024-12-05 10:17:26 +00:00
hiyouga	1324d158f9	support batch infer in vllm	2024-12-04 13:50:00 +00:00
JieShen	961e8c2d2e	add vllm_infer script	2024-11-29 14:22:20 +08:00