Commit Graph

20 Commits

Author SHA1 Message Date
Lian Junhong
322663bf90 chore: Update vllm_engine.py to support vllm version >= 0.5.1 2024-07-07 15:08:12 +08:00
hiyouga
1e27e8c776 fix #4677 2024-07-04 14:22:07 +08:00
mMrBun
20e2e6fdcb Add tool_format to overwrite tool formatter template 2024-06-22 02:13:23 +08:00
hiyouga
c96264bc47 fix #4335 2024-06-18 22:08:56 +08:00
hiyouga
d87108daa6 add license 2024-06-15 17:54:33 +08:00
hiyouga
b27269bd2b add test cases 2024-06-15 04:05:54 +08:00
hiyouga
2ed8270112 clean code 2024-06-13 01:58:16 +08:00
hzhaoy
8fb6366ebe adapt vllm==0.5.0 2024-06-12 18:29:03 +08:00
hiyouga
577de2fa07 fix #4242 2024-06-12 16:50:11 +08:00
Arthur Kim
d65a3f7cb6 Support vllm==0.5.0 2024-06-12 16:49:12 +09:00
hiyouga
74f96efef9 rename files 2024-06-07 00:09:06 +08:00
hiyouga
8fcc79e1e6 add vllm_dtype arg #3387 #3717 2024-06-06 02:53:27 +08:00
hiyouga
24e1c0e2ee fix #4022 2024-06-03 18:38:36 +08:00
hiyouga
5581cb2e4e update readme 2024-05-27 18:14:02 +08:00
hiyouga
3a023bca2a refactor data preprocessing, fix mllm rlhf 2024-05-24 04:08:25 +08:00
hiyouga
542229abb3 fix paligemma inference 2024-05-20 23:36:43 +08:00
hiyouga
d52fae2fa8 fix chat engines
do not use pop(key, default) since api assigns None to dict values
2024-05-20 00:36:43 +08:00
hoshi-hiyouga
a0e8d3d159 Update vllm_engine.py 2024-05-20 00:31:04 +08:00
juejuezi
b20d62ba3c feat: pass the max_lora_rank parameter to vLLM backend 2024-05-17 16:07:39 +08:00
hiyouga
308edbc426 rename package 2024-05-16 18:39:08 +08:00