36 Commits

Author	SHA1	Message	Date
hiyouga	60fc6b926e	fix mm inference	2024-09-02 01:47:40 +08:00
hiyouga	9967ccb3ae	fix mixed mm inputs and rlhf-v	2024-09-01 20:52:47 +08:00
hiyouga	a025c3df61	remove visual_inputs, fix qlora	2024-08-31 00:24:51 +08:00
hiyouga	bee1bd43b9	tiny fix	2024-08-30 03:21:50 +08:00
hiyouga	3382317e32	refactor mm training	2024-08-30 02:14:31 +08:00
hiyouga	6b48308ef9	fix #4792	2024-07-13 22:07:58 +08:00
hiyouga	2f09520c0d	fix #4742	2024-07-09 23:24:24 +08:00
Lian Junhong	322663bf90	chore: Update vllm_engine.py to support vllm version >= 0.5.1	2024-07-07 15:08:12 +08:00
hiyouga	ed232311e8	fix #4674	2024-07-05 00:41:03 +08:00
hiyouga	1e27e8c776	fix #4677	2024-07-04 14:22:07 +08:00
mMrBun	20e2e6fdcb	Add tool_format to overwrite tool formatter template	2024-06-22 02:13:23 +08:00
hiyouga	4bd77d8563	fix #4357	2024-06-18 22:42:45 +08:00
hiyouga	c96264bc47	fix #4335	2024-06-18 22:08:56 +08:00
hiyouga	7857c0990b	update chat engine #4335	2024-06-17 19:07:17 +08:00
hiyouga	d87108daa6	add license	2024-06-15 17:54:33 +08:00
hiyouga	b27269bd2b	add test cases	2024-06-15 04:05:54 +08:00
hiyouga	2ed8270112	clean code	2024-06-13 01:58:16 +08:00
hzhaoy	8fb6366ebe	adapt vllm==0.5.0	2024-06-12 18:29:03 +08:00
hiyouga	577de2fa07	fix #4242	2024-06-12 16:50:11 +08:00
Arthur Kim	d65a3f7cb6	Support vllm==0.5.0	2024-06-12 16:49:12 +09:00
hiyouga	74f96efef9	rename files	2024-06-07 00:09:06 +08:00
hiyouga	8fcc79e1e6	add vllm_dtype arg #3387 #3717	2024-06-06 02:53:27 +08:00
hiyouga	91611d68c4	fix #3873	2024-06-04 00:21:50 +08:00
hiyouga	24e1c0e2ee	fix #4022	2024-06-03 18:38:36 +08:00
hiyouga	97346c1d3d	fix hf chat engine	2024-05-29 01:20:07 +08:00
hiyouga	5581cb2e4e	update readme	2024-05-27 18:14:02 +08:00
hiyouga	3a023bca2a	refactor data preprocessing, fix mllm rlhf	2024-05-24 04:08:25 +08:00
hiyouga	542229abb3	fix paligemma inference	2024-05-20 23:36:43 +08:00
hiyouga	d52fae2fa8	fix chat engines ... do not use pop(key, default) since api assigns None to dict values	2024-05-20 00:36:43 +08:00
hoshi-hiyouga	a0e8d3d159	Update vllm_engine.py	2024-05-20 00:31:04 +08:00
hoshi-hiyouga	a943a1034b	Update hf_engine.py	2024-05-20 00:30:45 +08:00
hoshi-hiyouga	896c656185	Update chat_model.py	2024-05-20 00:29:12 +08:00
ycjcl868	a08ba254c8	feat: cli chat support system_message	2024-05-19 23:17:46 +08:00
hiyouga	70214b71b1	fix hf gen args	2024-05-19 19:39:32 +08:00
juejuezi	b20d62ba3c	feat: pass the max_lora_rank parameter to vLLM backend	2024-05-17 16:07:39 +08:00
hiyouga	308edbc426	rename package	2024-05-16 18:39:08 +08:00