21 Commits

Author	SHA1	Message	Date
hiyouga	a3f4925c2c	add test cases ... Former-commit-id: b27269bd2b	2024-06-15 04:05:54 +08:00
hiyouga	833aa324c2	clean code ... Former-commit-id: 2ed8270112	2024-06-13 01:58:16 +08:00
hzhaoy	65f2ba3802	adapt vllm==0.5.0 ... Former-commit-id: 8fb6366ebe	2024-06-12 18:29:03 +08:00
hiyouga	f8497921fe	fix #4242 ... Former-commit-id: 577de2fa07	2024-06-12 16:50:11 +08:00
Arthur Kim	bebca6d01c	Support vllm==0.5.0 ... Former-commit-id: d65a3f7cb6	2024-06-12 16:49:12 +09:00
hiyouga	8da149ba40	rename files ... Former-commit-id: 74f96efef9	2024-06-07 00:09:06 +08:00
hiyouga	c439c959f7	add vllm_dtype arg #3387 #3717 ... Former-commit-id: 8fcc79e1e6	2024-06-06 02:53:27 +08:00
hiyouga	88745c9bb5	fix #3873 ... Former-commit-id: 91611d68c4	2024-06-04 00:21:50 +08:00
hiyouga	d0ceb1b091	fix #4022 ... Former-commit-id: 24e1c0e2ee	2024-06-03 18:38:36 +08:00
hiyouga	05277ee864	fix hf chat engine ... Former-commit-id: 97346c1d3d	2024-05-29 01:20:07 +08:00
hiyouga	df33548b39	update readme ... Former-commit-id: 5581cb2e4e	2024-05-27 18:14:02 +08:00
hiyouga	3e729798df	refactor data preprocessing, fix mllm rlhf ... Former-commit-id: 3a023bca2a	2024-05-24 04:08:25 +08:00
hiyouga	446c681b58	fix paligemma inference ... Former-commit-id: 542229abb3	2024-05-20 23:36:43 +08:00
hiyouga	864da49139	fix chat engines ... do not use pop(key, default) since api assigns None to dict values Former-commit-id: d52fae2fa8	2024-05-20 00:36:43 +08:00
hoshi-hiyouga	02fdf903e8	Update vllm_engine.py ... Former-commit-id: a0e8d3d159	2024-05-20 00:31:04 +08:00
hoshi-hiyouga	30b2ec7025	Update hf_engine.py ... Former-commit-id: a943a1034b	2024-05-20 00:30:45 +08:00
hoshi-hiyouga	b293939c24	Update chat_model.py ... Former-commit-id: 896c656185	2024-05-20 00:29:12 +08:00
ycjcl868	b28f9ecaa0	feat: cli chat support system_message ... Former-commit-id: a08ba254c8	2024-05-19 23:17:46 +08:00
hiyouga	5f48c282d3	fix hf gen args ... Former-commit-id: 70214b71b1	2024-05-19 19:39:32 +08:00
juejuezi	20326affde	feat: pass the max_lora_rank parameter to vLLM backend ... Former-commit-id: b20d62ba3c	2024-05-17 16:07:39 +08:00
hiyouga	cae823ddf0	rename package ... Former-commit-id: 308edbc426	2024-05-16 18:39:08 +08:00