58 Commits

Author	SHA1	Message	Date
hiyouga	d52fae2fa8	fix chat engines ... do not use pop(key, default) since api assigns None to dict values	2024-05-20 00:36:43 +08:00
hoshi-hiyouga	a0e8d3d159	Update vllm_engine.py	2024-05-20 00:31:04 +08:00
hoshi-hiyouga	a943a1034b	Update hf_engine.py	2024-05-20 00:30:45 +08:00
hoshi-hiyouga	896c656185	Update chat_model.py	2024-05-20 00:29:12 +08:00
ycjcl868	a08ba254c8	feat: cli chat support system_message	2024-05-19 23:17:46 +08:00
hiyouga	70214b71b1	fix hf gen args	2024-05-19 19:39:32 +08:00
juejuezi	b20d62ba3c	feat: pass the max_lora_rank parameter to vLLM backend	2024-05-17 16:07:39 +08:00
hiyouga	308edbc426	rename package	2024-05-16 18:39:08 +08:00