hiyouga
|
2eba98e152
|
add examples
Former-commit-id: e824b715ad4bf885241b245b12d75563adab2e26
|
2024-11-01 08:41:54 +00:00 |
|
hiyouga
|
8ecc12ee2a
|
support multiimage inference
Former-commit-id: e80a4819274d46ac9e85db7469dc59d7c4e323c7
|
2024-11-01 07:25:20 +00:00 |
|
hiyouga
|
0d8aa6e6ef
|
use pre-commit
Former-commit-id: 21db8ed2f4a0eba203754a92ce0741538e8ee709
|
2024-10-29 09:07:46 +00:00 |
|
hiyouga
|
dc64166d13
|
update scripts
Former-commit-id: f2aa02c070b1442bfb58a075f22af25386192bfa
|
2024-09-08 14:17:41 +08:00 |
|
hiyouga
|
78cf256067
|
support vllm 0.6.0
Former-commit-id: b6681d7198acf4acbebfe271dd22095e236bc430
|
2024-09-08 02:26:20 +08:00 |
|
hiyouga
|
7ccb86b215
|
add docstrings, refactor logger
Former-commit-id: 54c69059379d77dc9046c144cbe2d0253de3a4da
|
2024-09-08 00:56:56 +08:00 |
|
hoshi-hiyouga
|
4ee9efbd98
|
fix #5384
Former-commit-id: 36665f3001647b8411ba0e256d1e64eb157abfaf
|
2024-09-07 01:21:14 +08:00 |
|
hiyouga
|
d5ea05cfff
|
update get template
Former-commit-id: dabad5570bf4a6b1044c963d8f27717030f373ef
|
2024-09-04 22:36:20 +08:00 |
|
hiyouga
|
b2a5f49a24
|
fix mm inference
Former-commit-id: 60fc6b926ead923dbb487b595ed4aa4cbfd94805
|
2024-09-02 01:47:40 +08:00 |
|
hiyouga
|
cb776752f6
|
fix mixed mm inputs and rlhf-v
Former-commit-id: 9967ccb3aef3ca557ad6eafb78c6c99866857008
|
2024-09-01 20:52:47 +08:00 |
|
hiyouga
|
f31e7e0dfc
|
remove visual_inputs, fix qlora
Former-commit-id: a025c3df61db154bef13033518903bbf846f4fc8
|
2024-08-31 00:24:51 +08:00 |
|
hiyouga
|
92c398166d
|
tiny fix
Former-commit-id: bee1bd43b946501690d70e4980205f9d82404296
|
2024-08-30 03:21:50 +08:00 |
|
hiyouga
|
aa15ca1719
|
fix #4742
Former-commit-id: 2f09520c0d5039a5a8be310ab668272cb4dc1bd3
|
2024-07-09 23:24:24 +08:00 |
|
Lian Junhong
|
7ca84e0a09
|
chore: Update vllm_engine.py to support vllm version >= 0.5.1
Former-commit-id: 322663bf90ce7b99ca5b0b43ff9dbd95eb36ff6b
|
2024-07-07 15:08:12 +08:00 |
|
hiyouga
|
e17f12fcad
|
fix #4677
Former-commit-id: 1e27e8c776acadf312804a6d9a243955427e9978
|
2024-07-04 14:22:07 +08:00 |
|
mMrBun
|
c0e005e2ea
|
Add tool_format to overwrite tool formatter template
Former-commit-id: 20e2e6fdcb0cd1771906be035745a2d9fcd3e138
|
2024-06-22 02:13:23 +08:00 |
|
hiyouga
|
15a5eb6647
|
fix #4335
Former-commit-id: c96264bc477d65276557e9059cac7c550c4835a8
|
2024-06-18 22:08:56 +08:00 |
|
hiyouga
|
2946153cea
|
add license
Former-commit-id: d87108daa68bd40174b262be1ca65fe6e1b7ab56
|
2024-06-15 17:54:33 +08:00 |
|
hiyouga
|
a3f4925c2c
|
add test cases
Former-commit-id: b27269bd2b52fb9d43cde8a8b7f293099b0127a2
|
2024-06-15 04:05:54 +08:00 |
|
hiyouga
|
833aa324c2
|
clean code
Former-commit-id: 2ed8270112755971e3f2dfd2f29c5939b077330a
|
2024-06-13 01:58:16 +08:00 |
|
hzhaoy
|
65f2ba3802
|
adapt vllm==0.5.0
Former-commit-id: 8fb6366ebec432c1333c80eb51007460ac5896bd
|
2024-06-12 18:29:03 +08:00 |
|
hiyouga
|
f8497921fe
|
fix #4242
Former-commit-id: 577de2fa078ee62d61bca24b75fa59590e2ef66b
|
2024-06-12 16:50:11 +08:00 |
|
Arthur Kim
|
bebca6d01c
|
Support vllm==0.5.0
Former-commit-id: d65a3f7cb6dcd34e9a3ff9e30dffc52a7671d50b
|
2024-06-12 16:49:12 +09:00 |
|
hiyouga
|
8da149ba40
|
rename files
Former-commit-id: 74f96efef9bcd63f65d0190c901ff9be54ccd350
|
2024-06-07 00:09:06 +08:00 |
|
hiyouga
|
c439c959f7
|
add vllm_dtype arg #3387 #3717
Former-commit-id: 8fcc79e1e66a4e952710ac8c98685437d924361a
|
2024-06-06 02:53:27 +08:00 |
|
hiyouga
|
d0ceb1b091
|
fix #4022
Former-commit-id: 24e1c0e2ee365812357fb9cf82e2162915299a26
|
2024-06-03 18:38:36 +08:00 |
|
hiyouga
|
df33548b39
|
update readme
Former-commit-id: 5581cb2e4e59f3f8109e2acd4611789f9e50bfca
|
2024-05-27 18:14:02 +08:00 |
|
hiyouga
|
3e729798df
|
refactor data preprocessing, fix mllm rlhf
Former-commit-id: 3a023bca2a502810a436cfba7708df164754ea62
|
2024-05-24 04:08:25 +08:00 |
|
hiyouga
|
446c681b58
|
fix paligemma inference
Former-commit-id: 542229abb3aba2032d4c52a878c0fd35ba299691
|
2024-05-20 23:36:43 +08:00 |
|
hiyouga
|
864da49139
|
fix chat engines
do not use pop(key, default) since api assigns None to dict values
Former-commit-id: d52fae2fa866afeb6156dc98388ce5cc6d5eca77
|
2024-05-20 00:36:43 +08:00 |
|
hoshi-hiyouga
|
02fdf903e8
|
Update vllm_engine.py
Former-commit-id: a0e8d3d159444a73a5ff07af3815cd2aaee0b056
|
2024-05-20 00:31:04 +08:00 |
|
juejuezi
|
20326affde
|
feat: pass the max_lora_rank parameter to vLLM backend
Former-commit-id: b20d62ba3ccc5c02529d19e22b7adcfe8b88c326
|
2024-05-17 16:07:39 +08:00 |
|
hiyouga
|
cae823ddf0
|
rename package
Former-commit-id: 308edbc4260d45907b4a9d3a45ec21d83e48aacb
|
2024-05-16 18:39:08 +08:00 |
|