Yaser Afshar
fe4546a7bb
Add trust_remote_code parameter and remove True
...
- Introduced a new model parameter `trust_remote_code`
- Set the default value of `trust_remote_code` to `False`
to enhance security
Former-commit-id: 0943776326
2024-12-17 12:25:12 +00:00
hiyouga
a94a1eac67
support control eos, fix #6345
...
Former-commit-id: eda76de32b
2024-12-17 10:42:05 +00:00
hiyouga
88b06a0c7f
support qwen2vl vllm infer
...
Former-commit-id: 207f8b069c
2024-12-05 10:17:26 +00:00
hiyouga
65699c29d4
fix vllm
...
Former-commit-id: 13ee1f5cec
2024-11-25 00:07:24 +08:00
hiyouga
dcc67ac1a5
fix qwen2vl vllm infer
...
Former-commit-id: fa50fc470e
2024-11-24 23:27:24 +08:00
hiyouga
e99031daa4
fix inputs
...
Former-commit-id: 446441fdb0
2024-11-23 18:26:02 +00:00
hoshi-hiyouga
9c394f11ef
fix #5988
...
Former-commit-id: 8d70edf39b
2024-11-11 13:57:14 +08:00
hiyouga
0d18cca0db
add vllm config
...
Former-commit-id: 58ab4579dc
2024-11-10 21:28:18 +08:00
hiyouga
97f4451912
fix #5966
...
Former-commit-id: 8f3a32286e
2024-11-08 23:49:16 +08:00
hiyouga
2360d63ebc
fix chat engines
...
Former-commit-id: 8c88065c38
2024-11-04 08:18:12 +00:00
hiyouga
e83cb17f97
support rank0 logger
...
Former-commit-id: c38aa29336
2024-11-02 18:31:04 +08:00
hiyouga
2eba98e152
add examples
...
Former-commit-id: e824b715ad
2024-11-01 08:41:54 +00:00
hiyouga
8ecc12ee2a
support multiimage inference
...
Former-commit-id: e80a481927
2024-11-01 07:25:20 +00:00
hoshi-hiyouga
15786539d7
fix bug
...
Former-commit-id: bb0afda8fb
2024-10-29 22:19:04 +08:00
hoshi-hiyouga
90cd3538de
Update hf_engine.py
...
Former-commit-id: 6e212fdab5
2024-10-29 22:00:59 +08:00
Kingsley
3053a806e9
Merge branch 'hiyouga:main' into pixtral-patch
...
Former-commit-id: 67f59579d7
2024-10-29 21:01:25 +08:00
hiyouga
0d8aa6e6ef
use pre-commit
...
Former-commit-id: 21db8ed2f4
2024-10-29 09:07:46 +00:00
KUANGDD
62cbcb646a
modify style & little change
...
Former-commit-id: 9d6143e36a
2024-10-23 15:24:07 +08:00
Kingsley
94ce8f561f
fix some errors due to inconsistency of model cards
...
Former-commit-id: 2166b9bc6b
2024-09-30 19:58:34 +08:00
Kingsley
66e473d519
remove some unnecessary if conditions
...
Former-commit-id: de06e2678e
2024-09-28 02:14:06 +08:00
hiyouga
009500bc6d
fix #5411
...
Former-commit-id: c7e51ff187
2024-09-11 17:36:42 +08:00
hiyouga
dc64166d13
update scripts
...
Former-commit-id: f2aa02c070
2024-09-08 14:17:41 +08:00
hiyouga
78cf256067
support vllm 0.6.0
...
Former-commit-id: b6681d7198
2024-09-08 02:26:20 +08:00
hiyouga
7ccb86b215
add docstrings, refactor logger
...
Former-commit-id: 54c6905937
2024-09-08 00:56:56 +08:00
hoshi-hiyouga
4ee9efbd98
fix #5384
...
Former-commit-id: 36665f3001
2024-09-07 01:21:14 +08:00
hiyouga
9df7a26e6b
video datasets
...
Former-commit-id: 8cafc7b055
2024-09-05 02:04:17 +08:00
hiyouga
d5ea05cfff
update get template
...
Former-commit-id: dabad5570b
2024-09-04 22:36:20 +08:00
hiyouga
22deca0e9e
lazy image load
...
Former-commit-id: 47ea97fb1b
2024-09-04 02:27:08 +08:00
hiyouga
b2a5f49a24
fix mm inference
...
Former-commit-id: 60fc6b926e
2024-09-02 01:47:40 +08:00
hiyouga
cb776752f6
fix mixed mm inputs and rlhf-v
...
Former-commit-id: 9967ccb3ae
2024-09-01 20:52:47 +08:00
hiyouga
f31e7e0dfc
remove visual_inputs, fix qlora
...
Former-commit-id: a025c3df61
2024-08-31 00:24:51 +08:00
hiyouga
92c398166d
tiny fix
...
Former-commit-id: bee1bd43b9
2024-08-30 03:21:50 +08:00
hiyouga
a83756b5e9
refactor mm training
...
Former-commit-id: 3382317e32
2024-08-30 02:14:31 +08:00
hiyouga
3baf1d1f7e
fix #4792
...
Former-commit-id: 6b48308ef9
2024-07-13 22:07:58 +08:00
hiyouga
aa15ca1719
fix #4742
...
Former-commit-id: 2f09520c0d
2024-07-09 23:24:24 +08:00
Lian Junhong
7ca84e0a09
chore: Update vllm_engine.py to support vllm version >= 0.5.1
...
Former-commit-id: 322663bf90
2024-07-07 15:08:12 +08:00
hiyouga
956e555310
fix #4674
...
Former-commit-id: ed232311e8
2024-07-05 00:41:03 +08:00
hiyouga
e17f12fcad
fix #4677
...
Former-commit-id: 1e27e8c776
2024-07-04 14:22:07 +08:00
mMrBun
c0e005e2ea
Add tool_format to overwrite tool formatter template
...
Former-commit-id: 20e2e6fdcb
2024-06-22 02:13:23 +08:00
hiyouga
5156114981
fix #4357
...
Former-commit-id: 4bd77d8563
2024-06-18 22:42:45 +08:00
hiyouga
15a5eb6647
fix #4335
...
Former-commit-id: c96264bc47
2024-06-18 22:08:56 +08:00
hiyouga
3d85217464
update chat engine #4335
...
Former-commit-id: 7857c0990b
2024-06-17 19:07:17 +08:00
hiyouga
2946153cea
add license
...
Former-commit-id: d87108daa6
2024-06-15 17:54:33 +08:00
hiyouga
a3f4925c2c
add test cases
...
Former-commit-id: b27269bd2b
2024-06-15 04:05:54 +08:00
hiyouga
833aa324c2
clean code
...
Former-commit-id: 2ed8270112
2024-06-13 01:58:16 +08:00
hzhaoy
65f2ba3802
adapt vllm==0.5.0
...
Former-commit-id: 8fb6366ebe
2024-06-12 18:29:03 +08:00
hiyouga
f8497921fe
fix #4242
...
Former-commit-id: 577de2fa07
2024-06-12 16:50:11 +08:00
Arthur Kim
bebca6d01c
Support vllm==0.5.0
...
Former-commit-id: d65a3f7cb6
2024-06-12 16:49:12 +09:00
hiyouga
8da149ba40
rename files
...
Former-commit-id: 74f96efef9
2024-06-07 00:09:06 +08:00
hiyouga
c439c959f7
add vllm_dtype arg #3387 #3717
...
Former-commit-id: 8fcc79e1e6
2024-06-06 02:53:27 +08:00