Commit Graph

60 Commits

Author SHA1 Message Date
hoshi-hiyouga
5f38bcaba9 [deps] upgrade vllm (#6857) 2025-02-08 15:02:28 +08:00
Zhangchi Feng
24c7842948 [model] support audio (#6701)
* support qwen2_audio

* improve code

* lint

* fix

* fix

* fix

---------

Co-authored-by: hiyouga <hiyouga@buaa.edu.cn>
2025-02-05 04:59:09 +08:00
hoshi-hiyouga
e2dc5b952a [misc] update license year & fix llama pro (#6814)
* fix llamapro script

* change year
2025-02-05 01:53:33 +08:00
hoshi-hiyouga
15357cdad9 [breaking] support transformers 4.48 (#6628) 2025-01-31 01:36:33 +08:00
zhuHQ
d9189f9f0b [optim] add support to APOLLO (#6617) 2025-01-15 00:24:56 +08:00
Zhangchi Feng
158a127d34 Support Inference of MiniCPM-V-2.6 and MiniCPM-o-2.6 (#6631)
* fix template name

* tiny fix

* support minicpm-o-2.6

* support inference of minicpmv
2025-01-14 17:34:58 +08:00
hoshi-hiyouga
1c7663d304 pin vllm version to 0.6.5 (#6629) 2025-01-14 02:44:02 +08:00
Zhangchi Feng
c3fda5046d Support new features of MiniCPM-V (#6626)
* fix template name

* tiny fix

* support minicpm-o-2.6
2025-01-14 00:26:19 +08:00
hiyouga
f6f630a1c9 refactor mllm param logic 2025-01-10 15:45:48 +00:00
hiyouga
6f5bb3b8e5 fix #6482 2024-12-30 06:03:07 +00:00
hiyouga
5111cac6f8 support report custom args 2024-12-21 21:42:45 +00:00
hiyouga
1324d158f9 support batch infer in vllm 2024-12-04 13:50:00 +00:00
hiyouga
58ab4579dc add vllm config 2024-11-10 21:28:18 +08:00
hiyouga
21db8ed2f4 use pre-commit 2024-10-29 09:07:46 +00:00
hiyouga
3af57795dd tiny fix 2024-10-11 23:51:54 +08:00
Johnny
cb56673675 Update setup.py 2024-10-11 12:29:09 +02:00
hoshi-hiyouga
c2e947de28 Update setup.py 2024-10-07 16:26:50 +08:00
Johnny
6b78d02175 Update setup.py 2024-10-07 10:16:53 +02:00
Johnny
e57f607cb4 Update setup.py 2024-10-06 08:53:55 +02:00
hiyouga
90d6df6222 release v0.9.0 (real) 2024-09-09 01:00:25 +08:00
hiyouga
b6681d7198 support vllm 0.6.0 2024-09-08 02:26:20 +08:00
hiyouga
ebddce5d4a fix #5252 2024-09-04 03:17:54 +08:00
hiyouga
d14edd350d add extra requires 2024-08-27 12:52:12 +08:00
hiyouga
e2a28f51c6 add adam_mini to readme 2024-08-09 20:02:03 +08:00
hiyouga
ad144c2265 support HQQ/EETQ #4113 2024-06-27 00:29:42 +08:00
hiyouga
addca926de improve autogptq integration 2024-06-26 22:11:44 +08:00
hiyouga
095fab58d3 tiny fix about badam 2024-06-25 01:54:53 +08:00
hiyouga
d87108daa6 add license 2024-06-15 17:54:33 +08:00
hiyouga
f1aa6a411a fix #4271 2024-06-15 05:11:33 +08:00
hiyouga
7f20e4722a fix ci 2024-06-08 01:57:36 +08:00
hiyouga
53eb2de75e update readme 2024-06-06 16:59:18 +08:00
hiyouga
4dc0632145 fix setup 2024-06-06 01:39:02 +08:00
hiyouga
83a005e3d4 fix #4079 2024-06-05 16:56:54 +08:00
hiyouga
24e1c0e2ee fix #4022 2024-06-03 18:38:36 +08:00
hiyouga
89ca832740 update readme 2024-05-29 18:39:11 +08:00
hoshi-hiyouga
880b4a9acf Merge pull request #3930 from MengqingCao/npu
Add Ascend npu doc and dependency
2024-05-29 18:33:38 +08:00
MengqingCao
b19d33b9d2 update torch-npu version 2024-05-29 10:05:11 +00:00
MengqingCao
e14f5b37e4 update cann kernels url 2024-05-29 09:53:31 +00:00
hiyouga
1e80a3a638 bump vllm version to 0.4.1 2024-05-28 21:27:27 +08:00
MengqingCao
cd67d6eeb5 add Ascend npu doc and dependency 2024-05-28 01:33:54 +00:00
hiyouga
308edbc426 rename package 2024-05-16 18:39:08 +08:00
hiyouga
1c910079d8 release v0.7.1 2024-05-16 00:57:16 +08:00
hiyouga
75aec4cf8e resolve python 3.8 package 2024-05-09 16:52:27 +08:00
hiyouga
10ab83f4c4 add deepseek moe 236B 2024-05-08 16:37:54 +08:00
hiyouga
34d33e2257 update docs 2024-05-06 21:47:00 +08:00
hiyouga
245fe47ece update webui and add CLIs 2024-05-03 02:58:23 +08:00
hiyouga
32347901d4 fix setup 2024-04-28 03:49:13 +08:00
hiyouga
168f56683a release v0.7.0 2024-04-26 23:18:00 +08:00
hoshi-hiyouga
f4b4a26c64 Update setup.py 2024-04-16 17:10:02 +08:00
Jonery
7ecb61822b resolve gradient checkpointing issue. 2024-04-16 12:05:27 +08:00