leo-pony
acc52e0fe7
[npu] update cann base image and torch 2.4 ( #7061 )
...
* Update base npu container image version:The Python version required for Hugging Face Transformers is >= python3.10
* Fix the bug: arg type of INSTALL_DEEPSPEED shoud been string now.
* Update Ascend CANN, CANN-Kernel and corresponding torch and torch-npu version
* Upgrade torch-npu needs packages' version: torch==2.1.0 and torch-npu==2.4.0.post2
2025-02-25 23:32:01 +08:00
hoshi-hiyouga
5f38bcaba9
[deps] upgrade vllm ( #6857 )
2025-02-08 15:02:28 +08:00
Zhangchi Feng
24c7842948
[model] support audio ( #6701 )
...
* support qwen2_audio
* improve code
* lint
* fix
* fix
* fix
---------
Co-authored-by: hiyouga <hiyouga@buaa.edu.cn >
2025-02-05 04:59:09 +08:00
hoshi-hiyouga
e2dc5b952a
[misc] update license year & fix llama pro ( #6814 )
...
* fix llamapro script
* change year
2025-02-05 01:53:33 +08:00
hoshi-hiyouga
15357cdad9
[breaking] support transformers 4.48 ( #6628 )
2025-01-31 01:36:33 +08:00
zhuHQ
d9189f9f0b
[optim] add support to APOLLO ( #6617 )
2025-01-15 00:24:56 +08:00
Zhangchi Feng
158a127d34
Support Inference of MiniCPM-V-2.6 and MiniCPM-o-2.6 ( #6631 )
...
* fix template name
* tiny fix
* support minicpm-o-2.6
* support inference of minicpmv
2025-01-14 17:34:58 +08:00
hoshi-hiyouga
1c7663d304
pin vllm version to 0.6.5 ( #6629 )
2025-01-14 02:44:02 +08:00
Zhangchi Feng
c3fda5046d
Support new features of MiniCPM-V ( #6626 )
...
* fix template name
* tiny fix
* support minicpm-o-2.6
2025-01-14 00:26:19 +08:00
hiyouga
f6f630a1c9
refactor mllm param logic
2025-01-10 15:45:48 +00:00
hiyouga
6f5bb3b8e5
fix #6482
2024-12-30 06:03:07 +00:00
hiyouga
5111cac6f8
support report custom args
2024-12-21 21:42:45 +00:00
hiyouga
1324d158f9
support batch infer in vllm
2024-12-04 13:50:00 +00:00
hiyouga
58ab4579dc
add vllm config
2024-11-10 21:28:18 +08:00
hiyouga
21db8ed2f4
use pre-commit
2024-10-29 09:07:46 +00:00
hiyouga
3af57795dd
tiny fix
2024-10-11 23:51:54 +08:00
Johnny
cb56673675
Update setup.py
2024-10-11 12:29:09 +02:00
hoshi-hiyouga
c2e947de28
Update setup.py
2024-10-07 16:26:50 +08:00
Johnny
6b78d02175
Update setup.py
2024-10-07 10:16:53 +02:00
Johnny
e57f607cb4
Update setup.py
2024-10-06 08:53:55 +02:00
hiyouga
90d6df6222
release v0.9.0 (real)
2024-09-09 01:00:25 +08:00
hiyouga
b6681d7198
support vllm 0.6.0
2024-09-08 02:26:20 +08:00
hiyouga
ebddce5d4a
fix #5252
2024-09-04 03:17:54 +08:00
hiyouga
d14edd350d
add extra requires
2024-08-27 12:52:12 +08:00
hiyouga
e2a28f51c6
add adam_mini to readme
2024-08-09 20:02:03 +08:00
hiyouga
ad144c2265
support HQQ/EETQ #4113
2024-06-27 00:29:42 +08:00
hiyouga
addca926de
improve autogptq integration
2024-06-26 22:11:44 +08:00
hiyouga
095fab58d3
tiny fix about badam
2024-06-25 01:54:53 +08:00
hiyouga
d87108daa6
add license
2024-06-15 17:54:33 +08:00
hiyouga
f1aa6a411a
fix #4271
2024-06-15 05:11:33 +08:00
hiyouga
7f20e4722a
fix ci
2024-06-08 01:57:36 +08:00
hiyouga
53eb2de75e
update readme
2024-06-06 16:59:18 +08:00
hiyouga
4dc0632145
fix setup
2024-06-06 01:39:02 +08:00
hiyouga
83a005e3d4
fix #4079
2024-06-05 16:56:54 +08:00
hiyouga
24e1c0e2ee
fix #4022
2024-06-03 18:38:36 +08:00
hiyouga
89ca832740
update readme
2024-05-29 18:39:11 +08:00
hoshi-hiyouga
880b4a9acf
Merge pull request #3930 from MengqingCao/npu
...
Add Ascend npu doc and dependency
2024-05-29 18:33:38 +08:00
MengqingCao
b19d33b9d2
update torch-npu version
2024-05-29 10:05:11 +00:00
MengqingCao
e14f5b37e4
update cann kernels url
2024-05-29 09:53:31 +00:00
hiyouga
1e80a3a638
bump vllm version to 0.4.1
2024-05-28 21:27:27 +08:00
MengqingCao
cd67d6eeb5
add Ascend npu doc and dependency
2024-05-28 01:33:54 +00:00
hiyouga
308edbc426
rename package
2024-05-16 18:39:08 +08:00
hiyouga
1c910079d8
release v0.7.1
2024-05-16 00:57:16 +08:00
hiyouga
75aec4cf8e
resolve python 3.8 package
2024-05-09 16:52:27 +08:00
hiyouga
10ab83f4c4
add deepseek moe 236B
2024-05-08 16:37:54 +08:00
hiyouga
34d33e2257
update docs
2024-05-06 21:47:00 +08:00
hiyouga
245fe47ece
update webui and add CLIs
2024-05-03 02:58:23 +08:00
hiyouga
32347901d4
fix setup
2024-04-28 03:49:13 +08:00
hiyouga
168f56683a
release v0.7.0
2024-04-26 23:18:00 +08:00
hoshi-hiyouga
f4b4a26c64
Update setup.py
2024-04-16 17:10:02 +08:00