Qiaolin Yu
|
30038d9ce7
|
[inference] support sglang backend (#7278)
* Mimic SGLang offline Engine
* Add more tests and args
* Pass all current tests
* Clean Code
* fix sample_params
* clean code
* Fix Stream Chat
* change sglang from engine mode to server mode
* fix
* Fix Review Issues
* Use SGLang Built-In Utilities
* Fix test SGLang
* Some Doc Issue
* fix sglang engine
* add readme
---------
Co-authored-by: Jin Pan <jpan236@wisc.edu>
Co-authored-by: hiyouga <hiyouga@buaa.edu.cn>
|
2025-03-15 04:37:58 +08:00 |
|
hoshi-hiyouga
|
9ccfb97a2c
|
[misc] update format (#7277)
|
2025-03-13 02:53:08 +08:00 |
|
hoshi-hiyouga
|
165d3ed084
|
[model] support gemma3 (#7273)
|
2025-03-13 01:35:23 +08:00 |
|
hoshi-hiyouga
|
142fd7e755
|
[misc] upgrade deps (#7257)
|
2025-03-12 00:33:47 +08:00 |
|
hoshi-hiyouga
|
7c1640ed5f
|
[misc] upgrade format to py39 (#7256)
|
2025-03-12 00:08:41 +08:00 |
|
hoshi-hiyouga
|
7a7071e504
|
Merge pull request #7242 from hiyouga/hiyouga/release
[release] release v0.9.2
Former-commit-id: 6b25268990bf225d84e29d4067595cf720fa12d8
|
2025-03-11 15:28:45 +08:00 |
|
hiyouga
|
99b71768a0
|
support commit info
Former-commit-id: af752b1c27
|
2025-03-11 15:13:59 +08:00 |
|
hiyouga
|
f5810a6e47
|
release v0.9.2
Former-commit-id: aaad963593
|
2025-03-11 14:49:13 +08:00 |
|
hoshi-hiyouga
|
5a29f49fb1
|
[config] update args (#7231)
Former-commit-id: ed8b12e3cb
|
2025-03-10 23:04:43 +08:00 |
|
hoshi-hiyouga
|
002f58ef8e
|
[model] add QwQ 32b (#7179)
Former-commit-id: 64a6fb9b50
|
2025-03-06 11:58:36 +08:00 |
|
Ze-Yi LIN
|
210cdb9557
|
[webui] display swanlab exp link (#7089)
* webui add swanlab link
* change callback name
* update
---------
Co-authored-by: hiyouga <hiyouga@buaa.edu.cn>
Former-commit-id: 891c487503
|
2025-02-27 19:40:54 +08:00 |
|
Kingsley
|
81947f1d2c
|
[model] add paligemma2-mix series (#7060)
Former-commit-id: 19861d5170
|
2025-02-25 18:51:16 +08:00 |
|
hoshi-hiyouga
|
ca78ba964d
|
[model] add models (#7054)
* add qwen25vl awq models
* add moonlight
Former-commit-id: ec1a1bc118
|
2025-02-24 22:05:13 +08:00 |
|
hoshi-hiyouga
|
3fbd4848e8
|
[version] support transformers 449 (#6982)
* support transformers 449
* fix mm plugin
Former-commit-id: b00b290c07
|
2025-02-18 17:05:40 +08:00 |
|
hoshi-hiyouga
|
2baf8bf03d
|
[misc] fix lora regex (#6944)
* fix lora regex
* fix
Former-commit-id: 1ada3ae5a3
|
2025-02-14 21:38:43 +08:00 |
|
hoshi-hiyouga
|
1679930e00
|
[breaking change] refactor data pipeline (#6901)
* refactor data
* rename file
Former-commit-id: 617c8ab467
|
2025-02-13 00:39:20 +08:00 |
|
hoshi-hiyouga
|
ff6658ad27
|
[deps] upgrade vllm (#6857)
Former-commit-id: 5f38bcaba9
|
2025-02-08 15:02:28 +08:00 |
|
hoshi-hiyouga
|
28037c7834
|
fix qwen2vl plugin (#6855)
Former-commit-id: 40048ab77a
|
2025-02-08 10:59:10 +08:00 |
|
Zhangchi Feng
|
01915eaf40
|
[model] support audio (#6701)
* support qwen2_audio
* improve code
* lint
* fix
* fix
* fix
---------
Co-authored-by: hiyouga <hiyouga@buaa.edu.cn>
Former-commit-id: 24c7842948
|
2025-02-05 04:59:09 +08:00 |
|
hoshi-hiyouga
|
1fee69f874
|
[misc] update license year & fix llama pro (#6814)
* fix llamapro script
* change year
Former-commit-id: e2dc5b952a
|
2025-02-05 01:53:33 +08:00 |
|
hoshi-hiyouga
|
445d643ef3
|
[model] add mistral small models (#6786)
Former-commit-id: 94803d8133
|
2025-02-01 04:31:38 +08:00 |
|
hoshi-hiyouga
|
e8c1979b79
|
[model] add qwen2.5 vl models (#6779)
Former-commit-id: 999c7c8fe0
|
2025-01-31 03:00:29 +08:00 |
|
hoshi-hiyouga
|
f6779b0e0c
|
[breaking] support transformers 4.48 (#6628)
Former-commit-id: 15357cdad9
|
2025-01-31 01:36:33 +08:00 |
|
hoshi-hiyouga
|
245de012ca
|
[webui] improve webui & reasoning mode (#6778)
Former-commit-id: 45e68b9f09
|
2025-01-31 00:09:21 +08:00 |
|
qvlehao
|
f5350b103b
|
[model] add deepseek-R1 & show think process (#6767)
Former-commit-id: 28417f862a
|
2025-01-29 12:16:26 +08:00 |
|
hoshi-hiyouga
|
9ef85f8fc4
|
[optim] clean apollo (#6645)
* clean apollo code
* update readme
Former-commit-id: 7a04021d04
|
2025-01-15 01:42:50 +08:00 |
|
zhuHQ
|
763f9b9df0
|
[optim] add support to APOLLO (#6617)
Former-commit-id: d9189f9f0b
|
2025-01-15 00:24:56 +08:00 |
|
Haian Huang(深度眸)
|
864ee06243
|
Support InternLM3 Dense 8B Model (#6640)
* support internlm3
* update
* update
* update
* add hint
Former-commit-id: deacc00b12
|
2025-01-14 18:07:27 +08:00 |
|
Zhangchi Feng
|
201a495154
|
Support new features of MiniCPM-V (#6626)
* fix template name
* tiny fix
* support minicpm-o-2.6
Former-commit-id: c3fda5046d
|
2025-01-14 00:26:19 +08:00 |
|
Zhangchi Feng
|
15bba15725
|
Fix template name of MiniCPM-V (#6620)
* fix template name
* tiny fix
Former-commit-id: 3077f20339
|
2025-01-13 16:46:48 +08:00 |
|
Zhangchi Feng
|
f51ac40f0a
|
Merge branch 'main' into minicpmv
Former-commit-id: fc045d7dd8
|
2025-01-10 20:12:07 +08:00 |
|
hiyouga
|
b471def13d
|
improve template, add phi4 model
Former-commit-id: ae16ea755d
|
2025-01-09 18:27:54 +00:00 |
|
hiyouga
|
da542fad18
|
imporve log
Former-commit-id: 47e17dd689
|
2025-01-08 09:56:10 +00:00 |
|
hiyouga
|
b4174021d6
|
refactor ray integration, support save ckpt
Former-commit-id: d8cac6f546
|
2025-01-07 09:39:10 +00:00 |
|
Zhangchi Feng
|
a0188a430f
|
Merge branch 'hiyouga:main' into minicpmv
Former-commit-id: ab87bd6b13
|
2025-01-04 11:20:33 +08:00 |
|
fzc8578
|
b5ef5059ee
|
add some
Former-commit-id: 79c2d7090c
|
2025-01-04 11:11:15 +08:00 |
|
hiyouga
|
528fb4f799
|
update model name
Former-commit-id: 4b8add7287
|
2025-01-02 12:19:21 +00:00 |
|
hiyouga
|
37c60c7d14
|
add gpt2 model
Former-commit-id: 67442bd497
|
2025-01-02 12:07:38 +00:00 |
|
hiyouga
|
d0e729cd33
|
add deepseek3 model
Former-commit-id: e67b9dcc3a
|
2024-12-30 13:39:20 +00:00 |
|
hiyouga
|
813f5919a3
|
fix #6482
Former-commit-id: 6f5bb3b8e5
|
2024-12-30 06:03:07 +00:00 |
|
hiyouga
|
c83b74ab9e
|
add qvq #6439
Former-commit-id: ee0e400f41
|
2024-12-25 07:52:41 +00:00 |
|
hiyouga
|
353259f03f
|
update readme
Former-commit-id: 8fd38d273e
|
2024-12-23 14:08:59 +00:00 |
|
hoshi-hiyouga
|
8265d6a228
|
Merge pull request #5922 from Tuyohai/main
support granite3 models
Former-commit-id: c23a4d0658
|
2024-12-23 16:46:02 +08:00 |
|
hiyouga
|
433d116080
|
add paligemma2
Former-commit-id: d3509050dc
|
2024-12-18 08:57:26 +00:00 |
|
hoshi-hiyouga
|
d43080b534
|
Merge pull request #6313 from ge-xing/main
support telechat2 model
Former-commit-id: 015f213788
|
2024-12-18 16:16:17 +08:00 |
|
hiyouga
|
a935933bed
|
support llama3 tool prompt
Former-commit-id: b24ae55ebf
|
2024-12-17 15:52:37 +00:00 |
|
zhaohu xing
|
cfb4c42ae4
|
support telechat2 model
Former-commit-id: 04f19ed0f3
|
2024-12-17 12:15:33 +00:00 |
|
hiyouga
|
bff1b94583
|
generalized packing & fix #6343
Former-commit-id: 2d107d3aef
|
2024-12-17 10:26:19 +00:00 |
|
hiyouga
|
235cdcacee
|
support batch infer in vllm
Former-commit-id: 1324d158f9
|
2024-12-04 13:50:00 +00:00 |
|
hiyouga
|
1c3d86cd65
|
add qwq
Former-commit-id: 68a612115a
|
2024-11-28 08:50:57 +00:00 |
|