hoshi-hiyouga
|
4831552856
|
[infer] set env for vllm ascend (#7745)
|
2025-04-17 01:08:55 +08:00 |
|
hoshi-hiyouga
|
0fe5631f9b
|
[deps] upgrade vllm (#7728)
|
2025-04-15 14:57:40 +08:00 |
|
hoshi-hiyouga
|
3ef36d0057
|
[misc] upgrade cli (#7714)
|
2025-04-14 15:41:22 +08:00 |
|
hoshi-hiyouga
|
5817cda37e
|
[misc] fix packing and eval plot (#7623)
|
2025-04-07 18:20:57 +08:00 |
|
hoshi-hiyouga
|
aaf2e6ba2a
|
[model] fix kv cache (#7564)
|
2025-04-01 23:07:46 +08:00 |
|
hoshi-hiyouga
|
dfbe1391e9
|
[deps] upgrade vllm to 0.8 (#7436)
|
2025-03-23 14:32:22 +08:00 |
|
Qiaolin Yu
|
30038d9ce7
|
[inference] support sglang backend (#7278)
* Mimic SGLang offline Engine
* Add more tests and args
* Pass all current tests
* Clean Code
* fix sample_params
* clean code
* Fix Stream Chat
* change sglang from engine mode to server mode
* fix
* Fix Review Issues
* Use SGLang Built-In Utilities
* Fix test SGLang
* Some Doc Issue
* fix sglang engine
* add readme
---------
Co-authored-by: Jin Pan <jpan236@wisc.edu>
Co-authored-by: hiyouga <hiyouga@buaa.edu.cn>
|
2025-03-15 04:37:58 +08:00 |
|
hoshi-hiyouga
|
9ccfb97a2c
|
[misc] update format (#7277)
|
2025-03-13 02:53:08 +08:00 |
|
hoshi-hiyouga
|
7c1640ed5f
|
[misc] upgrade format to py39 (#7256)
|
2025-03-12 00:08:41 +08:00 |
|
hoshi-hiyouga
|
4e68828e46
|
[config] fix export max len (#7230)
Former-commit-id: 728c2f68190129e88ac375b453c60ed0d6bebbd8
|
2025-03-10 16:46:08 +08:00 |
|
hoshi-hiyouga
|
113cc3d920
|
[misc] fix cli (#7204)
Former-commit-id: bd1722355944a3618f44a4ac3e8177c34b97dc75
|
2025-03-07 15:01:18 +08:00 |
|
hoshi-hiyouga
|
e7556b591e
|
[deps] upgrade vllm (#7183)
Former-commit-id: d739fddb10f51f422c12b1e7d5d7208309bf6c91
|
2025-03-06 15:25:08 +08:00 |
|
hoshi-hiyouga
|
036fb0d561
|
[misc] fix grad ckpt func (#6916)
Former-commit-id: e34c3c06da706f80c74c20800f19110e9ad6b82a
|
2025-02-13 00:17:18 +08:00 |
|
hoshi-hiyouga
|
2e2f6bea07
|
[data] feat: auto template (#6905)
* support auto template
* add unittest
Former-commit-id: 2f8b6847f5e199d770e91346dfe205c4b9f1fbb7
|
2025-02-12 00:22:53 +08:00 |
|
hoshi-hiyouga
|
ff6658ad27
|
[deps] upgrade vllm (#6857)
Former-commit-id: 5f38bcaba921dbdee27b4be4709fcec06fa37c9e
|
2025-02-08 15:02:28 +08:00 |
|
hoshi-hiyouga
|
f70208e1c0
|
[misc] allow extra args (#6831)
Former-commit-id: 74ade3a176cad753971aaad681fea6ff8df40914
|
2025-02-06 12:38:08 +08:00 |
|
hoshi-hiyouga
|
9ef85f8fc4
|
[optim] clean apollo (#6645)
* clean apollo code
* update readme
Former-commit-id: 7a04021d0461caea2c7b82169839340b7f51f463
|
2025-01-15 01:42:50 +08:00 |
|
zhuHQ
|
763f9b9df0
|
[optim] add support to APOLLO (#6617)
Former-commit-id: d9189f9f0b23ff6929044919208e0e813ca95b1c
|
2025-01-15 00:24:56 +08:00 |
|
hoshi-hiyouga
|
5e699458e5
|
pin vllm version to 0.6.5 (#6629)
Former-commit-id: 1c7663d3049e00a9148c3e3c58204deca7a08c8d
|
2025-01-14 02:44:02 +08:00 |
|
hoshi-hiyouga
|
b777fed171
|
Merge pull request #6564 from stephen-nju/fix_ray
Fix ray
Former-commit-id: 6b34b69fa688c4622489d3d5f33d847fb6b95528
|
2025-01-08 18:14:18 +08:00 |
|
zhubin
|
014a7ea042
|
fix get ray args when args not a dict
Former-commit-id: 9c4c84828b77acf48caf60726e4e7ef3e972118d
|
2025-01-08 10:06:02 +00:00 |
|
hiyouga
|
da542fad18
|
imporve log
Former-commit-id: 47e17dd689840ca9b3c5f34448e5f80265336cca
|
2025-01-08 09:56:10 +00:00 |
|
hiyouga
|
b4174021d6
|
refactor ray integration, support save ckpt
Former-commit-id: d8cac6f54663e6cffeddf2c65e3da454e7b86a75
|
2025-01-07 09:39:10 +00:00 |
|
Eric Tang
|
bba52e258e
|
run style check
Former-commit-id: 1e8e7be0a535e55888f58bbe2c38bc1c382e9012
|
2025-01-07 08:55:44 +00:00 |
|
Kourosh Hakhamaneshi
|
1217240918
|
drafting ray integration
Signed-off-by: Kourosh Hakhamaneshi <kourosh@anyscale.com>
Former-commit-id: 163ddb680b6f84a4424a887a3b8a5d668044e87c
|
2025-01-07 08:55:44 +00:00 |
|
hiyouga
|
813f5919a3
|
fix #6482
Former-commit-id: 6f5bb3b8e5b6eb7fdfd7b0ca8eba789ab741a7b6
|
2024-12-30 06:03:07 +00:00 |
|
hiyouga
|
235cdcacee
|
support batch infer in vllm
Former-commit-id: 1324d158f954d777f1fbf09f46149c372704b388
|
2024-12-04 13:50:00 +00:00 |
|
hiyouga
|
0d18cca0db
|
add vllm config
Former-commit-id: 58ab4579dc81a1dcea2bf5938ba3f3116cecfc76
|
2024-11-10 21:28:18 +08:00 |
|
hiyouga
|
e83cb17f97
|
support rank0 logger
Former-commit-id: c38aa29336f286266553da4909a7267d7ef21f37
|
2024-11-02 18:31:04 +08:00 |
|
hiyouga
|
0d8aa6e6ef
|
use pre-commit
Former-commit-id: 21db8ed2f4a0eba203754a92ce0741538e8ee709
|
2024-10-29 09:07:46 +00:00 |
|
hiyouga
|
e90a1199da
|
tiny fix
Former-commit-id: 3af57795dda5d236200bad4aa3f2e29ae8930fe2
|
2024-10-11 23:51:54 +08:00 |
|
Johnny
|
27be1e2122
|
Update parser.py
Former-commit-id: e5849cdcce109e15547edcf9a692e7c13d625e5a
|
2024-10-11 12:29:33 +02:00 |
|
hoshi-hiyouga
|
b855d3421e
|
Update parser.py
Former-commit-id: 1ce0b42b1e30cb5419c91702a499f23d52db43ee
|
2024-10-07 16:27:23 +08:00 |
|
Johnny
|
059c2ffbea
|
Update parser.py
Former-commit-id: 4e638777ebcbf7dea22011361fb341bafe6ba9d9
|
2024-10-07 10:17:45 +02:00 |
|
Johnny
|
9a6045eee6
|
Update parser.py
Former-commit-id: 6c1aef55604649a956fe928d89280626923815b8
|
2024-10-06 20:34:19 +02:00 |
|
hiyouga
|
56132983cf
|
fix #5611
Former-commit-id: a45f3f5461e2936b9e119eda2ef4d8c7a4131740
|
2024-10-06 10:34:55 +08:00 |
|
hiyouga
|
78cf256067
|
support vllm 0.6.0
Former-commit-id: b6681d7198acf4acbebfe271dd22095e236bc430
|
2024-09-08 02:26:20 +08:00 |
|
hiyouga
|
f31e7e0dfc
|
remove visual_inputs, fix qlora
Former-commit-id: a025c3df61db154bef13033518903bbf846f4fc8
|
2024-08-31 00:24:51 +08:00 |
|
hiyouga
|
a83756b5e9
|
refactor mm training
Former-commit-id: 3382317e32f88ed377d3e7759bdeaf0f2559d22a
|
2024-08-30 02:14:31 +08:00 |
|
hiyouga
|
0e4ee9d9a3
|
update liger kernel
Former-commit-id: a7dd7d325e68c92c7470c1e9ef83a7c8abcbc616
|
2024-08-29 20:46:08 +08:00 |
|
hiyouga
|
f153ee13be
|
fix #5292
Former-commit-id: aa1afdc75614868172bd2f9c052647b8f226d3f2
|
2024-08-29 20:37:47 +08:00 |
|
hiyouga
|
c765292093
|
support liger kernel
Former-commit-id: 72bc8f01111ad69b92a647b54b4af988515d9c34
|
2024-08-27 11:20:14 +08:00 |
|
hiyouga
|
5eacd17090
|
add adam_mini to readme
Former-commit-id: e2a28f51c635d64ff9de65a37087d89356bdedcc
|
2024-08-09 20:02:03 +08:00 |
|
hiyouga
|
b5146facff
|
follow #5115
Former-commit-id: c87023d539875cd8e622d40212a5627c9c182fb8
|
2024-08-09 18:03:00 +08:00 |
|
hiyouga
|
542658c986
|
update parser
Former-commit-id: 8f6995081cbdbb2424da586a443e5220a8990faa
|
2024-07-19 01:36:39 +08:00 |
|
hiyouga
|
34f16cc635
|
follow #4878 fix #4684
Former-commit-id: 779aae83d253de0a86201ff87543b5d695e28d23
|
2024-07-18 22:06:12 +08:00 |
|
Shiyu Zhang
|
249adacc4d
|
仅仅训练最后一轮对话
Former-commit-id: 1e7b396ff2489055574fd3365425d26360d73897
|
2024-07-18 15:30:25 +08:00 |
|
hiyouga
|
e90fae61f4
|
support batch_eval_metrics, fix #4826
Former-commit-id: d774b94f124923829b2eae428e25199d503ebfcb
|
2024-07-17 00:33:00 +08:00 |
|
hiyouga
|
22859b8734
|
allow computing rouge in training
Former-commit-id: 99ab7a8c1c966232faa11b6a42b9740d9a20ace3
|
2024-07-15 01:16:26 +08:00 |
|
hiyouga
|
14bc7b0551
|
fix up
Former-commit-id: 29ebcd75d55f70f2891632eba187b643cc3a9e51
|
2024-07-15 01:04:56 +08:00 |
|