Qiaolin Yu
|
30038d9ce7
|
[inference] support sglang backend (#7278)
* Mimic SGLang offline Engine
* Add more tests and args
* Pass all current tests
* Clean Code
* fix sample_params
* clean code
* Fix Stream Chat
* change sglang from engine mode to server mode
* fix
* Fix Review Issues
* Use SGLang Built-In Utilities
* Fix test SGLang
* Some Doc Issue
* fix sglang engine
* add readme
---------
Co-authored-by: Jin Pan <jpan236@wisc.edu>
Co-authored-by: hiyouga <hiyouga@buaa.edu.cn>
|
2025-03-15 04:37:58 +08:00 |
|
hoshi-hiyouga
|
df63f05b47
|
[data] fix loader (#7207)
* fix dataloader
* add test case
* fix type
* fix ci
* fix ci
* fix ci
* disable overwrite cache in ci
Former-commit-id: 8c3f9f6747
|
2025-03-07 17:20:46 +08:00 |
|
hoshi-hiyouga
|
1fee69f874
|
[misc] update license year & fix llama pro (#6814)
* fix llamapro script
* change year
Former-commit-id: e2dc5b952a
|
2025-02-05 01:53:33 +08:00 |
|
hiyouga
|
8524dcaa4a
|
fix #6391
Former-commit-id: d4c1fda1ad
|
2024-12-19 12:16:38 +00:00 |
|
hiyouga
|
95d3c2620b
|
support disable shuffling
Former-commit-id: c7cedc7569
|
2024-12-19 08:53:21 +00:00 |
|
hiyouga
|
3f7c874594
|
update tests
Former-commit-id: 93d3b8f43f
|
2024-11-02 12:41:44 +08:00 |
|
hiyouga
|
825ea1c72d
|
fix #5747
Former-commit-id: ae045c884f
|
2024-10-29 10:47:04 +00:00 |
|
hiyouga
|
0d8aa6e6ef
|
use pre-commit
Former-commit-id: 21db8ed2f4
|
2024-10-29 09:07:46 +00:00 |
|
hiyouga
|
52d3c42265
|
fix ci
Former-commit-id: eb5aa9adce
|
2024-09-05 22:39:47 +08:00 |
|
hiyouga
|
5585713182
|
fix ci
Former-commit-id: 2f939b708f
|
2024-09-05 22:27:48 +08:00 |
|
hiyouga
|
3aa6a3e45b
|
add e2e tests
Former-commit-id: 94d5b1bd8f
|
2024-09-05 21:52:28 +08:00 |
|