Qiaolin Yu 30038d9ce7

[inference] support sglang backend (#7278) ...

* Mimic SGLang offline Engine

* Add more tests and args

* Pass all current tests

* Clean Code

* fix sample_params

* clean code

* Fix Stream Chat

* change sglang from engine mode to server mode

* fix

* Fix Review Issues

* Use SGLang Built-In Utilities

* Fix test SGLang

* Some Doc Issue

* fix sglang engine

* add readme

---------

Co-authored-by: Jin Pan <jpan236@wisc.edu>
Co-authored-by: hiyouga <hiyouga@buaa.edu.cn>

2025-03-15 04:37:58 +08:00

..

data

[data] gemma3 plugin pan and scan (#7294)

2025-03-13 23:29:23 +08:00

e2e

[inference] support sglang backend (#7278)

2025-03-15 04:37:58 +08:00

eval

[misc] update license year & fix llama pro (#6814)

2025-02-05 01:53:33 +08:00

model

[misc] upgrade format to py39 (#7256)

2025-03-12 00:08:41 +08:00

train

[misc] upgrade format to py39 (#7256)

2025-03-12 00:08:41 +08:00

check_license.py

[misc] update format (#7277)

2025-03-13 02:53:08 +08:00