Commit Graph

124 Commits

Author SHA1 Message Date
taoharry
6faa6fb53d [webui] fix launch with proxy (#7332) 2025-04-01 15:52:56 +08:00
hoshi-hiyouga
dfbe1391e9 [deps] upgrade vllm to 0.8 (#7436) 2025-03-23 14:32:22 +08:00
Qiaolin Yu
30038d9ce7 [inference] support sglang backend (#7278)
* Mimic SGLang offline Engine

* Add more tests and args

* Pass all current tests

* Clean Code

* fix sample_params

* clean code

* Fix Stream Chat

* change sglang from engine mode to server mode

* fix

* Fix Review Issues

* Use SGLang Built-In Utilities

* Fix test SGLang

* Some Doc Issue

* fix sglang engine

* add readme

---------

Co-authored-by: Jin Pan <jpan236@wisc.edu>
Co-authored-by: hiyouga <hiyouga@buaa.edu.cn>
2025-03-15 04:37:58 +08:00
hoshi-hiyouga
7c1640ed5f [misc] upgrade format to py39 (#7256) 2025-03-12 00:08:41 +08:00
Ze-Yi LIN
0a43bc1960 [tracking] add swanlab_logdir param (#7219)
* feat: add swanlab_logdir param

* fix

Former-commit-id: a1e76af3d9
2025-03-11 00:53:07 +08:00
hoshi-hiyouga
eba31ae313 [webui] support escape html (#7190)
Former-commit-id: abb23f7673
2025-03-06 16:52:21 +08:00
hoshi-hiyouga
392533e139 [webui] fix webui (#7142)
Former-commit-id: 17ba2d5082
2025-03-04 00:01:49 +08:00
Ze-Yi LIN
210cdb9557 [webui] display swanlab exp link (#7089)
* webui add swanlab link

* change callback name

* update

---------

Co-authored-by: hiyouga <hiyouga@buaa.edu.cn>
Former-commit-id: 891c487503
2025-02-27 19:40:54 +08:00
hoshi-hiyouga
f4aa0a146c [misc] fix project toml (#7067)
Former-commit-id: 96fd510e6a
2025-02-25 23:22:48 +08:00
hoshi-hiyouga
b0bbacaacb [webui] update css (#6985)
Former-commit-id: 302ecb00fe
2025-02-18 18:27:57 +08:00
hoshi-hiyouga
2e954d8fd2 [data] refactor template (#6896)
Former-commit-id: d1b8aa3835
2025-02-11 17:59:25 +08:00
hoshi-hiyouga
fcd0f0480d [dataset] add openthought (#6866)
Former-commit-id: 1356f9d840
2025-02-09 00:53:01 +08:00
hoshi-hiyouga
ff6658ad27 [deps] upgrade vllm (#6857)
Former-commit-id: 5f38bcaba9
2025-02-08 15:02:28 +08:00
Zhangchi Feng
01915eaf40 [model] support audio (#6701)
* support qwen2_audio

* improve code

* lint

* fix

* fix

* fix

---------

Co-authored-by: hiyouga <hiyouga@buaa.edu.cn>
Former-commit-id: 24c7842948
2025-02-05 04:59:09 +08:00
hoshi-hiyouga
1fee69f874 [misc] update license year & fix llama pro (#6814)
* fix llamapro script

* change year

Former-commit-id: e2dc5b952a
2025-02-05 01:53:33 +08:00
hoshi-hiyouga
f6779b0e0c [breaking] support transformers 4.48 (#6628)
Former-commit-id: 15357cdad9
2025-01-31 01:36:33 +08:00
hoshi-hiyouga
245de012ca [webui] improve webui & reasoning mode (#6778)
Former-commit-id: 45e68b9f09
2025-01-31 00:09:21 +08:00
qvlehao
f5350b103b [model] add deepseek-R1 & show think process (#6767)
Former-commit-id: 28417f862a
2025-01-29 12:16:26 +08:00
engchina
324f07613a [webui] support ja (#6698)
* add support for japanese language

* add support for japanese language

---------

Co-authored-by: engchina <atjapan2015@gmail.com>
Former-commit-id: de9bc3fefa
2025-01-20 19:46:38 +08:00
hoshi-hiyouga
1efe525df7 [model] support yarn (#6693)
Former-commit-id: 1f47b6186c
2025-01-18 13:56:09 +08:00
hoshi-hiyouga
770433fa33 [webui] upgrade to gradio 5 (#6688)
Former-commit-id: 4d0f662dbe
2025-01-17 20:15:42 +08:00
steveepreston
8895cf1152 Update val_size english description (#6653)
* Update `val_size` Description in locales.py

* Update `val_size` Description in data_args.py

* Remove extra space in data_args.py

Former-commit-id: 76675b654e
2025-01-15 16:00:20 +08:00
hoshi-hiyouga
9ef85f8fc4 [optim] clean apollo (#6645)
* clean apollo code

* update readme

Former-commit-id: 7a04021d04
2025-01-15 01:42:50 +08:00
zhuHQ
763f9b9df0 [optim] add support to APOLLO (#6617)
Former-commit-id: d9189f9f0b
2025-01-15 00:24:56 +08:00
hoshi-hiyouga
d8cba9464f [inference] fix stop token for object detection (#6624)
* fix stop token

* update minicpm data pipeline

* fix npu qlora examples

Former-commit-id: e3e2c8c689
2025-01-13 21:34:20 +08:00
hiyouga
0c1ad5f3fb fix llamaboard with ray
Former-commit-id: c46675d5e5
2025-01-07 09:59:24 +00:00
hiyouga
47c2d91933 support report custom args
Former-commit-id: 5111cac6f8
2024-12-21 21:42:45 +00:00
hiyouga
f07bad7144 fix paligemma infer
Former-commit-id: 84cd1188ac
2024-12-21 20:24:32 +00:00
ZeYi Lin
67d4757c35 fix: project blank
Former-commit-id: 82e5d75014
2024-12-20 18:26:02 +08:00
ZeYi Lin
cc703b58f5 fix: by hiyouga suggestion
Former-commit-id: 3a7ea2048a
2024-12-20 16:43:03 +08:00
ZeYi Lin
8f786ee938 feat: ui improve
Former-commit-id: 5f6dafd70e
2024-12-20 11:03:02 +08:00
ZeYi Lin
03dba638e6 fix: text
Former-commit-id: 0a52962db3
2024-12-19 21:26:02 +08:00
ZeYi Lin
dd22454fc5 fix: bugs
Former-commit-id: d0eb64d5e3
2024-12-19 21:08:16 +08:00
ZeYi Lin
53103f55b6 feat: optimize frontend
Former-commit-id: 8c2df41b93
2024-12-19 19:04:19 +08:00
hiyouga
1a48340680 add swanlab
Former-commit-id: 96f8f103e5
2024-12-19 07:12:31 +00:00
hiyouga
92a0d08e27 fix webui
Former-commit-id: 369cca8110
2024-12-19 06:48:03 +00:00
hiyouga
433d116080 add paligemma2
Former-commit-id: d3509050dc
2024-12-18 08:57:26 +00:00
ylfeng
857d23b324 Support Mistral format tools
Former-commit-id: 115924af47
2024-12-17 19:13:26 +00:00
Yaser Afshar
76ebd62ac1 Add missing key to init_kwargs
Former-commit-id: 1c8ad22a5f
2024-12-17 12:34:05 +00:00
hiyouga
235cdcacee support batch infer in vllm
Former-commit-id: 1324d158f9
2024-12-04 13:50:00 +00:00
Azalea
0efa34c9ef [U] Compute hostname differently
Former-commit-id: 6554cdeedb
2024-11-28 22:23:41 -05:00
Azalea
f5e6e25a1b [+] Show the hostname
Former-commit-id: dfb953b1ad
2024-11-28 12:25:02 +08:00
hoshi-hiyouga
1eaaa85980 do not split save_cmd ret value
Former-commit-id: d20b97e7e9
2024-11-21 22:30:23 +08:00
superboy-zjc
e272f87849 [patch] Patch remote OS command injection vulnerability
Former-commit-id: aa6a174d68
2024-11-21 01:52:12 -05:00
hiyouga
0d18cca0db add vllm config
Former-commit-id: 58ab4579dc
2024-11-10 21:28:18 +08:00
hiyouga
d7e35ddcaa fix extra args
Former-commit-id: eb294fed13
2024-11-09 00:24:27 +08:00
hiyouga
604f4005c9 fix webchat
Former-commit-id: ba10d54bf9
2024-11-02 21:04:18 +08:00
hiyouga
c2766af6f4 fix dpo metrics
Former-commit-id: 4270f7dfb9
2024-11-02 20:59:01 +08:00
hiyouga
e83cb17f97 support rank0 logger
Former-commit-id: c38aa29336
2024-11-02 18:31:04 +08:00
hiyouga
8ecc12ee2a support multiimage inference
Former-commit-id: e80a481927
2024-11-01 07:25:20 +00:00