536 Commits

Author SHA1 Message Date
Yaowei Zheng
d7fb4ebffb [assets] update readme (#8396) 2025-06-17 16:15:20 +08:00
Yaowei Zheng
cd5420030c [assets] update wechat (#8385) 2025-06-16 18:23:22 +08:00
Yaowei Zheng
672a5ed820 [misc] tiny fixes (#8348) 2025-06-10 15:30:58 +08:00
Chenhao Zhang
55912a92e6 [assets] Add awesome works used LLaMA-Factory (#8333) 2025-06-09 10:21:17 +08:00
Yaowei Zheng
5c960a3b14 [assets] update readme (#8303) 2025-06-05 23:23:15 +08:00
Yaowei Zheng
c1a57f11ff [assets] update docker files (#8291) 2025-06-04 23:30:46 +08:00
Yaowei Zheng
548fd94e5c [assets] update readme (#8288) 2025-06-04 17:46:12 +08:00
Yaowei Zheng
8a998ac4fd [assets] add icon (#8276) 2025-06-03 20:36:21 +08:00
hoshi-hiyouga
1f30f446f6 [assets] update readme (#8235) 2025-05-30 16:52:12 +08:00
hoshi-hiyouga
4e0cd3877d [assets] fix docker images (#8203) 2025-05-28 22:26:05 +08:00
hoshi-hiyouga
5a6df7e166 [assets] update docker files (#8176) 2025-05-27 18:15:23 +08:00
hoshi-hiyouga
abb581026f [deps] update to transformers 4.52 (#8125) 2025-05-21 05:16:18 +08:00
hoshi-hiyouga
117db2f37b [data] llama3 multi tool support (#8124) 2025-05-21 02:01:12 +08:00
hoshi-hiyouga
b31f7d2301 [assets] update readme (#8110) 2025-05-20 02:44:18 +08:00
hoshi-hiyouga
3fff7629b0 [data] qwen3 fixes (#8109) 2025-05-20 02:00:30 +08:00
hoshi-hiyouga
8a18a28624 [doc] add no build isolation (#8103) 2025-05-19 19:25:13 +08:00
hoshi-hiyouga
db9c26e48a [assets] update windows installation (#8042) 2025-05-13 17:01:56 +08:00
hoshi-hiyouga
e0e97d2867 [model] add seed coder and qwen3 quant models (#8039) 2025-05-13 15:59:55 +08:00
tpoisonooo
ea88583754 [docs] add GraphGen (#7974) 2025-05-07 12:23:11 +02:00
Kingsley
d564fc584b [model] add mimo7b (#7946) 2025-05-06 17:10:30 +02:00
hoshi-hiyouga
634efb3ac9 [model] add qwen2 omni 3b (#7945) 2025-05-03 16:36:51 +08:00
Eric Chen
c94518718c [assets] Warp Support README Update (#7887) 2025-05-02 00:08:48 +08:00
hoshi-hiyouga
0af4d834ef [data] optimize qwen3 loss computation (#7923) 2025-04-30 16:18:00 +08:00
hoshi-hiyouga
1250ff9575 [misc] fix uv (#7913) 2025-04-30 07:45:03 +08:00
hoshi-hiyouga
660ceaaa3f [model] add qwen3 (#7885) 2025-04-29 09:34:05 +08:00
hoshi-hiyouga
a852298216 [assets] update model readme (#7804) 2025-04-22 16:43:56 +08:00
hoshi-hiyouga
cea9071ed1 [example] add bash usage (#7794) 2025-04-22 00:25:51 +08:00
Juanxi Tian
5a02c5afc2 [trainer] Add Muon Optimizer (#7749)
Co-authored-by: hoshi-hiyouga <hiyouga@buaa.edu.cn>
2025-04-21 23:38:37 +08:00
hoshi-hiyouga
3fc56b8499 [parser] support omegaconf (#7793) 2025-04-21 23:30:30 +08:00
hoshi-hiyouga
37bbafc5fc [assets] update wechat (#7792) 2025-04-21 21:29:42 +08:00
hoshi-hiyouga
8208cbf1dc [trainer] fix pt loss (#7748)
* fix pt loss

* robust

* fix

* test
2025-04-17 03:15:35 +08:00
hoshi-hiyouga
a0818eae58 [breaking] bump transformers to 4.45.0 & improve ci (#7746)
* update ci

* fix

* fix

* fix

* fix

* fix
2025-04-17 02:36:48 +08:00
Kingsley
7a00670f70 [model] support intern-VL 2.5-3 series (#7258)
* add internvl and rebase

* fix for internvl2&3

* remove lines

* fix video_inputs & lint

* nit

* add constants

* remove lines

* fix

* fix error

* pass ci

* pass ci

* skip internvl & nit
2025-04-17 00:31:30 +08:00
hoshi-hiyouga
d74634c68a [assets] update model readme (#7724) 2025-04-15 00:41:09 +08:00
hoshi-hiyouga
c60971f4b8 [deps] upgrade transformers (#7704) 2025-04-13 18:11:34 +08:00
Yuxuan Zhang
c21dc814ff [model] add GLM-4-0414 (#7695)
* Update README_zh.md

* update
2025-04-13 17:10:45 +08:00
Eric Tang
45c5a913f8 [data] support for specifying a dataset in cloud storage (#7567)
* add support for loading datasets from s3/gcs

* add comments to readme

* run linter and address comments

* add option to pass in kwargs to ray init (i.e. runtime env)

* address comment

* revert mixed up changes
2025-04-10 11:31:35 +08:00
hoshi-hiyouga
cca359fb6d [data] add coig-p dataset (#7657) 2025-04-09 21:18:25 +08:00
hoshi-hiyouga
458b6b0aef [assets] update readme (#7644) 2025-04-09 01:06:06 +08:00
hoshi-hiyouga
fb46193364 [misc] fix packing and eval plot (#7623) 2025-04-07 18:20:57 +08:00
hoshi-hiyouga
c0079ab9fd [assets] update readme (#7612) 2025-04-06 13:58:49 +08:00
hoshi-hiyouga
37d783149d [model] fix kv cache (#7564) 2025-04-01 23:07:46 +08:00
Billy Cao
51e741ec85 [data] shard the dataset to allow multiprocessing when streaming is enabled (#7530)
* Shard the dataset when streaming to allow multiprocessing

* Allow user to not set dataset_shards to ensure backward compatibility
2025-04-01 15:36:23 +08:00
Kingsley
1189aeb6c2 [model] add Qwen2.5-Omni model (#7537)
* preserve image_sizes

* preserve image_sizes

* init plugin

* support audio-text2text lora

* nit

* support image/video-text2text, audio-text2text

* remove args

* remove lines

* add docs && nit

* remove some comments

* fix && add merge part script

* add license
2025-03-31 20:39:35 +08:00
hoshi-hiyouga
cb42e2c4de [model] add qwen2vl 32b & upgrade peft (#7469)
* add qwen2vl 32b

* fix ci

* upgrade peft to 0.15

* fix ci

* fix ci
2025-03-25 12:15:58 +08:00
hoshi-hiyouga
23906c1a5c [assets] fix gemma3 readme (#7449) 2025-03-24 10:31:25 +08:00
hoshi-hiyouga
20908e4429 [assets] update videos (#7340)
* Update README.md

* Update README_zh.md
2025-03-17 15:48:02 +08:00
Hertz
db936dc329 [model] support hunyuan 7b (#7317)
* [Model]supported tencent-hunyuan model

* [Model]supported tencent-hunyuan model(fix)

* [Model]supported tencent-hunyuan model(fix)
2025-03-15 20:55:24 +08:00
Qiaolin Yu
280d9bda76 [inference] support sglang backend (#7278)
* Mimic SGLang offline Engine

* Add more tests and args

* Pass all current tests

* Clean Code

* fix sample_params

* clean code

* Fix Stream Chat

* change sglang from engine mode to server mode

* fix

* Fix Review Issues

* Use SGLang Built-In Utilities

* Fix test SGLang

* Some Doc Issue

* fix sglang engine

* add readme

---------

Co-authored-by: Jin Pan <jpan236@wisc.edu>
Co-authored-by: hiyouga <hiyouga@buaa.edu.cn>
2025-03-15 04:37:58 +08:00
hoshi-hiyouga
3c974c466e [assets] update video (#7287) 2025-03-13 18:45:47 +08:00