390 Commits

Author SHA1 Message Date
Yaowei Zheng
477bed6f89 [model] add kimi vl 2506 (#8432) 2025-06-23 17:56:48 +08:00
Dhia Eddine Rhaiem
1a67692886 [model] add support for Falcon H1 (#8403) 2025-06-18 16:51:23 +08:00
Yaowei Zheng
e62c9bc2bf [data] fix qwen2vl pos ids (#8387) 2025-06-17 00:48:54 +08:00
Yaowei Zheng
672a5ed820 [misc] tiny fixes (#8348) 2025-06-10 15:30:58 +08:00
阿丹(adan)
a7ae91d253 [model] support MiniCPM4 (#8314) 2025-06-10 14:38:39 +08:00
Kingsley
ae2a8100ba [model] support Mistral3.1 small 2503 (#8335) 2025-06-09 10:37:42 +08:00
Yaowei Zheng
c142ea814e [data] fix empty template (#8312) 2025-06-06 13:50:50 +08:00
Yaowei Zheng
8a998ac4fd [assets] add icon (#8276) 2025-06-03 20:36:21 +08:00
Kingsley
032781b0c5 [data] support nested images input for videos (#8264) 2025-06-03 20:26:29 +08:00
Kingsley
74769497c7 [model] add MIMO_VL (#8249) 2025-06-01 03:54:54 +08:00
Akshat Sehgal
b79f5123a7 [model] add smollm2 support (#8220) 2025-05-31 16:29:01 +08:00
hoshi-hiyouga
f9912ef2f9 [webui] fix skip args (#8195) 2025-05-28 18:11:07 +08:00
Youngwoo Kim
64379c5e9b [data] Reading files from cloud is broken (#8182) (#8183) 2025-05-28 15:50:44 +08:00
hoshi-hiyouga
60f991f05b [data] fix shared file system (#8179) 2025-05-27 18:36:03 +08:00
hoshi-hiyouga
fb743678a5 [model] add smollm2 and medgemma (#8161) 2025-05-26 23:19:58 +08:00
Akshat Sehgal
67e1b92194 feat: add smollm support (#8050) 2025-05-26 19:47:54 +08:00
Kingsley
a5f2c806b9 [data] fix internvl plugin when using PIL images (#8129) 2025-05-22 01:32:59 +08:00
hoshi-hiyouga
abb581026f [deps] update to transformers 4.52 (#8125) 2025-05-21 05:16:18 +08:00
hoshi-hiyouga
117db2f37b [data] llama3 multi tool support (#8124) 2025-05-21 02:01:12 +08:00
hoshi-hiyouga
3fff7629b0 [data] qwen3 fixes (#8109) 2025-05-20 02:00:30 +08:00
hoshi-hiyouga
8a18a28624 [doc] add no build isolation (#8103) 2025-05-19 19:25:13 +08:00
Kingsley
223a3002f8 [data] add forward compatibility for video_utils in Transformers 4.52.0 (#8077) 2025-05-16 17:41:04 +08:00
Eric Tang
fc4f22e321 [data] support loading folder from remote (#8078) 2025-05-16 15:35:38 +08:00
hoshi-hiyouga
e0e97d2867 [model] add seed coder and qwen3 quant models (#8039) 2025-05-13 15:59:55 +08:00
hoshi-hiyouga
d374dd08be [data] fix kimi vl template (#8015) 2025-05-11 20:45:19 +08:00
yunhao-tech
77549c3c47 [data] Avoid repetitive tool description warp (#8000)
Co-authored-by: chenyunhao <chenyunhao@wps.cn>
Co-authored-by: hoshi-hiyouga <hiyouga@buaa.edu.cn>
2025-05-09 21:16:37 +08:00
Kingsley
d564fc584b [model] add mimo7b (#7946) 2025-05-06 17:10:30 +02:00
hoshi-hiyouga
634efb3ac9 [model] add qwen2 omni 3b (#7945) 2025-05-03 16:36:51 +08:00
hoshi-hiyouga
0f33e040bf [data] fix base plugin (#7924) 2025-04-30 16:28:05 +08:00
hoshi-hiyouga
0af4d834ef [data] optimize qwen3 loss computation (#7923) 2025-04-30 16:18:00 +08:00
hoshi-hiyouga
23bc89c80c [data] add eval_on_each_dataset arg (#7912) 2025-04-30 06:56:43 +08:00
hoshi-hiyouga
142a071309 [data] replace eos token for base models (#7911) 2025-04-30 06:52:28 +08:00
hoshi-hiyouga
5bb88f7dc9 [data] improve mm plugin (#7910) 2025-04-30 06:34:28 +08:00
hoshi-hiyouga
660ceaaa3f [model] add qwen3 (#7885) 2025-04-29 09:34:05 +08:00
Kingsley
a3869a6514 [data] fix qwen2.5 omni template (#7883) 2025-04-29 00:58:23 +08:00
hoshi-hiyouga
f7275e1ef5 [model] fix dsv3 leaf node (#7879) 2025-04-28 18:11:09 +08:00
hoshi-hiyouga
8908a85465 [data] fix qwen2 omni plugin (#7875) 2025-04-28 14:22:41 +08:00
hoshi-hiyouga
f6bb4c3f8e [data] fix minicpmo vllm infer (#7870) 2025-04-28 01:59:53 +08:00
Kingsley
000dbfe144 [data] fix internvl plugin (#7817) 2025-04-23 00:58:22 +08:00
Kingsley
52eeb0fc4f [misc] update internvl constants (#7801) 2025-04-22 15:53:08 +08:00
hoshi-hiyouga
acf641abc2 [data] improve mmplugin (#7795) 2025-04-22 01:25:33 +08:00
Changrui Chen
314bcb3f36 [data] Fix wrong position ids with packed attention masks (#7754)
Co-authored-by: hoshi-hiyouga <hiyouga@buaa.edu.cn>
2025-04-21 23:19:36 +08:00
hoshi-hiyouga
8208cbf1dc [trainer] fix pt loss (#7748)
* fix pt loss

* robust

* fix

* test
2025-04-17 03:15:35 +08:00
hoshi-hiyouga
a0818eae58 [breaking] bump transformers to 4.45.0 & improve ci (#7746)
* update ci

* fix

* fix

* fix

* fix

* fix
2025-04-17 02:36:48 +08:00
Kingsley
7a00670f70 [model] support intern-VL 2.5-3 series (#7258)
* add internvl and rebase

* fix for internvl2&3

* remove lines

* fix video_inputs & lint

* nit

* add constants

* remove lines

* fix

* fix error

* pass ci

* pass ci

* skip internvl & nit
2025-04-17 00:31:30 +08:00
Kingsley
d1b695cd9f [model] Support Kimi_VL thinking/instruct (#7719)
* add kimi_vl

* patch config

* check version

* Update mm_plugin.py

* Update mm_plugin.py

---------

Co-authored-by: hoshi-hiyouga <hiyouga@buaa.edu.cn>
2025-04-15 00:21:58 +08:00
Eric Tang
45c5a913f8 [data] support for specifying a dataset in cloud storage (#7567)
* add support for loading datasets from s3/gcs

* add comments to readme

* run linter and address comments

* add option to pass in kwargs to ray init (i.e. runtime env)

* address comment

* revert mixed up changes
2025-04-10 11:31:35 +08:00
hoshi-hiyouga
458b6b0aef [assets] update readme (#7644) 2025-04-09 01:06:06 +08:00
Kingsley
0935eff188 [data] Fix bugs of use_audio_in_video in Qwen2.5 Omni (#7638)
* cache _mm_inputs

* nit

* support for use_audio_in_video

* remove cache

* fix data

* Update mllm_video_audio_demo.json
2025-04-08 18:40:10 +08:00
hoshi-hiyouga
fb46193364 [misc] fix packing and eval plot (#7623) 2025-04-07 18:20:57 +08:00