Commit Graph

13 Commits

Author SHA1 Message Date
Jiaqi
3f77101580 [v1] refactor registry plugin structure and params (#10641) 2026-07-24 15:23:21 +08:00
HelloWorldBeginner
5f653cb96a [v1] add muon optimizer (#10618)
Co-authored-by: mhh111 <mahonghao1@huawei.com>
2026-07-17 21:44:28 +08:00
浮梦
b61140db3e [v1] replace custom template system with apply_chat_template (#10598)
Co-authored-by: frozenleaves <frozenleaves@users.noreply.github.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2026-07-10 21:15:44 +08:00
HelloWorldBeginner
50ff45176a [v1] set flash_attn to flash_attention_2 for ulysses CP example (#10616)
Co-authored-by: mhh111 <mahonghao1@huawei.com>
2026-06-30 16:56:12 +08:00
sunyi0505
7e20db5735 [v1] support liger_kernel (#10493) 2026-05-21 11:44:56 +08:00
jiaqiw09
28a6ea1cdc [v1] add deepspeed zero3 trigger for low memory usage weight loading (#10300) 2026-04-21 14:09:52 +08:00
sunyi0505
b5afabe3d2 [v1] support ulysses cp for fsdp2 (#10262) 2026-03-27 16:22:48 +08:00
jiaqiw09
df2e6edb7e [v1] add init on rank0 for fsdp2 (#10264) 2026-03-27 14:54:03 +08:00
jiaqiw09
45d335c709 [v1] add seed for training and fix gradient checkpointing (#10211) 2026-02-28 18:16:06 +08:00
Yaowei Zheng
122cd46084 [model] update constants (#10220) 2026-02-26 21:13:56 +08:00
浮梦
5c52afa30d [v1] support deepspeed (#10181) 2026-02-12 17:24:30 +08:00
浮梦
bf04ca6af8 [deps] adapt to transformers v5 (#10147)
Co-authored-by: frozenleaves <frozen@Mac.local>
Co-authored-by: hiyouga <hiyouga@buaa.edu.cn>
2026-02-02 12:07:19 +08:00
浮梦
f9f11dcb97 [v1] support training with fsdp2 (#9773)
Co-authored-by: frozenleaves <frozen@Mac.local>
Co-authored-by: Yaowei Zheng <hiyouga@buaa.edu.cn>
2026-01-25 19:41:58 +08:00