423A35C7/LLaMA-Factory
1
0
Fork 0
mirror of https://github.com/hiyouga/LLaMA-Factory.git synced 2026-06-17 12:48:55 +08:00
Code Issues Packages Projects Releases Wiki Activity
3,035 Commits 1 Branch 36 Tags
7af909522a951e3ad9f022ea6f88b6755257eaa5
Commit Graph

302 Commits

Author SHA1 Message Date
jiaqiw09
7d719182c9 [model] fix non-packing batch (bsz>1) for Qwen3.5 with flash attention (#10529) 2026-05-30 21:41:41 +08:00
马境远
53e77a9bfa [model] support MiniCPM-V-4.6 (#10472) 2026-05-08 18:14:34 +08:00
luca-888
8752280dd7 [data] Optimize QwenVL video dataset preprocessing (#10404) 
Co-authored-by: Kingsley <kingsleydodonow@gmail.com>
 2026-05-03 18:36:56 +08:00
Peilin Li
887ee2b121 [refactor] Add KTransformers AMX MoE SFT support via Accelerate (#10430) 
Co-authored-by: mrhaoxx <mr.haoxx@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-05-01 01:47:58 +08:00
Hertz
f7f3bfcbd7 [model] support Hy3-Preview (#10432) 2026-04-29 23:21:13 +08:00
Kingsley
3475198d1e [fa2] fix IMA when train qwen3_5 (#10448) 2026-04-29 20:20:55 +08:00
Kingsley
99464b3d03 [misc] code lint (#10439) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-04-27 14:07:31 +08:00
Kingsley
79c8332e4c [train] add qwen35 patch for neat_packing (#10436) 2026-04-27 00:31:49 +08:00
Kingsley
436d26bc28 fix: projector lookup for gemma4 modules (#10382) 
Co-authored-by: yiluoAK_47 <yiluoAK_47@163.com>
 2026-04-12 08:32:14 +08:00
Kingsley
c109c061e5 [model] set mm_projectors for omni models (#10378) 2026-04-10 18:12:57 +08:00
Kingsley
eae6f0b541 [model] gemma4 (#10346) 2026-04-05 12:10:28 +08:00
浮梦
e5e8546493 [misc] fix moe (#10334) 
Co-authored-by: frozenleaves <frozen@Mac.local>
 2026-03-31 23:04:45 +08:00
Yutong Wu
97d479fa92 [model] support Qwen3.5 liger kernel (#10313) 2026-03-24 18:25:33 +08:00
Kingsley
833f6027b1 [fix] fit neat_packing & mrope model packing (#10283) 
Co-authored-by: Yaowei Zheng <hiyouga@buaa.edu.cn>
 2026-03-20 16:50:11 +08:00
LittleYanlin
2d9bd2aa14 [fix] qwen3.5 projector path (#10242) 
Co-authored-by: Yaowei Zheng <hiyouga@buaa.edu.cn>
 2026-03-04 01:31:09 +08:00
Kingsley
816480012f [fix] register visual part for Qwen3.5 (#10227) 2026-02-28 16:39:24 +08:00
Yaowei Zheng
122cd46084 [model] update constants (#10220) 2026-02-26 21:13:56 +08:00
Shanay Mehta
aab9b400bb [model] Add DeepSpeed Z3 leaf module for Qwen3-Next (#10194) 
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-02-24 19:54:37 +08:00
Shanay Mehta
184304b5b4 [model] add liger kernel support for Qwen3-Next (#10176) 
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-02-10 21:47:48 +08:00
Xue Yadong
d3ebd5678d [model] support GLM-OCR SFT (#10183) 2026-02-10 21:41:01 +08:00
Shanay Mehta
ea644d04ec [model] support GLM-4.7-Flash SFT (#10173) 
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-02-09 10:40:44 +08:00
Hertz
b53d7037c2 [model] support youtu-vl model (#10152) 2026-02-02 21:42:43 +08:00
浮梦
bf04ca6af8 [deps] adapt to transformers v5 (#10147) 
Co-authored-by: frozenleaves <frozen@Mac.local>
Co-authored-by: hiyouga <hiyouga@buaa.edu.cn>
 2026-02-02 12:07:19 +08:00
Jewon Lee
9640f79ae5 [fix] add visual.pos_embed to Qwen3-VL visual model keys (#10139) 2026-01-27 16:33:01 +08:00
Yaowei Zheng
8abb8fb533 [v1] use async streamer (#9741) 2026-01-09 16:12:07 +08:00
Vo Van Phuc
958fb523a2 [model] support LiquidAI's LFM2.5-VL vision-language model (#9729) 2026-01-07 17:20:29 +08:00
Yaowei Zheng
d22de0d4bf [v1] add renderer ut (#9722) 2026-01-07 02:06:07 +08:00
Xunpeng Xiao
68119e5522 [misc] Add a PyTorch version warning for Conv3D. (#9715) 2026-01-05 13:26:29 +08:00
Yaowei Zheng
8600530002 [misc] lint (#9710) 2026-01-04 13:47:56 +08:00
Xunpeng Xiao
0087bc253b [misc] Compatible with an empty architectures field in config.json (#9709) 2026-01-04 12:11:35 +08:00
浮梦
16735b9e35 [v1] Refactor kernel plugin (#9669) 
Co-authored-by: frozenleaves <frozen@Mac.local>
 2025-12-31 18:26:48 +08:00
Copilot
eceec8ab69 [deps] goodbye python 3.9 (#9677) 
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: hiyouga <16256802+hiyouga@users.noreply.github.com>
Co-authored-by: hiyouga <hiyouga@buaa.edu.cn>
 2025-12-27 02:50:44 +08:00
Yaowei Zheng
55590f5ece [misc] fix ci with uv (#9676) 2025-12-27 01:39:13 +08:00
Xunpeng Xiao
3c17f2722c [model] Update ernie_vl to adapt new version (#9665) 2025-12-26 19:57:49 +08:00
Yaowei Zheng
a754604c11 [misc] fix accelerator (#9661) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2025-12-25 02:11:04 +08:00
Xunpeng Xiao
6a2eafbae3 [feat] Models trained and inferred with Mxfp4 are dequantized by default (#9652) 
Co-authored-by: Yaowei Zheng <hiyouga@buaa.edu.cn>
 2025-12-24 00:26:40 +08:00
Yaowei Zheng
84485406b7 [ci] disable pip cache for ci (#9654) 2025-12-23 18:37:40 +08:00
thulyubh22
7901b2f32e [model] efficient tuning for gpt-oss (#9354) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2025-12-23 16:28:38 +08:00
Hertz
4923f52a28 [model] support MiMo-V2-Flash model (#9637) 2025-12-21 14:38:18 +08:00
浮梦
5204cd2bca [misc] add version check for moe (#9633) 2025-12-19 14:57:37 +08:00
Xunpeng Xiao
8c74dca76a [feat] Models trained and inferred with FP8 are dequantized by default (#9627) 2025-12-18 22:54:35 +08:00
tangefly
4fd94141a4 [model] Add Ministral3 (#9582) 
Co-authored-by: kingsley <kingsleydodonow@gmail.com>
 2025-12-10 15:57:24 +08:00
DoubleWheat
cff4483392 [config] Fix RoPE scaling patch for resuming from a scaled model (#9588) 2025-12-09 20:37:37 +08:00
Yaowei Zheng
5d56817e2b [misc] lint (#9593) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2025-12-09 18:00:35 +08:00
xvxuopop
109162dc56 [fix] fix the issue when using fsdp2 with gradient checkpointing. (#9541) 
Co-authored-by: jin-yongxu <jinyongxu@h-partners.com>
 2025-12-06 16:04:51 +08:00
Kingsley
22be45c78c [misc] fix omni thinker load (#9552) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2025-11-30 09:36:36 +08:00
浮梦
2b6f16f261 [model] temporarily support npu fused options on v0, powered by v1 kernels (#9520) 
Co-authored-by: frozenleaves <frozen@Mac.local>
 2025-11-27 02:08:36 +08:00
Edge-Seven
9779b1f361 [misc] fix typos in some files (#9505) 
Co-authored-by: khanhkhanhlele <namkhanh20xx@gmail.com>
 2025-11-18 20:36:01 +08:00
浮梦
d4e120423d [data] fix qwen3omni moe model (#9501) 
Co-authored-by: frozenleaves <frozen@Mac.local>
 2025-11-18 13:43:22 +08:00
Pory
10a446e373 [model] ktransformers qwen3 support (#9485) 
Co-authored-by: unknown <xiongchenhui@hisense.ad>
 2025-11-13 20:09:44 +08:00