423A35C7/LLaMA-Factory
1
0
Fork 0
mirror of https://github.com/hiyouga/LLaMA-Factory.git synced 2026-08-17 13:35:44 +08:00
Code Issues Packages Projects Releases Wiki Activity

[v1] add FSDPTurbo EP/EFSDP plugin for MoE training (#10676)

Browse Source
This commit is contained in:
Hazeldxq
2026-08-13 20:45:55 +08:00
committed by GitHub
parent bc4b42cefc
commit f28afaf635
21 changed files with 1341 additions and 29 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
docs/en/index.rst
View File

@@ -38,6 +38,7 @@ LlamaFactory Docs
advanced/distributed/fsdp
advanced/distributed/deepspeed
advanced/distributed/parallel-dp-tp-ep-sp-cp
advanced/distributed/fsdpturbo-ep-efsdp
advanced/custom-kernels/triton
advanced/custom-kernels/fused-operators