hoshi-hiyouga 3f3756b113 Merge pull request #2283 from A-Cepheus/main
fix: ZeRO3 does not work with MoE models
Former-commit-id: f5ea760abec2aac8d29ce5c945647be05648e676
2024-01-22 23:28:45 +08:00
..
2024-01-21 19:15:27 +08:00
2024-01-21 01:47:33 +08:00
2024-01-22 22:27:30 +08:00
2024-01-20 20:15:56 +08:00
2024-01-22 21:26:53 +08:00
2024-01-22 22:27:30 +08:00
2024-01-22 23:27:39 +08:00
2024-01-21 12:39:38 +08:00
2024-01-21 12:34:17 +08:00
2024-01-21 19:15:27 +08:00