Skip to content

[Moe/Zero] Update MoeHybridParallelPlugin with refactored ZeRO and Fix Zero bug#5819

Merged
botbw merged 8 commits intohpcaitech:feature/moefrom
Hz188:feature/moe
Jun 14, 2024
Merged

[Moe/Zero] Update MoeHybridParallelPlugin with refactored ZeRO and Fix Zero bug#5819
botbw merged 8 commits intohpcaitech:feature/moefrom
Hz188:feature/moe