Skip to content

Add MoE support for T5 model (w/o expert parallel)#5409

Merged
MaximumEntropy merged 21 commits intomainfrom
moe_basic
Nov 15, 2022
Merged

Add MoE support for T5 model (w/o expert parallel)#5409
MaximumEntropy merged 21 commits intomainfrom
moe_basic

Commits

Commits on Nov 14, 2022

Commits on Nov 15, 2022

Comments