[moe]: add flash attention & optimize top2 router#4712
Merged
oahzxl merged 6 commits intohpcaitech:feature/MoEfrom Sep 18, 2023
Merged
[moe]: add flash attention & optimize top2 router#4712oahzxl merged 6 commits intohpcaitech:feature/MoEfrom
oahzxl merged 6 commits intohpcaitech:feature/MoEfrom
Commits
Commits on Sep 18, 2023
- committed
- committed
- committed
- committed
- committed
- committed
