[shardformer] bert support flash attention.#4206
Merged
FrankLeeeee merged 9 commits intohpcaitech:feature/flash-attention-shardformerfrom Jul 11, 2023
Merged
[shardformer] bert support flash attention.#4206FrankLeeeee merged 9 commits intohpcaitech:feature/flash-attention-shardformerfrom
FrankLeeeee merged 9 commits intohpcaitech:feature/flash-attention-shardformerfrom
