[shardformer] gpt2 support flash attention.#4191
Merged
FrankLeeeee merged 11 commits intohpcaitech:feature/flash-attention-shardformerfrom Jul 7, 2023
Merged
[shardformer] gpt2 support flash attention.#4191FrankLeeeee merged 11 commits intohpcaitech:feature/flash-attention-shardformerfrom
FrankLeeeee merged 11 commits intohpcaitech:feature/flash-attention-shardformerfrom
