[shardformer]t5 flash attention fix#4239

Merged

CjhHa1 merged 11 commits intohpcaitech:feature/flash-attention-shardformerfrom

flybird11111:t5-fix

Jul 14, 2023

Commits on Jul 5, 2023

Commits on Jul 6, 2023

Commits on Jul 13, 2023

Merge branch 'hpcaitech:feature/flash-attention-shardformer' into feature/flash-attention-shardformer
flybird11111
authored

Commits on Jul 14, 2023