Skip to content

[shardformer] t5 support flash attention.#4216

Merged
flybird11111 merged 16 commits intohpcaitech:feature/flash-attention-shardformerfrom
flybird11111:flash-t5
Jul 13, 2023
Merged

[shardformer] t5 support flash attention.#4216
flybird11111 merged 16 commits intohpcaitech:feature/flash-attention-shardformerfrom
flybird11111:flash-t5

Commits

Commits on Jul 5, 2023

Commits on Jul 11, 2023

Commits on Jul 12, 2023