Skip to content

[shardformer] update gpt2 to use coloattention.#4234

Merged
FrankLeeeee merged 14 commits intohpcaitech:feature/flash-attention-shardformerfrom
flybird11111:update-gpt2
Jul 17, 2023
Merged

[shardformer] update gpt2 to use coloattention.#4234
FrankLeeeee merged 14 commits intohpcaitech:feature/flash-attention-shardformerfrom
flybird11111:update-gpt2

Commits

Commits on Jul 5, 2023

Commits on Jul 15, 2023