Skip to content

[shardformer] llama support flash attention#4185

Merged
FrankLeeeee merged 10 commits intohpcaitech:feature/flash-attention-shardformerfrom
flybird11111:flash-llama
Jul 6, 2023
Merged

[shardformer] llama support flash attention#4185
FrankLeeeee merged 10 commits intohpcaitech:feature/flash-attention-shardformerfrom
flybird11111:flash-llama