Skip to content

[shardformer]fix flash attention, when mask is casual, just don't unpad it#5084

Merged
FrankLeeeee merged 2 commits intohpcaitech:mainfrom
flybird11111:fix-flash-attn
Nov 22, 2023
Merged

[shardformer]fix flash attention, when mask is casual, just don't unpad it#5084
FrankLeeeee merged 2 commits intohpcaitech:mainfrom
flybird11111:fix-flash-attn

Commits

Commits on Nov 21, 2023