Skip to content

[shardformer] update shardformer to use flash attention 2#4392

Merged
ver217 merged 2 commits intohpcaitech:feature/pipelinefrom
flybird11111:flash-attention-2
Aug 9, 2023
Merged

[shardformer] update shardformer to use flash attention 2#4392
ver217 merged 2 commits intohpcaitech:feature/pipelinefrom
flybird11111:flash-attention-2

Commits

Commits on Aug 8, 2023

Commits on Aug 9, 2023