Skip to content

[shardformer/sequence parallel] Overlap input gather and grad computation during col backward#4401

Merged
FoolPlayer merged 4 commits intohpcaitech:feature/seq-parallelfrom
FoolPlayer:overlap
Aug 11, 2023
Merged

[shardformer/sequence parallel] Overlap input gather and grad computation during col backward#4401
FoolPlayer merged 4 commits intohpcaitech:feature/seq-parallelfrom
FoolPlayer:overlap

Commits

Commits on Aug 10, 2023