[Ring Attention] Overlap kv comm with output rescale#6017
Merged
Edenzzzz merged 1 commit intohpcaitech:mainfrom Aug 19, 2024
Merged
[Ring Attention] Overlap kv comm with output rescale#6017Edenzzzz merged 1 commit intohpcaitech:mainfrom
Edenzzzz merged 1 commit intohpcaitech:mainfrom
