Skip to content

[Ring Attention] fix the 2d ring attn when using multiple machine#6071

Merged
wangbluo merged 26 commits intohpcaitech:mainfrom
wangbluo:ring_attention
Oct 15, 2024
Merged

[Ring Attention] fix the 2d ring attn when using multiple machine#6071
wangbluo merged 26 commits intohpcaitech:mainfrom
wangbluo:ring_attention

Commits

Commits on Sep 25, 2024

Commits on Sep 26, 2024

Commits on Oct 9, 2024

Commits on Oct 10, 2024

Commits on Oct 11, 2024

Commits on Oct 14, 2024

Commits on Oct 15, 2024