Make reduce scatter optional for ZeRO-1 as workaround#971

Merged

jeffra merged 5 commits intomasterfrom

olruwase/zero_optional_reduce_scatter

Apr 21, 2021

Commits on Apr 17, 2021

Commits on Apr 20, 2021

Commits on Apr 21, 2021

Merge branch 'master' into olruwase/zero_optional_reduce_scatter
jeffra
authored