Best#121

Merged

jamesthesnake merged 16 commits intomainfrom

Aug 4, 2023

Commits on Jul 31, 2023

[zero] refactor low level zero for shard evenly (#4030)

Gy-Lu
authored and
ver217
committed
[zero]support no_sync method for zero1 plugin (#4138)

Gy-Lu
authored and
ver217
committed
[zero] allow passing process group to zero12 (#4153)

Gy-Lu
authored and
ver217
committed
[zero] add state dict for low level zero (#4179)

Gy-Lu
authored and
ver217
committed
[zero] support shard optimizer state dict of zero (#4194)

Gy-Lu
authored and
ver217
committed
[zero] optimize the optimizer step time (#4221)

Gy-Lu
authored and
ver217
committed

Commits on Aug 2, 2023

[chat] fix bugs and add unit tests (#4213)
cwher
authored

Commits on Aug 3, 2023

Commits on Aug 4, 2023