Skip to content

[zero] optimize the step time #4220

@Gy-Lu

Description

@Gy-Lu

Now in the step(), zero uses the master param to comm, which leads to a long optimizer_step time.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

Status

✅ Done

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions