Skip to content

[zero] override state_dict for low level zero #4154

@Gy-Lu

Description

@Gy-Lu

Since the fp32 params have been sharded evenly, the state_dict has been actually destroyed.

Therefore, we need to override the state_dict method to support load or save checkpoint.

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

Status

✅ Done

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions