Skip to content

[zero] add support for shard state dict save/load #4186

@Gy-Lu

Description

@Gy-Lu

Now the state_dict of low-level zero follows the torch form.
For compatibility, the shard form(like huggingface) is needed.

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

Status

✅ Done

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions