[shardformer] support lazy init #4201

Closed

Assignees

Labels

opened

on Jul 10, 2023

Support lazy initialization for both TP and PP. Materialization is executed in two stages: initializing TP layers and after all TP layers being initialized.

Metadata

Assignees

ver217

Labels

Type

No type

Projects

Status

✅ Done

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests