Skip to content

[FEATURE]: refactored embedding layer to decouple with gpc #4012

@FrankLeeeee

Description

@FrankLeeeee

Describe the feature

In Shardformer, all layers accept process group as the arguments for distributed operations. We should remove the dependency on the gpc.

Metadata

Metadata

Assignees

Type

No type

Projects

Status

✅ Done

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions