[shardformer] integrate with data parallel #4102

Closed

Assignees

Labels

enhancementshardformer

opened

on Jun 28, 2023

We can integrate shardformer with pytorch DDP.

Metadata

Assignees

FrankLeeeee

Labels

enhancementshardformer

Type

No type

Projects

Status

✅ Done

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests