[shardformer] support tp+zero #4453

Closed

Assignees

opened

on Aug 16, 2023

Support TP + ZeRO for shardformer

Metadata

Assignees

Fridge003

Labels

No labels

No labels

Type

No type

Projects

Status

✅ Done

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests