[shardformer] support disabling tensor parallelism #4143

Closed

Assignees

Labels

enhancementshardformer

opened

Tensor parallelism is not suitable for cases, e.g. small model training. We can set it to be optional.

Metadata

Assignees

FrankLeeeee

Labels

enhancementshardformer

Type

No type

Projects

Status

✅ Done

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests