Skip to content

[shardformer] support pipeline for gpt #4200

Closed
Closed
[shardformer] support pipeline for gpt#4200
Assignees
Fridge003
Labels
pipeline-parallelrelated to the pipeline-parallel featureshardformer
@Fridge003

Description

@Fridge003
Fridge003
opened on Jul 10, 2023

support pipeline for gpt models, integrate its policy to shardformer, and add relevant tests.

Metadata

Metadata

Assignees

Labels

pipeline-parallelrelated to the pipeline-parallel featureshardformer

Type

No type

Projects

Shardformer

Status

✅ Done

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions