Skip to content

[shardformer] support bert/gpt2 and downstream model with new api and dtensor #4015

@FoolPlayer

Description

@FoolPlayer

support bert/gpt2 and downstream model with new api and dtensor

Metadata

Metadata

Assignees

Labels

exampleexample-related issuer or pull requestshardformer

Type

No type

Projects

Status

✅ Done

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions