Skip to content

[shardformer] add dropout layer to sharded layer #3935

@FoolPlayer

Description

@FoolPlayer

Use out own dropout layer to replace dropout layer in torch to ensure different dropout pattern

Metadata

Metadata

Assignees

Type

No type

Projects

Status

✅ Done

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions