[shardformer] support fused layernorm #4113

Closed

Assignees

Labels

enhancementshardformer

opened

on Jun 28, 2023

We should provide support to use fused normalization kernels in shardformer.

Metadata

Assignees

FrankLeeeee

Labels

enhancementshardformer

Type

No type

Projects

Status

✅ Done

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests