Skip to content

[shardformer] fix flash attention, when mask is casual, just don't unpad it. #5083

Closed
Closed
[shardformer] fix flash attention, when mask is casual, just don't unpad it.#5083
@flybird11111

Description

@flybird11111
flybird11111
opened on Nov 21, 2023
No description provided.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    Shardformer

    Status

    ✅ Done

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions