Skip to content

[FEATURE]: Support SP+PP in Llama etc.  #5866

Closed
#5868
Closed
[FEATURE]: Support SP+PP in Llama etc. #5866
#5868
Labels
enhancementNew feature or requestshardformer
@GuangyaoZhang

Description

@GuangyaoZhang
GuangyaoZhang
opened on Jun 27, 2024

Describe the feature

Currently most models like Llama does not support SP together with PP. Please add support for this.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or requestshardformer

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions