Skip to content

[ShardFormer] Add Ulysses Sequence Parallelism support for Command-R, Qwen2 and ChatGLM#5897

Merged
ver217 merged 1 commit intohpcaitech:mainfrom
GuangyaoZhang:sp_new
Jul 10, 2024
Merged

[ShardFormer] Add Ulysses Sequence Parallelism support for Command-R, Qwen2 and ChatGLM#5897
ver217 merged 1 commit intohpcaitech:mainfrom
GuangyaoZhang:sp_new

Commits

Commits on Jul 9, 2024