Skip to content

[shardformer] vit/llama/t5 ignore the sequence parallelism flag and some fix.#4498

Merged
flybird11111 merged 12 commits intohpcaitech:feature/shardformerfrom
flybird11111:feature/shardformer
Aug 24, 2023
Merged

[shardformer] vit/llama/t5 ignore the sequence parallelism flag and some fix.#4498
flybird11111 merged 12 commits intohpcaitech:feature/shardformerfrom
flybird11111:feature/shardformer

Commits

Commits on Aug 22, 2023

Commits on Aug 23, 2023

Commits on Aug 24, 2023