Skip to content

[moe] update benchmark scripts and ckpt io#4804

Merged
oahzxl merged 10 commits intohpcaitech:feature/MoEfrom
oahzxl:bench
Sep 29, 2023
Merged

[moe] update benchmark scripts and ckpt io#4804
oahzxl merged 10 commits intohpcaitech:feature/MoEfrom
oahzxl:bench

Conversation

@oahzxl
Copy link
Copy Markdown
Contributor

@oahzxl oahzxl commented Sep 26, 2023

  • update benchmark scrpits
  • fix some bugs
  • update pp layer distribution
  • update ckpt io

@oahzxl oahzxl changed the title [moe] update benchmark scripts [moe] update benchmark scripts and ckpt io Sep 26, 2023
@oahzxl oahzxl merged commit 03f9a04 into hpcaitech:feature/MoE Sep 29, 2023
@oahzxl oahzxl deleted the bench branch October 4, 2023 04:44
oahzxl added a commit to oahzxl/ColossalAI that referenced this pull request Oct 26, 2023
* update benchmark script

* update pp strategy

* update plugin

* update bench script

* optimize

* update pp layers

* update zero ep

* ep

* update ckpt

* update test
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants