Skip to content

[shardformer]: Feature/shardformer, add some docstring and readme#3816

Merged
FrankLeeeee merged 13 commits intohpcaitech:feature/shardformerfrom
FoolPlayer:feature/shardformer
May 24, 2023
Merged

[shardformer]: Feature/shardformer, add some docstring and readme#3816
FrankLeeeee merged 13 commits intohpcaitech:feature/shardformerfrom
FoolPlayer:feature/shardformer

Conversation

@FoolPlayer
Copy link
Copy Markdown
Contributor

@FoolPlayer FoolPlayer commented May 23, 2023

📌 Checklist before creating the PR

  • I have created an issue for this PR for traceability
  • The title follows the standard format: [doc/gemini/tensor/...]: A concise description
  • I have added relevant tags if possible for us to better distinguish different PRs

🚨 Issue number

Link this PR to your issue with words like fixed to automatically close the linked issue upon merge

e.g. fixed #1234, closed #1234, resolved #1234

📝 What does this PR do?

  1. add inference and train test
  2. add docstring for shardformer and add a simple readme file

💥 Checklist before requesting a review

  • I have linked my PR to an issue (instruction)
  • My issue clearly describes the problem/feature/proposal, with diagrams/charts/table/code if possible
  • I have performed a self-review of my code
  • I have added thorough tests.
  • I have added docstrings for all the functions/methods I implemented

⭐️ Do you enjoy contributing to Colossal-AI?

  • 🌝 Yes, I do.
  • 🌚 No, I don't.

Tell us more if you don't enjoy contributing to Colossal-AI.

@FrankLeeeee FrankLeeeee added enhancement New feature or request shardformer labels May 23, 2023
@FrankLeeeee FrankLeeeee merged commit 795f38f into hpcaitech:feature/shardformer May 24, 2023
@FoolPlayer FoolPlayer deleted the feature/shardformer branch May 24, 2023 02:35
FrankLeeeee pushed a commit that referenced this pull request May 24, 2023
@FoolPlayer @FrankLeeeee
[shardformer]: Feature/shardformer, add some docstring and readme (#3816
94d9add 
)

* init shardformer code structure

* add implement of sharder (inject and replace)

* add implement of replace layer to colossal layer

* separate different layer policy, add some notion

* implement 1d and 2d slicer, can tell col or row

* fix bug when slicing and inject model

* fix some bug; add inference test example

* add share weight and train example

* add train

* add docstring and readme

* add docstring for other files

* pre-commit
FrankLeeeee pushed a commit to FrankLeeeee/ColossalAI that referenced this pull request Jun 8, 2023
@FoolPlayer @FrankLeeeee
[shardformer]: Feature/shardformer, add some docstring and readme (hp…
17f2e44 
…caitech#3816)

* init shardformer code structure

* add implement of sharder (inject and replace)

* add implement of replace layer to colossal layer

* separate different layer policy, add some notion

* implement 1d and 2d slicer, can tell col or row

* fix bug when slicing and inject model

* fix some bug; add inference test example

* add share weight and train example

* add train

* add docstring and readme

* add docstring for other files

* pre-commit
FrankLeeeee pushed a commit to FrankLeeeee/ColossalAI that referenced this pull request Jun 8, 2023
@FoolPlayer @FrankLeeeee
[shardformer]: Feature/shardformer, add some docstring and readme (hp…
06a9e6e 
…caitech#3816)

* init shardformer code structure

* add implement of sharder (inject and replace)

* add implement of replace layer to colossal layer

* separate different layer policy, add some notion

* implement 1d and 2d slicer, can tell col or row

* fix bug when slicing and inject model

* fix some bug; add inference test example

* add share weight and train example

* add train

* add docstring and readme

* add docstring for other files

* pre-commit
FrankLeeeee pushed a commit to FrankLeeeee/ColossalAI that referenced this pull request Jun 8, 2023
@FoolPlayer @FrankLeeeee
[shardformer]: Feature/shardformer, add some docstring and readme (hp…
58f6432 
…caitech#3816)

* init shardformer code structure

* add implement of sharder (inject and replace)

* add implement of replace layer to colossal layer

* separate different layer policy, add some notion

* implement 1d and 2d slicer, can tell col or row

* fix bug when slicing and inject model

* fix some bug; add inference test example

* add share weight and train example

* add train

* add docstring and readme

* add docstring for other files

* pre-commit
FrankLeeeee pushed a commit that referenced this pull request Jun 26, 2023
@FoolPlayer @FrankLeeeee
[shardformer]: Feature/shardformer, add some docstring and readme (#3816
ffacf0f 
)

* init shardformer code structure

* add implement of sharder (inject and replace)

* add implement of replace layer to colossal layer

* separate different layer policy, add some notion

* implement 1d and 2d slicer, can tell col or row

* fix bug when slicing and inject model

* fix some bug; add inference test example

* add share weight and train example

* add train

* add docstring and readme

* add docstring for other files

* pre-commit
flybird11111 pushed a commit to flybird11111/ColossalAI that referenced this pull request Jul 3, 2023
@FoolPlayer @flybird11111
[shardformer]: Feature/shardformer, add some docstring and readme (hp…
5ad31d6 
…caitech#3816)

* init shardformer code structure

* add implement of sharder (inject and replace)

* add implement of replace layer to colossal layer

* separate different layer policy, add some notion

* implement 1d and 2d slicer, can tell col or row

* fix bug when slicing and inject model

* fix some bug; add inference test example

* add share weight and train example

* add train

* add docstring and readme

* add docstring for other files

* pre-commit
FrankLeeeee pushed a commit that referenced this pull request Jul 4, 2023
@FoolPlayer @FrankLeeeee
[shardformer]: Feature/shardformer, add some docstring and readme (#3816
8cc1123 
)

* init shardformer code structure

* add implement of sharder (inject and replace)

* add implement of replace layer to colossal layer

* separate different layer policy, add some notion

* implement 1d and 2d slicer, can tell col or row

* fix bug when slicing and inject model

* fix some bug; add inference test example

* add share weight and train example

* add train

* add docstring and readme

* add docstring for other files

* pre-commit
ver217 pushed a commit to ver217/ColossalAI that referenced this pull request Jul 13, 2023
@FoolPlayer @ver217
[shardformer]: Feature/shardformer, add some docstring and readme (hp…
47edc2d 
…caitech#3816)

* init shardformer code structure

* add implement of sharder (inject and replace)

* add implement of replace layer to colossal layer

* separate different layer policy, add some notion

* implement 1d and 2d slicer, can tell col or row

* fix bug when slicing and inject model

* fix some bug; add inference test example

* add share weight and train example

* add train

* add docstring and readme

* add docstring for other files

* pre-commit
ver217 pushed a commit to ver217/ColossalAI that referenced this pull request Jul 13, 2023
@FoolPlayer @ver217
[shardformer]: Feature/shardformer, add some docstring and readme (hp…
ad10cfb 
…caitech#3816)

* init shardformer code structure

* add implement of sharder (inject and replace)

* add implement of replace layer to colossal layer

* separate different layer policy, add some notion

* implement 1d and 2d slicer, can tell col or row

* fix bug when slicing and inject model

* fix some bug; add inference test example

* add share weight and train example

* add train

* add docstring and readme

* add docstring for other files

* pre-commit
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

1 more reviewer

@FrankLeeeee FrankLeeeee FrankLeeeee approved these changes

Reviewers whose approvals may not affect merge requirements

Assignees

No one assigned

Labels

enhancement New feature or request shardformer

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@FoolPlayer @FrankLeeeee