Ra by jamesthesnake · Pull Request #8 · jamesthesnake/ColossalAI

jamesthesnake · 2023-04-02T18:23:14Z

📌 Checklist before creating the PR

I have created an issue for this PR for traceability
The title follows the standard format: [doc/gemini/tensor/...]: A concise description
I have added relevant tags if possible for us to better distinguish different PRs

🚨 Issue number

Link this PR to your issue with words like fixed to automatically close the linked issue upon merge

e.g. fixed #1234, closed #1234, resolved #1234

📝 What does this PR do?

Summarize your work here.
if you have any plots/diagrams/screenshots/tables, please attach them here.

💥 Checklist before requesting a review

I have linked my PR to an issue (instruction)
My issue clearly describes the problem/feature/proposal, with diagrams/charts/table/code if possible
I have performed a self-review of my code
I have added thorough tests.
I have added docstrings for all the functions/methods I implemented

⭐️ Do you enjoy contributing to Colossal-AI?

🌝 Yes, I do.
🌚 No, I don't.

Tell us more if you don't enjoy contributing to Colossal-AI.

* polish train_prompts * polish readme

* [application] updated the README * polish code

* [doc] add ColossalChat news * [doc] add ColossalChat news

hpcaitech#3302) Co-authored-by: github-actions <github-actions@github.com>

…dding.py code style (hpcaitech#3256) Co-authored-by: Minghao Huang <huangminghao@luchentech.com>

….py (hpcaitech#3260)

Co-authored-by: luchen <luchen@luchendeMBP.lan>

…ch#3263) Co-authored-by: csric <richcsr256@gmail.com>

Co-authored-by: Yuanchen Xu <yuanchen.xu00@gmail.com>

… style (hpcaitech#3275)

…tech#3276)

…lation.py code style (hpcaitech#3277) Co-authored-by: siqi <siqi@siqis-MacBook-Pro.local>

…#3290)

* [NFC] polish colossalai/engine/schedule/_pipeline_schedule.py code style * [NFC] polish colossalai/fx/tracer/_tracer_utils.py code style --------- Co-authored-by: Qianran Ma <qianranm@luchentech.com>

* [doc] add Intel cooperation news * [doc] add Intel cooperation news

…3338)

…ech#3327)

hpcaitech#3329)

* [autoparallel] adapt autoparallel with new analyzer * fix all node handler tests * polish * polish

* [moe] add checkpoint for moe models * [hotfix] fix bugs in unit test

* [booster] add gemini plugin * [booster] update docstr * [booster] gemini plugin add coloparam convertor * [booster] fix coloparam convertor * [booster] fix gemini plugin device * [booster] add gemini plugin test * [booster] gemini plugin ignore sync bn * [booster] skip some model * [booster] skip some model * [booster] modify test world size * [booster] modify test world size * [booster] skip test

s/0.12.0/0.0.12/

* [examples/images/diffusion]: README.md: typo fixes * Update README.md * Grammar fixes * Reformulated "Step 3" (xformers) introduction to the cost => at the cost + reworded pip availability.

Minor changes to improve grammar and punctuation.

ra

ht-zhou and others added 30 commits March 29, 2023 08:44

[chat]polish prompts training (hpcaitech#3300)

8257e10

* polish train_prompts * polish readme

[application] updated the README (hpcaitech#3301)

e235a24

* [application] updated the README * polish code

[doc] add ColossalChat news (hpcaitech#3304)

31c78f2

* [doc] add ColossalChat news * [doc] add ColossalChat news

[format] applied code formatting on changed files in pull request 3300 (

cb413cc

hpcaitech#3302) Co-authored-by: github-actions <github-actions@github.com>

[release] v0.2.8 (hpcaitech#3305)

a0b3749

Polish readme link (hpcaitech#3306)

b512893

[doc] added authors to the chat application (hpcaitech#3307)

0fbadce

[NFC] polish colossalai/fx/profiler/experimental/profiler_module/embe…

204ca2f

…dding.py code style (hpcaitech#3256) Co-authored-by: Minghao Huang <huangminghao@luchentech.com>

[NFC] polish colossalai/engine/gradient_handler/_moe_gradient_handler…

1ff7d5b

….py (hpcaitech#3260)

[NFC] polish colossalai/global_variables.py code style (hpcaitech#3259)

488f370

Co-authored-by: luchen <luchen@luchendeMBP.lan>

[NFC] polish colossalai/fx/passes/split_module.py code style (hpcaite…

00778ab

…ch#3263) Co-authored-by: csric <richcsr256@gmail.com>

[NFC] polish tensor_placement_policy.py code style (hpcaitech#3265)

c4a226b

[NFC] polish code style (hpcaitech#3268)

d58fa70

Co-authored-by: Yuanchen Xu <yuanchen.xu00@gmail.com>

[NFC] policy colossalai/fx/proxy.py code style (hpcaitech#3269)

4cadb25

[NFC] polish code style (hpcaitech#3273)

6b3bb2c

[NFC] polish colossalai/amp/__init__.py code style (hpcaitech#3272)

4b95464

[NFC] polish colossalai/nn/_ops/addmm.py code style (hpcaitech#3274)

196d469

[NFC] polish colossalai/engine/schedule/_pipeline_schedule_v2.py code…

1168b50

… style (hpcaitech#3275)

[NFC] polish colossalai/context/parallel_context.py code style (hpcai…

8af977f

…tech#3276)

[NFC] polish colossalai/engine/gradient_accumulation/_gradient_accumu…

94eec1c

…lation.py code style (hpcaitech#3277) Co-authored-by: siqi <siqi@siqis-MacBook-Pro.local>

[NFC] polish initializer_3d.py code style (hpcaitech#3279)

964a286

[NFC] polish colossalai/cli/benchmark/models.py code style (hpcaitech…

1bed38e

…#3290)

[NFC] polish initializer_data.py code style (hpcaitech#3287)

1ce9d0c

[NFC] polish colossalai/gemini/paramhooks/_param_hookmgr.py code style

6435002

[NFC] polish colossalai/fx/tracer/_tracer_utils.py (hpcaitech#3323)

ad285e1

* [NFC] polish colossalai/engine/schedule/_pipeline_schedule.py code style * [NFC] polish colossalai/fx/tracer/_tracer_utils.py code style --------- Co-authored-by: Qianran Ma <qianranm@luchentech.com>

[doc] add Intel cooperation news (hpcaitech#3333)

15a74da

* [doc] add Intel cooperation news * [doc] add Intel cooperation news

[hotfix] meta_tensor_compatibility_with_torch2

fbd2a9e

[chat] correcting a few obvious typos and grammars errors (hpcaitech#…

82132f4

…3338)

[NFC] polish colossalai/context/random/__init__.py code style (hpcait…

198a74b

…ech#3327)

[NFC] polish colossalai/engine/gradient_handler/__init__.py code style (

8706a8c

hpcaitech#3329)

kurisusnowdeng and others added 8 commits March 30, 2023 15:25

fix torch 2.0 compatibility (hpcaitech#3346)

e78a1e9

[autoparallel] adapt autoparallel with new analyzer (hpcaitech#3261)

fee2af8

* [autoparallel] adapt autoparallel with new analyzer * fix all node handler tests * polish * polish

[moe] add checkpoint for moe models (hpcaitech#3354)

1a1d68b

* [moe] add checkpoint for moe models * [hotfix] fix bugs in unit test

Typofix: malformed xformers version (hpcaitech#3384)

51cd2fe

s/0.12.0/0.0.12/

[doc] polish diffusion example (hpcaitech#3386)

dd367ce

* [examples/images/diffusion]: README.md: typo fixes * Update README.md * Grammar fixes * Reformulated "Step 3" (xformers) introduction to the cost => at the cost + reworded pip availability.

Improve grammar and punctuation (hpcaitech#3398)

94c24d9

Minor changes to improve grammar and punctuation.

Merge pull request #7 from hpcaitech/main

2071350

ra

jamesthesnake merged commit 6d10ae7 into co Apr 2, 2023

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Ra#8

Ra#8
jamesthesnake merged 38 commits intocofrom
ra

jamesthesnake commented Apr 2, 2023

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

20 participants

Conversation

jamesthesnake commented Apr 2, 2023

📌 Checklist before creating the PR

🚨 Issue number

📝 What does this PR do?

💥 Checklist before requesting a review

⭐️ Do you enjoy contributing to Colossal-AI?

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

20 participants