far by jamesthesnake · Pull Request #53 · jamesthesnake/ColossalAI

jamesthesnake · 2023-06-02T20:27:05Z

📌 Checklist before creating the PR

I have created an issue for this PR for traceability
The title follows the standard format: [doc/gemini/tensor/...]: A concise description
I have added relevant tags if possible for us to better distinguish different PRs

🚨 Issue number

Link this PR to your issue with words like fixed to automatically close the linked issue upon merge

e.g. fixed #1234, closed #1234, resolved #1234

📝 What does this PR do?

Summarize your work here.
if you have any plots/diagrams/screenshots/tables, please attach them here.

💥 Checklist before requesting a review

I have linked my PR to an issue (instruction)
My issue clearly describes the problem/feature/proposal, with diagrams/charts/table/code if possible
I have performed a self-review of my code
I have added thorough tests.
I have added docstrings for all the functions/methods I implemented

⭐️ Do you enjoy contributing to Colossal-AI?

🌝 Yes, I do.
🌚 No, I don't.

Tell us more if you don't enjoy contributing to Colossal-AI.

* [doc] add docstr for booster methods * [doc] fix autodoc

* Update colotensor_concept.md * Update configure_parallelization.md * Update define_your_config.md * Update engine_trainer.md * Update initialize_features.md * Update model_checkpoint.md * Update colotensor_concept.md * Update configure_parallelization.md * Update define_your_config.md * Update engine_trainer.md * Update initialize_features.md * Update model_checkpoint.md

* [doc] update gradient clipping document * [doc] update gradient clipping document * [doc] update gradient clipping document * [doc] update gradient clipping document * [doc] update gradient clipping document * [doc] update gradient clipping document * [doc] update gradient clipping doc, fix sidebars.json * [doc] update gradient clipping doc, fix doc test

#3787) Co-authored-by: github-actions <github-actions@github.com>

* [docker] Add ARG VERSION to determine the Tag * [workflow] fixed the version in the release docker workflow --------- Co-authored-by: liuzeming <liuzeming@4paradigm.com>

* [workflow] fixed the docker build workflow * polish code

* [doc]update gradient accumulation * [doc]update gradient accumulation * [doc]update gradient accumulation * [doc]update gradient accumulation * [doc]update gradient accumulation, fix * [doc]update gradient accumulation, fix * [doc]update gradient accumulation, fix * [doc]update gradient accumulation, add sidebars * [doc]update gradient accumulation, fix * [doc]update gradient accumulation, fix * [doc]update gradient accumulation, fix * [doc]update gradient accumulation, resolve comments * [doc]update gradient accumulation, resolve comments * fix

* [mixed_precison] add naive amp demo * [mixed_precison] add naive amp demo * [api] add docstrings and initialization to apex amp, naive amp * [api] add docstring to apex amp/ naive amp * [api] add docstring to apex amp/ naive amp * [api] add docstring to apex amp/ naive amp * [api] add docstring to apex amp/ naive amp * [api] add docstring to apex amp/ naive amp * [api] add docstring to apex amp/ naive amp * [api] fix * [api] fix

* fix typo colossalai/autochunk auto_parallel amp * fix typo colossalai/auto_parallel nn utils etc.

[doc] update amp document

* [workflow] changed to doc build to be on schedule and release * polish code

* add functions for gpt evaluation * add automatic eval Update eval.py * using jload and modify the type of answers1 and answers2 * Update eval.py Update eval.py * Update evaluator.py * support gpt evaluation * update readme.md update README.md update READNE.md modify readme.md * add Chinese example for config, battle prompt and evaluation prompt file * remove GPT-4 config * remove sample folder --------- Co-authored-by: Yuanchen Xu <yuanchen.xu00@gmail.com> Co-authored-by: Camille Zhong <44392324+Camille7777@users.noreply.github.com>

* fix typo colossalai/autochunk auto_parallel amp * fix typo colossalai/auto_parallel nn utils etc. * fix typo colossalai/auto_parallel autochunk fx/passes etc. * fix typo docs/ * change placememt_policy to placement_policy in docs/ and examples/

* [workflow] fixed testmon cache in build CI * polish code

* [doc] update meet_gemini.md * [doc] update meet_gemini.md * [doc] fix parentheses * [doc] fix parentheses * [doc] fix doc test * [doc] fix doc test * [doc] fix doc

* fix typo colossalai/autochunk auto_parallel amp * fix typo colossalai/auto_parallel nn utils etc. * fix typo colossalai/auto_parallel autochunk fx/passes etc. * fix typo docs/ * change placememt_policy to placement_policy in docs/ and examples/ * fix typo colossalai/ applications/

* fix a bug when the config file contains one category but the answer file doesn't contains that category * fix Chinese prompt file * support gpt-3.5-turbo and gpt-4 evaluation * polish and update README * resolve pr comments --------- Co-authored-by: Yuanchen Xu <yuanchen.xu00@gmail.com>

* [example]update gemini examples * [example]update gemini examples

* [doc] fix title of mixed precision * [doc]update document of zero with chunk * [doc] update document of zero with chunk, fix * [doc] update document of zero with chunk, fix * [doc] update document of zero with chunk, fix * [doc] update document of zero with chunk, add doc test * [doc] update document of zero with chunk, add doc test * [doc] update document of zero with chunk, fix installation * [doc] update document of zero with chunk, fix zero with chunk doc * [doc] update document of zero with chunk, fix zero with chunk doc

* fix typo colossalai/autochunk auto_parallel amp * fix typo colossalai/auto_parallel nn utils etc. * fix typo colossalai/auto_parallel autochunk fx/passes etc. * fix typo docs/ * change placememt_policy to placement_policy in docs/ and examples/ * fix typo colossalai/ applications/ * fix typo colossalai/cli fx kernel

ver217 and others added 30 commits May 22, 2023 10:56

[doc] add booster docstring and fix autodoc (#3789)

72688ad

* [doc] add docstr for booster methods * [doc] fix autodoc

[format] applied code formatting on changed files in pull request 3786 (

62c7e67

#3787) Co-authored-by: github-actions <github-actions@github.com>

Fix/docker action (#3266)

4d29c0f

* [docker] Add ARG VERSION to determine the Tag * [workflow] fixed the version in the release docker workflow --------- Co-authored-by: liuzeming <liuzeming@4paradigm.com>

[workflow] fixed the docker build workflow (#3794)

788e07d

* [workflow] fixed the docker build workflow * polish code

fixed the example docstring for booster (#3795)

f5c425c

[workflow] enable testing for develop & feature branch (#3801)

ad93c73

[test] fixed lazy init test import error (#3799)

615e2e5

[NFC]fix typo colossalai/auto_parallel nn utils etc. (#3779)

9265f2d

* fix typo colossalai/autochunk auto_parallel amp * fix typo colossalai/auto_parallel nn utils etc.

[doc] update amp document

8c62e50

[doc] update amp document

1167bf5

[doc] update amp document

a520610

[doc] add removed warning

75272ef

[doc] add removed change of config.py

c425a69

[booster] torch fsdp fix ckpt (#3788)

6b305a9

[doc] add warning about fsdp plugin (#3813)

19d1530

[workflow] enblaed doc build from a forked repo (#3815)

1e3b64f

[doc]fix

8aa1fb2

[doc]fix

278fcbc

Merge pull request #3810 from jiangmingyan/amp

725365f

[doc] update amp document

fix typo colossalai/auto_parallel autochunk fx/passes etc. (#3808)

7f8203a

[Docker] Fix a couple of build issues (#3691)

269150b

[workflow] changed to doc build to be on schedule and release (#3825)

05b8a8d

* [workflow] changed to doc build to be on schedule and release * polish code

fix typo docs/

e90fdb1

[workflow] fixed testmon cache in build CI (#3806)

84500b7

* [workflow] fixed testmon cache in build CI * polish code

wukong1992 and others added 11 commits May 25, 2023 14:00

[booster] add warning for torch fsdp plugin doc (#3833)

3229f93

[workflow] supported test on CUDA 10.2 (#3841)

54e97ed

[doc] update document of gemini instruction. (#3842)

a64df3f

* [doc] update meet_gemini.md * [doc] update meet_gemini.md * [doc] fix parentheses * [doc] fix parentheses * [doc] fix doc test * [doc] fix doc test * [doc] fix doc

[release] bump to v0.3.0 (#3830)

d42b1be

[workflow] fixed workflow check for docker build (#3849)

ae959a7

[doc] update nvme offload documents. (#3850)

b047487

[example] update gemini examples (#3868)

5f79008

* [example]update gemini examples * [example]update gemini examples

jamesthesnake merged commit 1a4f721 into jamesthesnake:l Jun 2, 2023

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

far#53

far#53
jamesthesnake merged 41 commits intojamesthesnake:lfrom
hpcaitech:main

jamesthesnake commented Jun 2, 2023

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

10 participants

Conversation

jamesthesnake commented Jun 2, 2023

📌 Checklist before creating the PR

🚨 Issue number

📝 What does this PR do?

💥 Checklist before requesting a review

⭐️ Do you enjoy contributing to Colossal-AI?

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

10 participants