Skip to content

[checkpoint] add test for bert and hotfix save bugs#1297

Merged
feifeibear merged 10 commits intohpcaitech:mainfrom
feifeibear:checkpoint/param
Jul 14, 2022
Merged

[checkpoint] add test for bert and hotfix save bugs#1297
feifeibear merged 10 commits intohpcaitech:mainfrom
feifeibear:checkpoint/param

Conversation

@feifeibear
Copy link
Copy Markdown
Contributor

No description provided.

@feifeibear
Copy link
Copy Markdown
Contributor Author

image

@pytest.mark.dist
@pytest.mark.parametrize('world_size', [1, 2])
@pytest.mark.parametrize('use_ddp', [True, False])
@pytest.mark.parametrize('use_ddp', [False])
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why not use ddp?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ColoDDP is currently not available. @1SAA is working on DDP.

@feifeibear feifeibear merged commit 3ef3791 into hpcaitech:main Jul 14, 2022
@feifeibear feifeibear deleted the checkpoint/param branch July 14, 2022 07:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants