Skip to content

[shardformer] support all GPT-J auto sharding except lazy init #4721

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
ppt0011 wants to merge 72 commits into from

[shardformer] support all GPT-J shard former techniques except lazy init

ec9cba2
Select commit
Loading
Failed to load commit list.
Closed

[shardformer] support all GPT-J auto sharding except lazy init #4721

[shardformer] support all GPT-J shard former techniques except lazy init
ec9cba2
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs