You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The current API in shardformer such as shard_rowwise and shard_colwise will shard the tensor in place. This might cause unwanted usage, therefore, we should support non-inplace sharding.
Describe the feature
The current API in shardformer such as
shard_rowwiseandshard_colwisewill shard the tensor in place. This might cause unwanted usage, therefore, we should support non-inplace sharding.