[shardformer] zero1+pp and the corresponding tests#4517

CjhHa1 merged 4 commits intohpcaitech:feature/shardformerhpcaitech/ColossalAI:feature/shardformerfrom

CjhHa1:shardformer/zero_ppCjhHa1/ColossalAI:shardformer/zero_ppCopy head branch name to clipboard