[shardformer] add util functions for shardformer tests/fix sync_shared_param#4366

Merged

ver217 merged 3 commits intohpcaitech:feature/pipelinefrom

Fridge003:feature/pipeline

Aug 3, 2023

Commits on Aug 3, 2023

add util functions for shardformer tests & rewrite gpt2 test
Baizhou Zhang
committed
fix shared_params & embedding/merging
Baizhou Zhang
committed
fix precision
Baizhou Zhang
committed