[shardformer] support sharded checkpoint IO for models of HybridParallelPlugin #4506

Merged

flybird11111 merged 11 commits intohpcaitech:feature/shardformerfrom

Fridge003:feature/shardformer

Aug 25, 2023

Commits on Aug 25, 2023

add APIs
Baizhou Zhang
committed
implement save_sharded_model
Baizhou Zhang
committed
add test for hybrid checkpointio
Baizhou Zhang
committed
implement naive loading for sharded model
Baizhou Zhang
committed
implement efficient sharded model loading
Baizhou Zhang
committed
open a new file for hybrid checkpoint_io
Baizhou Zhang
committed
small fix
Baizhou Zhang
committed
fix circular importing
Baizhou Zhang
committed
fix docstring
Baizhou Zhang
committed
arrange arguments and apis
Baizhou Zhang
committed
small fix
Baizhou Zhang
committed