[pipeline] rewrite t5 tests & support multi-tensor transmitting in pipeline#4388

Merged

ver217 merged 8 commits intohpcaitech:feature/pipelinefrom

Fridge003:feature/pipeline

Aug 8, 2023

Commits on Aug 7, 2023

fix remaining t5 bugs/rewrite t5 tests
Baizhou Zhang
committed
fix multi-tensor communication in pipeline
Baizhou Zhang
committed
rearrange test_config
Baizhou Zhang
committed
fix keyerror in sync_shared_params
Baizhou Zhang
committed

Commits on Aug 8, 2023

fix get_held_layers & Randomnizer, complete t5 tests
Baizhou Zhang
committed
erase printing
Baizhou Zhang
committed
fix get_held_layers through modifying _release_unheld_layers
Baizhou Zhang
committed
fix _get_recursive_held_layers bug
Baizhou Zhang
committed