[shardformer] fix pipeline forward error if custom layer distribution is used#5189

Merged

cwher merged 9 commits intohpcaitech:mainfrom

insujang:fix/shardformer_distribute_layer

Mar 27, 2024

Commits on Mar 27, 2024

Use self.[distribute_layers|get_stage_index] to exploit custom layer distribution

insujang
authored and
cwher
committed
Change static methods for t5 layer distribution to member functions

insujang
authored and
cwher
committed
Change static methods for whisper layer distribution to member functions

insujang
authored and
cwher
committed
Replace whisper policy usage with self one

insujang
authored and
cwher
committed
Fix test case to use non-static layer distribution methods

insujang
authored and
cwher
committed
Fix missing changes

insujang
authored and
cwher
committed
style: polish code
cwher
committed
feat: Use self.[distribute_layers|get_stage_index] to exploit custom layer distribution
cwher
committed
fix: fix typo
cwher
committed