[shardformer] add gpt2 test and layer class refactor#4041

Merged

FrankLeeeee merged 3 commits intohpcaitech:feature/shardformerfrom

FoolPlayer:gpt2

Jun 20, 2023

Commits on Jun 19, 2023

add gpt2 test and layer class refactor
FoolPlayer
committed

Commits on Jun 20, 2023

Merge branch 'feature/shardformer' of https://github.com/hpcaitech/ColossalAI into gpt2
FoolPlayer
committed
add dropout in gpt2 policy
FoolPlayer
committed