fixed 1D and 2D convergence#38

Merged

FrankLeeeee merged 3 commits intohpcaitech:develop/experimentsfrom

FrankLeeeee:develop/experiments

Dec 4, 2021

Commits on Nov 29, 2021

optimized 2D operations
FrankLeeeee
committed

Commits on Nov 30, 2021

Merge branch 'hpcaitech:develop/experiments' into develop/experiments
FrankLeeeee
authored

Commits on Dec 3, 2021

fixed 1D ViT convergence problem
FrankLeeeee
committed