Fix for fragmented linear inputs in ZeRO 3 Linear layers where reshap…#881

Merged

jeffra merged 6 commits intomasterfrom

samyamr/fix-for-fragmented-linear-inputs

Apr 7, 2021

Commits on Mar 19, 2021

Fix for fragmented linear inputs in ZeRO 3 Linear layers where reshape is needed instead of view. Should not affect performance for cases which only requires view since reshape will just do view wh…
samyam
committed
Enable memory efficient linear when ZeRO 3 model is initialized in Stage 3 initialize instead of using deepspeed.init
samyam
committed

Commits on Mar 27, 2021

Merge branch 'master' into samyamr/fix-for-fragmented-linear-inputs
tjruwase
authored

Commits on Apr 1, 2021

Merge branch 'master' into samyamr/fix-for-fragmented-linear-inputs
jeffra
authored

Commits on Apr 2, 2021

Merge branch 'master' into samyamr/fix-for-fragmented-linear-inputs
jeffra
authored

Commits on Apr 7, 2021

Merge branch 'master' into samyamr/fix-for-fragmented-linear-inputs
jeffra
authored