Megatron-LM GPT2 ZeRO2 on 16 GPUs#20

Merged

jithunnair-amd merged 1 commit intoROCm:masterfrom

rraminen:GPT2_16GPUs_config

Mar 1, 2022

Commits on Mar 1, 2022

Added scripts to run Megatron-LM GPT2 on 16 GPUs
rraminen
committed