Skip to content

Cache FP8 weight and transpose only at the first micro-batch in each validation and test routine#7470

Merged
layalir merged 2 commits intoNVIDIA-NeMo:r1.20.0_pt_23.09from
erhoo82:slym/cache_wt
Sep 22, 2023
Merged

Cache FP8 weight and transpose only at the first micro-batch in each validation and test routine#7470
layalir merged 2 commits intoNVIDIA-NeMo:r1.20.0_pt_23.09from
erhoo82:slym/cache_wt

Commits

Commits on Sep 20, 2023

Comments