Applying PR 1794 to  r1.0.0rc1
PR https://github.com/NVIDIA/NeMo/pull/1794 is important for nemo saving but was applied to the main branch only; for most of us, the working branch is r1.0.0rc1. This PR applies the same change to this branch.

Signed-off-by: mchrzanowski mike.chrzanowski0@gmail.com
