T5 changes based on mcore changes
> LGTM. One job (L2_QAT_Llama2_INT4) failed. I just restarted the job.

Job that failed optional - not required. Merging ...

PR based on : https://github.com/NVIDIA/NeMo/pull/9677/files