NeMo MCore Llama2 support fp8
This issue is stale because it has been open for 30 days with no activity. Remove stale label or comment or this will be closed in 7 days. This issue was closed because it has been inactive for 7 days since being marked as stale.

Hi, does Nemo MCore llama2 currently support training with fp8? I got this error when training the llama model with fp8
![Screenshot from 2023-11-09 18-03-17](https://github.com/NVIDIA/NeMo/assets/25007718/57c79bc4-8610-4f45-a042-dcdc8b69bf0d)

Thanks !