Util for measuring MFU?
We will add support for this in this repo: computing Model Flops Utilization. 
Our team has this task in the backlog and will be working on it. @dementrock I'll be adding this support this week. Any particular model(s) that you are looking at? 
@ericharper Could you assign this to me? @ericharper can you help review and merge this PR- #9735? @malay-nagda thanks a lot! Support for the common models like llama / mistral would be sufficient for us for now This issue is stale because it has been open for 30 days with no activity. Remove stale label or comment or this will be closed in 7 days.
We'd like to track model flops utilization (MFU) during training. Is there any pointers for how to do this or would it be possible to add support for this within NeMo?