Nvidia nemo blog and Apples to Oranges comparison of H200 vs A100
This issue is stale because it has been open for 30 days with no activity. Remove stale label or comment or this will be closed in 7 days. Touch. This issue is stale because it has been open for 30 days with no activity. Remove stale label or comment or this will be closed in 7 days. This issue was closed because it has been inactive for 7 days since being marked as stale.
Can someone from nemo fix this performance comparison and have A100 also on the same nemo version as the H200? The same blog is posted in this repo readme as indication of nemo performance numbers.

https://developer.nvidia.com/blog/new-nvidia-nemo-framework-features-and-nvidia-h200-supercharge-llm-training-performance-and-versatility/

A100: Nemo 23.08
H200: Nemo 24.01-alpha

I do not understand why Nvidia would publish this chart using different versions of nemo. Is A100 not supported in the latest nemo alpha/git release? Please help the community by doing apples to apples comparison, or provide the code/data to reproduce the data. 

Moreover, most of us do not have access to 8xA100 or 8XH100 to verify the results so it is even more important we, as potential end users, see true apples to apples comparisons.  Thanks.

![image](https://github.com/NVIDIA/NeMo/assets/417764/209d4151-b0f0-4222-831f-4aa0536b7a39)

