Performance data mistakes in LLAMA inference
This issue is stale because it has been open for 30 days with no activity. Remove stale label or comment or this will be closed in 7 days. This issue was closed because it has been inactive for 7 days since being marked as stale.
[Inference Performance of LLAMA-2 posted by Nvidia 1](https://docs.nvidia.com/nemo-framework/user-guide/latest/performance/llama.html)

According to the link above, the inference lantecy of LLAMA-2-13B with A100 80GB SXM4 at batch size=1 and tp=1, is less than latency of LLAMA-2-7B under the same condition.

How can we get this performance data? It’s unbelievable and ridiculous.