title: Training a model on GPU is very slow
body: <p>I am using <code>A100-SXM4-40GB Gpu</code> but training is terribly slow. I tried two models, a simple classification on cifar and a Unet on Cityscapes. I tried my code on other GPUs and it worked totally fine, but I do not know why training on this high capacity GPU is super slow.</p>
  <p>I would appreciate any help.</p>
  <p>Here are some other properties of GPUs.</p>
  <pre><code>GPU 0: A100-SXM4-40GB
  GPU 1: A100-SXM4-40GB
  GPU 2: A100-SXM4-40GB
  GPU 3: A100-SXM4-40GB
  </code></pre>
  <ul>
  <li>Nvidia driver version: 460.32.03</li>
  <li>cuDNN version: Could not collect</li>
  </ul>