Question: How to speed up training?
Hi
I have a question about fast training.

I am trying to train QuartzNet15x5 from scratch on 6000 hours of data with 2xA100 GPUs. It takes 10 hours per epoch.

How can I speed up the training or convergence speed? 

I am using
2xA100 with 40GB RAM
mixed precision
80 num workers in torch loader

what else can i do to speed up the training?
