Support TPU Training
Hi,
Thanks for your great repo. I think it would be really great if Nemo support TPU training (due to the fact that training on some large datasets on GPU is slow, and TPU will probably help in these scenarios. In addition, other speech frameworks, to the best of my knowledge, such as SpeechBrain, ESPNet, etc., currently do not support TPU training, so in this viewpoint, it would be a great benefit for Nemo).
Best