NMT fix for DDP training hanging
NMT DDP training is hanging after training for a few epochs. This hanging is likely due to validation metrics becoming out of sync. 

See the PTL discussion here: https://github.com/PyTorchLightning/pytorch-lightning/issues/5604

Was able to train for over 24 epochs with 4 GPUs without hanging.
