Loss is getting zero when training Titanet with Adam
Hi

I am trying to train TitaNet with angular loss. When the optimizer is SGD everything is fine (loss decreases and TopK accuracy  increases). Switching optimizer from SGD to Adam or AdamW results zero loss and zero accuracy after some steps.  Do you have any clue about zero-loss?
Btw, number of speakers in my case is equal to ~25000.