Speaker Diarization: Known Number of Speakers
Hello NeMo team

I evaluated NeMo clustering diarizer on VoxConverse dataset. And the results are wonderful. But when I am providing the actual number of speakers through manifest, results get worse. I noticed the same behavior for NIST SRE 2000 dataset too. I am wondering why is this happening? Is it something related to dataset (like overlap speech)?


<img width="873" alt="Screen Shot 2022-05-23 at 23 07 41" src="https://user-images.githubusercontent.com/47416614/169889294-ff7b4100-5f9c-4b58-b695-06a686c34c52.png">

