Unsupervised Source Separation via Self-Supervised Training
  We introduce two novel unsupervised (blind) source separation methods, which
involve self-supervised training from single-channel two-source speech mixtures
without any access to the ground truth source signals. Our first method employs
permutation invariant training (PIT) to separate artificially-generated
mixtures of the original mixtures back into the original mixtures, which we
named mixture permutation invariant training (MixPIT). We found this
challenging objective to be a valid proxy task for learning to separate the
underlying sources. We improve upon this first method by creating mixtures of
source estimates and employing PIT to separate these new mixtures in a cyclic
fashion. We named this second method cyclic mixture permutation invariant
training (MixCycle), where cyclic refers to the fact that we use the same model
to produce artificial mixtures and to learn from them continuously. We show
that MixPIT outperforms a common baseline (MixIT) on our small dataset
(SC09Mix), and they have comparable performance on a standard dataset
(LibriMix). Strikingly, we also show that MixCycle surpasses the performance of
supervised PIT by being data-efficient, thanks to its inherent data
augmentation mechanism. To the best of our knowledge, no other purely
unsupervised method is able to match or exceed the performance of supervised
training.
