Data-Efficient Framework for Real-world Multiple Sound Source 2D
  Localization
  Deep neural networks have recently led to promising results for the task of
multiple sound source localization. Yet, they require a lot of training data to
cover a variety of acoustic conditions and microphone array layouts. One can
leverage acoustic simulators to inexpensively generate labeled training data.
However, models trained on synthetic data tend to perform poorly with
real-world recordings due to the domain mismatch. Moreover, learning for
different microphone array layouts makes the task more complicated due to the
infinite number of possible layouts. We propose to use adversarial learning
methods to close the gap between synthetic and real domains. Our novel
ensemble-discrimination method significantly improves the localization
performance without requiring any label from the real data. Furthermore, we
propose a novel explicit transformation layer to be embedded in the
localization architecture. It enables the model to be trained with data from
specific microphone array layouts while generalizing well to unseen layouts
during inference.
