14thAnnual Conference of the International Speech Communication Association

Lyon, France
August 25-29, 2013

Learning Binaural Spectrogram Features for Azimuthal Speaker Localization

Wiktor Młynarski

MPI for Mathematics in the Sciences, Germany

Spatial localization of speech and other natural sounds with rich spectro-temporal structure is a computationally challenging task. It requires extraction of features which are informative about speaker's position and yet invariant to sound level and spectral modulation present in the signal. This paper demonstrates that this can be achieved with Independent Component Analysis (ICA) applied to binaural speech spectrograms. A small subset of learned Independent Components (ICs) captures signal structure imposed by outer ears. A Gaussian Classifier trained on those features, performs accurate localization on the azimuthal plane. The remaining majority of ICs have position invariant distributions, and can be used to reconstruct the spectrogram of the original sound source.

Full Paper

Bibliographic reference.  Młynarski, Wiktor (2013): "Learning binaural spectrogram features for azimuthal speaker localization", In INTERSPEECH-2013, 2939-2942.