Convolutional Speech Recognition with Pitch and Voice Quality Features
  The effects of adding pitch and voice quality features such as jitter and
shimmer to a state-of-the-art CNN model for Automatic Speech Recognition are
studied in this work. Pitch features have been previously used for improving
classical HMM and DNN baselines, while jitter and shimmer parameters have
proven to be useful for tasks like speaker or emotion recognition. Up to our
knowledge, this is the first work combining such pitch and voice quality
features with modern convolutional architectures, showing improvements up to 7%
and 3% relative WER points, for the publicly available Spanish Common Voice and
LibriSpeech 100h datasets, respectively. Particularly, our work combines these
features with mel-frequency spectral coefficients (MFSCs) to train a
convolutional architecture with Gated Linear Units (Conv GLUs). Such models
have shown to yield small word error rates, while being very suitable for
parallel processing for online streaming recognition use cases. We have added
pitch and voice quality functionality to Facebook's wav2letter speech
recognition framework, and we provide with such code and recipes to the
community, to carry on with further experiments. Besides, to the best of our
knowledge, our Spanish Common Voice recipe is the first public Spanish recipe
for wav2letter.
