ASR Adaptation for E-commerce Chatbots using Cross-Utterance Context and
  Multi-Task Language Modeling
  Automatic Speech Recognition (ASR) robustness toward slot entities are
critical in e-commerce voice assistants that involve monetary transactions and
purchases. Along with effective domain adaptation, it is intuitive that cross
utterance contextual cues play an important role in disambiguating domain
specific content words from speech. In this paper, we investigate various
techniques to improve contextualization, content word robustness and domain
adaptation of a Transformer-XL neural language model (NLM) to rescore ASR
N-best hypotheses. To improve contextualization, we utilize turn level dialogue
acts along with cross utterance context carry over. Additionally, to adapt our
domain-general NLM towards e-commerce on-the-fly, we use embeddings derived
from a finetuned masked LM on in-domain data. Finally, to improve robustness
towards in-domain content words, we propose a multi-task model that can jointly
perform content word detection and language modeling tasks. Compared to a
non-contextual LSTM LM baseline, our best performing NLM rescorer results in a
content WER reduction of 19.2% on e-commerce audio test set and a slot labeling
F1 improvement of 6.4%.
