Applying GPGPU to Recurrent Neural Network Language Model based Fast
  Network Search in the Real-Time LVCSR
  Recurrent Neural Network Language Models (RNNLMs) have started to be used in
various fields of speech recognition due to their outstanding performance.
However, the high computational complexity of RNNLMs has been a hurdle in
applying the RNNLM to a real-time Large Vocabulary Continuous Speech
Recognition (LVCSR). In order to accelerate the speed of RNNLM-based network
searches during decoding, we apply the General Purpose Graphic Processing Units
(GPGPUs). This paper proposes a novel method of applying GPGPUs to RNNLM-based
graph traversals. We have achieved our goal by reducing redundant computations
on CPUs and amount of transfer between GPGPUs and CPUs. The proposed approach
was evaluated on both WSJ corpus and in-house data. Experiments shows that the
proposed approach achieves the real-time speed in various circumstances while
maintaining the Word Error Rate (WER) to be relatively 10% lower than that of
n-gram models.
