An Efficient End-to-End Neural Model for Handwritten Text Recognition
  Offline handwritten text recognition from images is an important problem for
enterprises attempting to digitize large volumes of handmarked scanned
documents/reports. Deep recurrent models such as Multi-dimensional LSTMs have
been shown to yield superior performance over traditional Hidden Markov Model
based approaches that suffer from the Markov assumption and therefore lack the
representational power of RNNs. In this paper we introduce a novel approach
that combines a deep convolutional network with a recurrent Encoder-Decoder
network to map an image to a sequence of characters corresponding to the text
present in the image. The entire model is trained end-to-end using Focal Loss,
an improvement over the standard Cross-Entropy loss that addresses the class
imbalance problem, inherent to text recognition. To enhance the decoding
capacity of the model, Beam Search algorithm is employed which searches for the
best sequence out of a set of hypotheses based on a joint distribution of
individual characters. Our model takes as input a downsampled version of the
original image thereby making it both computationally and memory efficient. The
experimental results were benchmarked against two publicly available datasets,
IAM and RIMES. We surpass the state-of-the-art word level accuracy on the
evaluation set of both datasets by 3.5% & 1.1%, respectively.
