Rethinking Text Line Recognition Models
  In this paper, we study the problem of text line recognition. Unlike most
approaches targeting specific domains such as scene-text or handwritten
documents, we investigate the general problem of developing a universal
architecture that can extract text from any image, regardless of source or
input modality. We consider two decoder families (Connectionist Temporal
Classification and Transformer) and three encoder modules (Bidirectional LSTMs,
Self-Attention, and GRCLs), and conduct extensive experiments to compare their
accuracy and performance on widely used public datasets of scene and
handwritten text. We find that a combination that so far has received little
attention in the literature, namely a Self-Attention encoder coupled with the
CTC decoder, when compounded with an external language model and trained on
both public and internal data, outperforms all the others in accuracy and
computational complexity. Unlike the more common Transformer-based models, this
architecture can handle inputs of arbitrary length, a requirement for universal
line recognition. Using an internal dataset collected from multiple sources, we
also expose the limitations of current public datasets in evaluating the
accuracy of line recognizers, as the relatively narrow image width and sequence
length distributions do not allow to observe the quality degradation of the
Transformer approach when applied to the transcription of long lines.
