{'fraction_non_alphanumeric': 0.013843648208469055, 'fraction_numerical': 0.003257328990228013, 'mean_word_length': 5.335051546391752, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Automatic Reading System for Printed Documents

A system for automatically reading Japanese and English printed documents including different types of layout objects such as headlines, text lines and charts is proposed. This paper attempts to define these features, and describes a prototype system which satisfies the design objectives. The system has two stages. In the first stage, document image segmentation is carried out using three basic features and also knowledge of document layout rules. Furthermore, projection profiles of a text line are employed to extract a wide variety of characters. In the second stage, multifont character recognition is performed using feature vectors which represent stroke complexity, direction, connectivity and relative location of individual characters. A prototype system combining these two stages is described. The system consists of three special hardware units each connected with the one host computer. Recognition experiments with the prototype system are conducted for a range of printed documents. It is confirmed that the method proposed here is capable of reading different types of printed documents containing text lines and charts at an accuracy rate of 95 to 97 percent.