{'fraction_non_alphanumeric': 0.011412268188302425, 'fraction_numerical': 0.0, 'mean_word_length': 5.5, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 1, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Developing A General Purpose Optical Character Recognition System

The most important points in the development of an OCR system are the font independence and the ability to read free layout text. The feature extraction algorithm based on contour tracing generates size invariant geometrical and topological features which make the recognition as font independent as possible. In our OCR system (Recognita) these features are arranged in a tree structure which enables fast classification to be done. The character and line finding algorithm is designed to meet the second requirement including the recognition of proportional spacing, ligatures, kerning and automatic separation of graphics and text.