{'fraction_non_alphanumeric': 0.010714285714285714, 'fraction_numerical': 0.0, 'mean_word_length': 5.442528735632184, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Dynamic local connectivity and its application to page segmentation

Page segmentation is one of the important stage in most document processing systems. Algorithms found in published literatures often rely on some predetermined parameters such as general font sizes, distances between text lines and document scan resolutions. Variations of these parameters in real document images greatly affect the performance of the algorithms. In this paper we present a novel approach for document page segmentation using dynamic local connectivity transform. An efficient implementation of a local connectivity algorithm transforms a document image into a parameter domain in which a parameter value at a pixel location represents a connectivity property for its neighboring foreground pixels in the original document image. Then a top-down approach with a linear search reveals the document regions at each resolution levels as text block, text lines and graphics. We consider our algorithm a transform based multi-resolution method. Our ongoing research shows that the algorithm is robust for variations of document parameters.