{'fraction_non_alphanumeric': 0.017834394904458598, 'fraction_numerical': 0.0, 'mean_word_length': 5.717948717948718, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Text document filters using morphological and geometrical features of characters

This paper aims at irregular noise removal in binary document images. A new filtering algorithm called the modified directional morphological filter (MDMF) is introduced with dual properties for eliminating document salt-and-pepper noises, and for remedying eroded character stroke distortion. For eliminating larger noise, an enhanced algorithm called the image geometric structure filter (IGSF) is proposed based on the geometric stroke information of the characters. The IGSF can especially be used for noise removal in alphanumeric documents. Experiments demonstrate that the performance of combining two filters is robust, which can feasibly filter out various isolated noises in the binary images.