{'fraction_non_alphanumeric': 0.021739130434782608, 'fraction_numerical': 0.0, 'mean_word_length': 5.662650602409639, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Numbered sequence detection in documents

We present in this work a method to detect numbered sequences in a document. The method relies on the following steps: first, all potential "numbered patterns" are automatically extracted from the document. Secondly, possible coherent sequences are built using pattern incrementality (called incremental relation). Finally possible wrong links between items are corrected using the notion of optimization context. An evaluation of the method is presented and weaknesses and possible improvements are discussed.