{'fraction_non_alphanumeric': 0.013613861386138614, 'fraction_numerical': 0.0, 'mean_word_length': 5.3700787401574805, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Detection of Temporal Document Features for Information Retrieval

In this paper we concern with the automatic generation of document temporal metadata, and how to exploit it in current Information Retrieval and Topic Detection systems. Specifically, we first propose a method to automatically detect the time references appearing in a document and to translate them into a formal time model. Then, we describe an algorithm that constructs the event-time period of a document starting from its extracted time references. Finally, we demonstrate through a clustering experiment that such generated event-time periods are as accurate as regarding all the time references of the document. This greatly simplifies the representation of the document temporality and its management within IR and databases systems.