{'fraction_non_alphanumeric': 0.015530629853321829, 'fraction_numerical': 0.0, 'mean_word_length': 5.105263157894737, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
TheSys-a comprehensive thesaurus system for intelligent document analysis and text retrieval

Well designed thesauri can represent semantic/conceptual knowledge so as to reveal relationships among different elements in documents, thus serving as a critical tool in intelligent text retrieval systems and document analysis systems. In this paper, we present a thesaurus system, referred to as TheSys, which can be used as a tool for users to build thesauri according to their own requirements. It is our goal to design a comprehensive thesaurus building tool which can be used in any field of specialty rather than targeting for a particular specialty field. People can use our system to build an electronic thesaurus in any specialty field required for a specific application. We propose a thesaurus model, referred to as the thesaurus frame, which uses weighted links, to represent semantic relationships among concepts and terms. Our approach is to use a set of controlled terms, referred to as semantemes, to build the thesaurus frame. This approach can effectively reduce the size of the thesaurus yet the intelligence of the thesaurus is not compromised.