{'fraction_non_alphanumeric': 0.015056461731493099, 'fraction_numerical': 0.0, 'mean_word_length': 5.705882352941177, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Measuring of Semantic Relatedness between Words based on Wikipedia Links

A novel technique of semantic relatedness measurement between words based on link structure of Wikipedia was provided. Only Wikipedia’s link information was used in this method, which avoid researchers from burdensome text processing. During the process of relatedness computation, the positive effects of two-directional Wikipedia’s links and four link types are taken into account. Using a widely used test set of manual defined measures of semantic relatedness as bench-mark, our method resulted in substantial improvement in correlation of computed relatedness score with human judgments, with a smaller amount of calculation comparing with other present popular methods in computing semantic relatedness between words.