{'fraction_non_alphanumeric': 0.014138817480719794, 'fraction_numerical': 0.010282776349614395, 'mean_word_length': 5.43801652892562, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Semantic similarity computation based on HowNet2008

Semantic similarity is a fundamental concept and widely researched and used in the fields of natural language processing. By analyzing the definition of the concept in HowNet2008, this paper proposes a new method of semantic similarity calculation. The concepts are classified into three classes: simple concept; complex concept and combined concept. To different concept, we design different method and then transform the similarity calculation of concept into the similarity calculation of the sememe. The similarity of the smeme is computed by the hyponymy of the sememe in the sememe tree. Experiments show the new approach is effective to the similarity calculation and out-performs the conventional computed approaches.