{'fraction_non_alphanumeric': 0.011267605633802818, 'fraction_numerical': 0.0, 'mean_word_length': 5.644859813084112, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Similarity Measure Based on Improved Optimal Assignment Model

Measuring similarity has a wide range of application in information retrieval, machine translation or other related fields. In this paper, we proposed a text similarity computation based on improved optimal assignment model, which combine the improved Hungarian algorithm with the semantic similarity of terms to obtain the maximum semantic similarity between two documents or between a query and a document. Experiment shows that the algorithm has a significant improvement for semantic similarity comparing to traditional models of similarity measure. the method can be applied to document clustering, which will enchance the accuracy of result.