{'fraction_non_alphanumeric': 0.011560693641618497, 'fraction_numerical': 0.0, 'mean_word_length': 5.321167883211679, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Improvement on corpus-based word similarity using vector space models

This paper presents a new approach for finding semantically similar words from large text collection using window based context methods. Previous studies on this problem mainly concentrate on finding new methods which are new combination of distance-weight measurement methods or new context methods. The main difference of our approach is that we focus on reprocessing of existing methods' outputs to update the representation of related word vectors, which are used for measuring semantic distance between words, to further improve the results. This new approach can be easily applied to many of the existing word similarity methods using the vector space model for representing contexts. We claim that our method improves the performance of some of the existing similarity measuring methods.