{'fraction_non_alphanumeric': 0.014563106796116505, 'fraction_numerical': 0.0, 'mean_word_length': 5.136904761904762, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Word Sense Disambiguation Model based on Bi-LSTM

Word sense disambiguation is a very important task in natural language processing, and it is also a basic work in this field. There are many polysemous words in Chinese vocabulary. Using the word sense disambiguation model can determine the correct meaning of polysemous words in different contexts according to the context of polysemous words, so as to eliminate the ambiguity caused by polysemous words in Chinese. This paper proposes a neural sequence learning model based on Bi-LSTM (bidirectional long short memory) to realize word sense disambiguation. The word vector of the sentence is input into the neural network to train the similarity model, and the different sense items are classified, and the ambiguity is determined by the similarity comparison. The correct sense item of the word thus realizes the disambiguation of the word sense. Experiments show that the disambiguation model proposed in this paper has higher disambiguation accuracy than traditional methods.