{'fraction_non_alphanumeric': 0.019036954087346025, 'fraction_numerical': 0.0022396416573348264, 'mean_word_length': 5.248251748251748, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
A Novel Approach for Analyzing Entity Linking Between Words and Entities for a Knowledge Base Using an Attention-Based Bilinear Joint Learning and Weighted Summation Model

Entity linking (EL) is a task about natural language that links mentions of entities in text to corresponding entities that are in a knowledge base. Potential applications include question-answering systems, information extraction and knowledge base population (KBP). The key to structuring an EL system that has high quality involves creating careful representations of words and entities. However, a hypothesis that whole words have the same weight in their context exists in most previous methods, which causes the meanings of words to be biased. In this paper, a novel approach to analyze entity linking between words and entities for a knowledge base using attention-based bilinear joint learning is proposed. First, the approach designs a novel encoding method to model entities and words in EL. The method learns words and entities in a joint way and uses an attention mechanism to obtain different importance values in the context. Second, the approach introduces a weighted summation method to form the textual context and introduces the method with same line of reasoning to model coherence to improve ranking the features. Finally, the approach employs a pairwise boosting regression tree (PBRT) to rank the candidate entities. During the ranking, the approach takes features constructed with a weighted summation model and conventional EL features as the input. Through experiments, it demonstrates that compared with other state-of-the-art methods, the proposed model learns embeddings efficiently and improves EL performance. Our approach achieves progressive results on CoNLL and TAC 2010 datasets.