{'fraction_non_alphanumeric': 0.017769002961500493, 'fraction_numerical': 0.0, 'mean_word_length': 5.541935483870968, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Named Entity Recognition for Addresses: An Empirical Study

In this paper, several model architectures are explored in order to design a high-performing named entity recognition model for addresses which deals with challenges such as diversity, ambiguity and complexity of the address entity. Different types of neural networks are used for training the classifier, including the bidirectional LSTM network in combination with a convolutional layer, a conditional random field layer and different word embeddings. Experiments are conducted on two types of corpora specifically constructed and tagged for tackling this challenge: unstructured and semi-structured datasets. For model evaluation, two versions of the unstructured dataset are used that are tagged differently based on the granularity of address entity: entire address, and address consisting of subparts. For both types of corpora, the best results are achieved on a BiLSTM-CRF architecture model with a single RNN layer trained with BERT embeddings.