{'fraction_non_alphanumeric': 0.022857142857142857, 'fraction_numerical': 0.001142857142857143, 'mean_word_length': 5.212765957446808, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Knowledge Graph - Our Secret Recipe for Entity Disambiguation

Being able to correctly disambiguate persons and organizations mentioned in various documents can have a great impact on helping FINRA achieve its mission - protecting investors and ensuring the integrity of U.S. securities markets. Our solution was to disambiguate entities and make connections through FINRA Knowledge Graph [1]. Various text analytics techniques were used to improve data quality. The sparsely populated data led us to a home-grown "seed" algorithm - a bottom-up community detection technique that grows communities around reliable clusters (seeds). We adapted a clustering algorithm used for DNA sequencing to improve the quality of disambiguation. Using these approaches, we were able to find a practical solution for clique detection problem which is foundational for entity disambiguation.