{'fraction_non_alphanumeric': 0.01567398119122257, 'fraction_numerical': 0.0, 'mean_word_length': 5.344370860927152, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Detecting Duplicates at Hospital Admission: Comparison of Deterministic and Probabilistic Record Linkage

Effective detection of corresponding or duplicate records in medical data sets is vital for a high quality health care system. We evaluate the efficacy of several current and novel record linkage approaches by modeling a hospital-admission scenario, wherein an incoming patient may or may not have been previously treated. Our work is to develop recommendations for how an automated system could operate in such a scenario, especially regarding comparison and classification. By using a large, anonymous, real-world data set, we can gain insight into the robustness of these methods in a way that artificial data sets cannot provide. Preliminary results show that even minor confounders have deleterious effects on our ability to classify matches. We aim to evaluate and refine a semi-supervised classification technique to cope with these influences.