{'fraction_non_alphanumeric': 0.0073937153419593345, 'fraction_numerical': 0.0, 'mean_word_length': 5.775, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Johnson distribution models of hyperspectral image data clusters

The Johnson System for characterizing an empirical distribution is used to model the non-normal behavior of Mahalanobis distances in material clusters extracted from hyperspectral imagery data. An automated method for determining Johnson distribution parameters is used to model Mahalanobis distance distributions and is compared to an existing method which uses mixtures of F distributions. The results lead to a method for determining outliers and mitigating their effects.