{'fraction_non_alphanumeric': 0.014405762304921969, 'fraction_numerical': 0.0, 'mean_word_length': 5.725806451612903, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Robust Probabilistic Simplex Component Analysis

Simplex component analysis (SCA) is an important problem that finds diverse applications from hyperspectral imaging to topic mining and community detection. This contribution revisits SCA from a probabilistic point of view, with the aim of dealing with outliers in a disciplined and effective way. Towards this end, a mixture distribution is used to model the data, and the parameters of the mixture model are sought via a maximum likelihood formulation. A variational inference approximation is used to tackle the resulting problem, and the solution enables simultaneous nominal model estimation and outlier detection. Careful simulations with synthetic and semi-real data reveal that the proposed approach offers significantly improved robustness and outlier detection capabilities.