{'fraction_non_alphanumeric': 0.01837270341207349, 'fraction_numerical': 0.0, 'mean_word_length': 5.203252032520325, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
General bad data identification and estimation in the presence of critical measurement sets

In power systems state estimation, critical sets are groups of measurements whose normalized residuals are (nearly) equal, so that corresponding bad data are not identifiable. A novel methodology for the identification of critical sets and for the estimation of the bad data is introduced, based on a noisy projection of the residuals correlation matrix on a subspace. The proposed solution takes into account model and data uncertainty and is able to detect cases of nearly-critical sets, missed by traditional methods, including higher-order critical k-tuples. A convenient interpretation of the estimated bad data as the total error within the sets is also proposed.