{'fraction_non_alphanumeric': 0.019813519813519812, 'fraction_numerical': 0.0, 'mean_word_length': 6.099173553719008, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
A penalized EM algorithm incorporating missing data mechanism for Gaussian parameter estimation

Missing data rates could depend on the targeted values in many settings, including mass spectrometry‐based proteomic profiling studies. Here, we consider mean and covariance estimation under a multivariate Gaussian distribution with non‐ignorable missingness, including scenarios in which the dimension (p) of the response vector is equal to or greater than the number (n) of independent observations. A parameter estimation procedure is developed by maximizing a class of penalized likelihood functions that entails explicit modeling of missing data probabilities. The performance of the resulting “penalized EM algorithm incorporating missing data mechanism (PEMM)” estimation procedure is evaluated in simulation studies and in a proteomic data illustration.