{'fraction_non_alphanumeric': 0.014134275618374558, 'fraction_numerical': 0.004711425206124852, 'mean_word_length': 4.704697986577181, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
A Solution to the Effect of Sample Size on Outlier Elimination

Results from a Monte Carlo study demonstrate how a non-recursive, a simple recursive, a modified recursive, and a hybrid outlier elimination procedure are influenced by population skew and sample size. All the procedures are based on computing a mean and a standard deviation from a sample in order to determine whether an observation is an outlier. Miller (1991) showed that the estimated mean produced by the simple non-recursive procedure can be affected by sample size and that this effect can produce a bias in certain kinds of experiments. We extended this result to the other three procedures. We also create two new procedures in which the criterion used to identify outliers is adjusted as a function of sample size so as to produce results that are unaffected by sample size.