{'fraction_non_alphanumeric': 0.010101010101010102, 'fraction_numerical': 0.0, 'mean_word_length': 4.891089108910891, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Better selection of the best

We present a new method of selecting the best of several competing system designs on the basis of expected steady-state performance. The method uses a new form of time-series bootstrap in a sequential hypothesis testing framework. We illustrate the efficiency of the new method by comparing its results against the current state of the art in a series of simulation experiments. The new method achieves equal or greater probability of correct selection of the best system with substantial savings in the number of simulation observations required for the decision.