{'fraction_non_alphanumeric': 0.009313154831199068, 'fraction_numerical': 0.004656577415599534, 'mean_word_length': 5.466165413533835, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Experimental measurements of dynamic range requirements for cross-correlation with synthetic discriminant functions

Optical correlation systems have been lagging in performance due to the severely limited dynamic range capability which has been somewhat alleviated as newer devices are becoming available. In general, however, it is not clear what dynamic range is required for generally good performance both in the input device and in the filters. Experiments with a digital cross correlator which can accommodate up to 16 bits of input dynamic range was used to establish practical performance limitations for a majority of cross correlators. The experiments were conducted using a reduction of the dynamic range from actual 12 bit data incrementally to smaller levels such that performance measures could be compared. This paper quantifies these results.