{'fraction_non_alphanumeric': 0.01199400299850075, 'fraction_numerical': 0.005247376311844078, 'mean_word_length': 5.327014218009479, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Intelligent signal processing for detection system optimization.

A wavelet-neural network signal processing method has demonstrated approximately 10-fold improvement over traditional signal processing methods for the detection limit of various nitrogen and phosphorus compounds from the output of a thermionic detector attached to a gas chromatograph. A blind test was conducted to validate the lower detection limit. All 14 of the compound spikes were detected when above the estimated threshold, including all 3 within a factor of 2 above the threshold. In addition, two of six spikes were detected at levels of half the concentration of the nominal threshold. Another two of the six would have been detected correctly if we had allowed human intervention to examine the processed data. One apparent false positive in five nulls was traced to a solvent impurity, whose presence was subsequently identified by analyzing a solvent aliquot evaporated to 1% residual volume, while the other four nulls were properly classified. We view this signal processing method as broadly applicable in analytical chemistry, and we advocate that advanced signal processing methods should be applied as directly as possible to the raw detector output so that less discriminating preprocessing and postprocessing does not throw away valuable signal.