{'fraction_non_alphanumeric': 0.017210144927536232, 'fraction_numerical': 0.0036231884057971015, 'mean_word_length': 5.5, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Combining statistical pattern recognition approach with neural networks for recognition of large-set categories

We present a two-stage hierarchical system consisting of a statistical pattern recognition (SPR) module and artificial neural network (ANN) to recognize a large number of categories including similar category sets. In the first stage, the SPR module performs classification. If the first candidate does not belong to a pre-determined similar category set, the first candidate is accepted as the final result; otherwise, the first candidate is sent to the ANN module. In the second stage, ANN performs classification for similar categories to select a correct candidate from the predetermined candidate set designated by the first candidate. The new scheme offers improved system performance by sharing tasks between SPR and ANN according to the degree of classification difficulty and forming specialized ANNs for each similar category. The system achieves higher performance for the recognition of 3,201 handprinted characters than a traditional system constructed with just the SPR module.