{'fraction_non_alphanumeric': 0.013944223107569721, 'fraction_numerical': 0.0, 'mean_word_length': 4.988095238095238, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Performance and complexity

Shannon showed that it was possible to achieve arbitrarily low error rates at any data rate less than channel capacity. By the early Sixties, it had been realized that the real problem was how to achieve reasonable error rates with acceptable decoding complexity at data rates anywhere near capacity. The author's research has been primarily motivated by this problem. The author offers an account of some of his adventures in this pursuit, and some preliminary conclusions.