{'fraction_non_alphanumeric': 0.015296367112810707, 'fraction_numerical': 0.0, 'mean_word_length': 5.717948717948718, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Computer Processing of Texts for Lexical Analysis

The use of computers for processing texts for lexicographic descriptions is not new. However, until recently, computers and software programs with specifications necessary to process texts large enough to be useful were accessible only to large projects which could afford mainframe computers. With the rapid development of computer technology, however, desktop and even laptop computers are now becoming available with the capacity for processing multimillion-word texts.