{'fraction_non_alphanumeric': 0.013230429988974642, 'fraction_numerical': 0.0, 'mean_word_length': 5.34965034965035, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Lexical coverage and profiling

Introduction Technological innovations in computer software and advancements in corpus linguistics have made it easier to analyse the vocabulary in a text. Corpus-driven analysis of multi-million-word corpora has enabled researchers to create word frequency lists and these have been used together with software to profile the distribution of words at different frequency levels within texts. This analysis of vocabulary provides an indication of the difficulty level of a text, the potential for vocabulary learning through reading or listening to the text, as well as the vocabulary knowledge required to understand different types of spoken and written discourse. This area of research, known as LEXICAL COVERAGE or LEXICAL PROFILING, tends to fall into a number of different categories. The following themes highlight some of the major areas of lexical coverage research.