{'fraction_non_alphanumeric': 0.023781902552204175, 'fraction_numerical': 0.0, 'mean_word_length': 4.711920529801325, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Problems in New-Word Lexicography

.Had lexicographers but world enough and time, they would no doubt include in their dictionaries every lexical item ever used by any speaker or writer of English, with all recoverable information about each item. To be sure, such a dictionary would be more than most users want. The users of a particular dictionary obviously have needs that circumscribe the appropriate contents of that book. But within such user-oriented limitations, the impossible dream of the lexicographer is exhaustive comprehensiveness—a complete listing of all lexical items with complete information about each. This dream of a full accounting for lexis is a mystical vision of the linguistic plenum. As Dr. Johnson observed in his melancholy way, such visions are "the dreams of a poet doomed at last to wake a lexicographer." The jangling alarm that wakes the lexicographer is the sound of "Time's winged chariot hurrying near," driven by some soulless accountant who cares for the bottom line and not at all for the main entry. The lexicographer's bitter task is selection—deciding what to include and what to leave out. And his lot is therefore not a happy one. The problem of selection is particularly keen in new-word lexicography, where it has two aspects: the definition of what a new word is and the decisions of which new words to include and of what to say about them. The problem of definition—deciding what is new and what is not—is especially troublesome in new-word glossaries. The problem of inclusion, on the other hand, is general: the editor of every new or revised dictionary is faced with the need to make decisions about which new words, however defined, will be included and which omitted.