{'fraction_non_alphanumeric': 0.0512, 'fraction_numerical': 0.0192, 'mean_word_length': 5.659574468085107, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Thinking beyond the nouns - computing semantic relatedness across parts of speech

Semantic relatedness is any kind of lexical-functional association between two words. For example, given the words “surfen”, “Internet” and “Apfel”, human judges are likely to classify “surfen Internet” as being more closely related than “Internet Apfel” or “surfen Apfel”. Information about semantic relatedness of words is often required in various natural language processing (NLP) applications ranging from spelling correction (Budanitsky & Hirst, 2005) and sense tagging (McCarthy et al., 2004) to information retrieval (Gurevych 2005a).