{'fraction_non_alphanumeric': 0.014023732470334413, 'fraction_numerical': 0.0, 'mean_word_length': 5.145695364238411, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
A Lexicographer-Friendly Association Score

Finding collocation candidates is one of the most important and
widely used feature of corpus linguistics tools. There are many
statistical association measures used to identify good
collocations. Most of these measures define a formula of a
association score which indicates amount of statistical
association between two words. The score is computed for all
possible word pairs and the word pairs with the highest score
are presented as collocation candidates. The same scores are
used in many other algorithms in corpus linguistics. The score
values are usually meaningless and corpus specific, they cannot
be used to compare words (or word pairs) of different corpora.
But endusers want an interpretation of such scores and want a
score’s stability. This paper present a modification of a well
known association score which has a reasonable interpretation
and other good features.