{'fraction_non_alphanumeric': 0.01845018450184502, 'fraction_numerical': 0.01107011070110701, 'mean_word_length': 5.464285714285714, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Statistical Methods for Extracting Collocations from a Text Corpus

The article deals with statistical methods for extracting collocations on the example of the English Web 2020 corpus (enTenTen20). The authors considered three types of association measures: t-score, MI-score and Log Dice, which determine the strength of association between collocates based on the frequencies of their own and joint occurrence in the corpus. The importance of corpus linguistics technology in the study of various language aspects is especially emphasized.