{'fraction_non_alphanumeric': 0.017462165308498253, 'fraction_numerical': 0.0, 'mean_word_length': 5.417910447761194, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Research on the design of a data processing-based buzzword mining system for the times

In today's constantly iterating online world, a large amount of information appears in spurts, causing certain difficulties for social governance. In this paper, we establish a big data monitoring system, use web crawler technology to obtain data and then use python language to analyze data to obtain reference models and various correlation variables and indicator data to help the government monitor online public opinion. Specifically, this paper combines cloud word graphs and data visualization techniques to analyze comments on hot topics on Weibo, extracting keywords from the text more intuitively and accurately, and then analyzing the sentiment direction of keywords, which can quickly predict the public's opinions, views and social values on a certain topic.