{'fraction_non_alphanumeric': 0.01730103806228374, 'fraction_numerical': 0.0, 'mean_word_length': 4.908163265306122, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Research on Improved FP-Tree Algorithm Based on Hadoop

With the development of science and technology, the Internet is more and more widely used in all aspects of society, and the research on the combination of data mining and big data platform has gradually become an urgent demand. This paper studies the association rules algorithm based on FP- Tree algorithm, and proposes the improvement of the algorithm. After combining with Hadoop platform, the algorithm is implemented and tested in big data environment, and the efficiency of the algorithm is improved to some extent.