{'fraction_non_alphanumeric': 0.023870417732310314, 'fraction_numerical': 0.0008525149190110827, 'mean_word_length': 4.754901960784314, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 2, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
A Data-Driven Real-Time Analytical Framework with Improved Granularity using Machine Learning and Big Data Analysis

During daily studying and working, people have to research massive amounts of information on the internet and download numerous files. Some of these files can be easily categorized to relevant files. However, there are always some files left unorganized due to their difficulty in categorization [1]. Such files pile up in the download folder as time passes, making the folder extremely messy. Many people do not have the motive to clean up the folder as it requires a lot of energy and time. Based on this common problem, my group developed an app that can clean the messy folder up. After applying our program which is based on machine learning, the files will firstly be divided into five general parts – document, video, music, photos and package. Then the files will be further categorized based on the contents they present. For example, photos are divided into animals, families and so on. In order to achieve the content-categorizing function, several powerful apis were introduced in our program, and they helped us to achieve the optimal results.