{'fraction_non_alphanumeric': 0.019441069258809233, 'fraction_numerical': 0.0, 'mean_word_length': 5.458823529411765, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Online data processing on cloud and Hadoop platform

Person to person communication Sites (SNS) and Media content suppliers are always progressing in the direction of giving mixed media rich encounters to end clients. To expand a SNS in view of a lot of online networking, territory capable mass stockpiling for web-based social networking information produced day by day by clients is required. However, the capacity to cut up, the interactive media objects makes the Internet more appealing to customers, customers and essential systems are not generally ready to stay aware of this developing interest. Sight and sound handling is recognized by cumbersome measures of information, requiring massive measure of preparing, stockpiling, and correspondence assets, accordingly forcing an extensive weight on the registering foundation. The standard way to deal with transcoding sight and sound information requires and expensive equipment in view of the high-limit and top-quality components of mixed media information. Along these lines, regular reason gadgets and techniques are not consumption viable, and they have confinements. To conquer the issue of capacity and execution, we propose another framework which is the combination of three existing framework's which are picture handling, Hadoop and video preparing. Here, we apply a distributed computing condition to our Hadoop-based information Conversion framework. Upgrades in quality and speed are accomplished by embracing Hadoop Distributed File System (HDFS) for putting away a lot of information made by various clients, Map Reduce for dispersed and parallel handling of information.