{'fraction_non_alphanumeric': 0.013377926421404682, 'fraction_numerical': 0.0, 'mean_word_length': 5.510869565217392, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Parallel Text Clustering Based on MapReduce

This paper analyzes challenges of ordinary text clustering algorithms and proposes cloud computing can be a feasible solution. The classical Jarvis-Patrick (JP) algorithm was adapted as a study case. It was implemented using MapReduce programming mode and was testified on the cloud computing platform-Hadoop with Sogou corpus provided by Sogou laboratory. The experiment results demonstrate that text clustering algorithm can be paralleled in MapReduce framework and parallel algorithm can handle massive textual data and get a better time performance.