{'fraction_non_alphanumeric': 0.025477707006369428, 'fraction_numerical': 0.0, 'mean_word_length': 5.093023255813954, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Large-Scale Social Network Analysis Based on MapReduce

Social Networks Service (SNS), is becoming more and more popular and a lot of studies have been carried out in this active field. However, traditional analysis methods based on single machines is not suitable because the network is growing too large. MapReduce, a programming paradigm proposed by Google, gives us a new approach to solve large-scale social networks analysis problem by making use of the power of multi-machines. In this paper, we use Hadoop—an open source implementation of MapReduce—to conduct a series of analyses on large-scale social networks including several distributions, clustering coefficient and diameter. We believe that our work will shed light on the study of measuring large-scale social networks.