{'fraction_non_alphanumeric': 0.016697588126159554, 'fraction_numerical': 0.0, 'mean_word_length': 4.9944444444444445, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Actor-based architecture for Cloud Services Orchestration: the case of social media data extraction

In this paper we present a distributed system for social media scraping which aims to acquire an arbitrarily large number of information from social networks, by exploiting an actor-based solution able to orchestrate efficiently several services on cloud. Our goal is to ensure that correct operations among actors occur, thanks to a master node, based on the ActoDeS architecture, which takes care of managing communications, interface and messages exchanged by client nodes. As a use case, we consider Twitter as social media platform for the key role that is playing in the modern society, as shown by Google Trends data. However, Twitter’s search API have many limitations and there is definitely no way to make it work when it comes to obtaining millions of records within a monthly or annual time range. Thus, we have designed a distributed solution that is able to overcome these constraints without breaking the current laws on this subject and the policies of Twitter.