{'fraction_non_alphanumeric': 0.020313406848520024, 'fraction_numerical': 0.0, 'mean_word_length': 5.1571428571428575, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Self-Regulated Trade-Off among Timeliness, Messages and Accuracy for Approximate Queries in Large-Scale Information Aggregation

In data management for large-scale applications, challenges arise in regard to the decentralization of the application and to an increasing number of failures. A consequence of these conditions is an increasing retrieval time, inaccurate results and higher network consumption. A solution to restrain an increasing retrieval time and an increasing number of messages is the introduction of approximate queries. The introduction of approximate queries limits the querying of all nodes of a network to a subset of nodes at the cost of the results' accuracy. Thus, a conflict for providing a large-scalability lies in guaranteeing accurate data, in the provision of fast results and in a low network consumption. Therefore, we propose an information aggregation that is based on an analytic hierarchical process (AHP) to find a trade-off in the information retrieval among the factors of time, messages and accuracy. After a user defines the preferences for the retrieval process, the AHP-based algorithm makes autonomous decisions on each node. The algorithm decides autonomously about pruning the approximate queries to reach an optimal trade-off from a global perspective. Applying the self-regulated pruning of the approximate queries allows reducing the messages from an exponential increase to a constant factor. At the same time, the retrieval time is reduced from a linear increase to a constant factor in regard to an increasing number of nodes. At the same time of reducing the retrieval time and network consumption, the AHP-based self-regulation guarantees a certain level of accuracy.