{'fraction_non_alphanumeric': 0.020486555697823303, 'fraction_numerical': 0.0, 'mean_word_length': 5.571428571428571, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Testing Rules for Mapreduce Fameworks

Nowadays, MapReduce frameworks has emerged as the most popular framework to process efficiently large-scale datasets using several workers with various functionalities. However, the execution of such models on large clusters produces several failures due to bugs or hardware problems. In this context, we present a novel architecture-Based Conformance Testing in order to check if the behavior of a Mapreduce Implementation Under Test (MR-IUT) is conform to its specification. The proposed approach shows how to cope with problems encountered in Mapreduce distributed testing using distributed testing rules. Afterwards, we illustrate our contribution using a case study based on the famous ‘Inverted Index’ application distributed by Hadoop.