{'fraction_non_alphanumeric': 0.010309278350515464, 'fraction_numerical': 0.0, 'mean_word_length': 5.985611510791367, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Decomposition Methods and Learning Approaches for Imbalanced Dataset: An Experimental Integration

Decomposition methods are multiclass classification schemes where the polychotomy is reduced into several dichotomies. Each dichotomy is addressed by a classifier trained on a training set derived from the original one on the basis of the decomposition rule adopted. These new training sets may present a disproportion between the classes, harming the global recognition accuracy. Indeed, traditional learning algorithms are biased towards the majority class, resulting in poor predictive accuracy over the minority one. This paper investigates if the application of learning methods specifically tailored for imbalanced training set introduces any performance improvement when used by dichotomizers of decomposition methods. The results on five public datasets show that the application of these learning methods improves the global performance of decomposition schemes.