{'fraction_non_alphanumeric': 0.019230769230769232, 'fraction_numerical': 0.001201923076923077, 'mean_word_length': 5.3106060606060606, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
A diversity-based method for class-imbalanced cost-sensitive learning

It is often the case that datasets are imbalanced in the real world. In this situation, it is minimizing misclassification costs rather than classification accuracy that is the primary goal of classification algorithms. To tackle this problem and improve the performance of classifiers, sampling is widely employed. In this paper, we propose a new diversity-based under-sampling technique for class-imbalanced datasets. The key idea is to balance a data set by choosing only the potential informative samples of the majority class according to diversity of class probability calculation. The experimental results on 5 class-imbalanced datasets show that our method performs better than two existing sampling techniques in terms of total misclassification costs.