{'fraction_non_alphanumeric': 0.015965166908563134, 'fraction_numerical': 0.0, 'mean_word_length': 5.509433962264151, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Effective Large-scale Sample Reduction Strategy Based on Support Vector Machine

Training a support vector machine (SVM) on a large-scale sample set is a challenging problem. This paper proposes a sample reduction strategy to pretreat training samples which is realized by a two step procedure: instance reduction and attribute reduction, and the classification model of the SVM is also offered. The experimental results show that the proposed reduction algorithm can effectively remove the nonsupport vector instances and nonessential attributes of the samples, consequently, the whole sample space is simplified and good results are obtained both in training speed and testing precision.