{'fraction_non_alphanumeric': 0.0313588850174216, 'fraction_numerical': 0.0011614401858304297, 'mean_word_length': 5.291970802919708, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
An approach to meta feature selection

Many methods, such as mutual information (MI), document frequency (DF), information gain (IG) and χ2 statistics (CHI) algorithm, have been discussed and applied to the study of meta feature selection. This paper gives a brief review of the recent approaches on this topic. By summarizing and synthesizing these approaches, we propose a framework of the application of meta feature selections, where the classical algorithm on attribute reduction is used for data preprocessing and the support vector machine (SVM) algorithm is used for the text classification. The proposed framework has advantages in both effectiveness and accuracy, i.e., our approach decreases the dimension of the text feature space and, at the same time, improves the accuracy of text classification. The experimental results confirm this conclusion.