{'fraction_non_alphanumeric': 0.0137524557956778, 'fraction_numerical': 0.0, 'mean_word_length': 5.36875, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Text Categorization Techniques: A Survey

The amount of data being generated during recent times has been exponentially huge. The data mainly comprises of unstructured data in the form of textual information like emails, tweets, articles etc. To gain information from these textual data, traditional way of analyzing cannot be used. There is a need for efficient techniques for analyzing these data. Text mining is defined as the process of transforming this unstructured data into understandable and meaningful information. Text Mining is a subfield of Artificial Intelligence which aims to automatically process the data and gain insights from the huge voluminous data. In this paper, several techniques used for classifying the data have been discussed. An overview about the dimensionality reduction methodology and how it can enhance the categorization process has been highlighted. It also aims with a future research scope in extending this categorization process along with dimensionality reduction procedures.