{'fraction_non_alphanumeric': 0.013986013986013986, 'fraction_numerical': 0.0, 'mean_word_length': 5.1923076923076925, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Chinese Futures Market Information Extraction and Classification Model Combined with HMM and SVM

The Chinese futures information extraction and classification model can be used to analyze internet futures text, extracting text about the quotes and classifying them for analysis. At present, there is relatively little research on futures market analysis on network public opinion. Less attention is paid to the events that cause market changes. To this end, this paper proposes a Chinese futures market information extraction and classification model combined with HMM and SVM to help investors quickly understand the reasons for market changes. Firstly, feature extraction is performed on the original text through certain rules to highlight the key differences between the market description sentences and the other sentences. Secondly, the HMM model is used to process the feature sequence to obtain the output sequence about whether it is the market description. Then the SVM model is used to classify the sentence features that are judged as “market” in the output sequence. Finally, in the optimization module, the rules are used to optimize each market text to make the sentences more independent and readable. This model has a good performance on the dataset built by ourselves.