{'fraction_non_alphanumeric': 0.023277467411545624, 'fraction_numerical': 0.00186219739292365, 'mean_word_length': 5.142857142857143, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Application of Unbalanced Data Approach to Network Intrusion Detection

In view of the current problems of HNIDS (high-speed network intrusion detection system), such as high packet loss rate, slow pace of testing for attacks and unbalanced data for detection. This paper presents a novel approach for HNIDS by taking two-stage strategy with load balancing model, In the on-line phase, the system captures the packets from network and split into small according the type of protocol, then detected intrusion though each sensor. In the off-line, training dataset are used to build model, which can detected intrusion. We discuss different approaches to unbalanced data, empirically evaluate the SMOTE over-sampling approaches, AdaBoost and random forests algorithm. We also discuss the approaches for selecting features. Finally report our experimental results over the KDD'99 datasets. The results show that SMOTE and the AdaBoost Algorithm by using random forests as weak learner not only can provides better performance to small class, but also has lower build model time.