{'fraction_non_alphanumeric': 0.03085177733065057, 'fraction_numerical': 0.00335345405767941, 'mean_word_length': 5.660714285714286, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
A novel framework approach for intrusion detection based on improved critical feature selection in Internet of Things networks

With the convergence of the Internet of Things (IoT), 5G, and artificial intelligence, the number of security violations and disturbances on IoT devices and networks has increased. Traditional intrusion detection systems (IDS) are inadequate to handle and detect attacks. This article proposes an improved critical feature selection (ICFS) algorithm with an ensemble learning (EL) for IDS in IoT‐Message queuing telemetry transport (MQTT) network. The proposed framework includes four major parts: (i) The RPIMQTTSET dataset is created using three raspberry pi devices for generating the regular and attack features. (ii) An ICFS algorithm is proposed to select the optimized features from the original dataset, and the optimized features have been validated with the help of the Tanimoto coefficient. (iii) SMOTETomek is applied for balancing the dataset to improve the detection rate of attacks. (iv) Generation of a K‐fold cross‐validated attack detection model utilizing an EL method such as K‐nearest neighbor, eXtreme Gradient Boosting, and random forest. Experimental results show less computational complexity in selecting features, training, and testing the dataset in the proposed network. The proposed model has training accuracy over 99% and testing accuracy over 92%, and it uses fewer redundant features than previous state‐of‐the‐art methodologies.