STM Journals Peer-reviewed research from Consortium e-Learning Network

International Journal of Wireless Security and Networks Original Research Open Access

Assessing the Robustness of Machine Learning Models for Wireless Intrusion Detection Under Adversarial Traffic Perturbations

  1. Siddhant Sukhatankar Demand Science Optimization Organization, Amazon, Arlington

Abstract

As the Internet of Things (IoT) devices and wireless communication networks continue to grow rapidly, protecting systems from cyber threats has become increasingly important. Machine learning–based intrusion detection systems (IDS) have shown strong potential in detecting abnormal and malicious network activities, yet their effectiveness and resilience when facing adversarial attacks are still not sufficiently explored. This research evaluates Machine Learning (ML) models–XGBoost, random forest, and multi-layer perceptron (MLP)—in detecting attacks within wireless IoT networks when subjected to certain specific traffic feature perturbations. Using the CICIoT2023 and IoT intrusion datasets, we conducted binary classification experiments distinguishing benign and attack traffic. Perturbations simulating realistic adversarial manipulations were applied to numeric features at multiple levels (5%, 10%, and 25%). The results demonstrate that tree-based models, XGBoost, and random forest maintain high recall under perturbation, with less than 0.2% reduction at even the highest perturbation levels, whereas MLP performance is unstable on imbalanced data. Feature importance analysis reveals that timing and protocol-related features contribute significantly to model predictions. These findings highlight the robustness of ensemble tree methods in practical IoT intrusion detection scenarios and emphasize the need for perturbation-aware evaluations for ML-based IDS. The study contributes to safer deployment of wireless IDS and provides a methodological framework for assessing model resilience against adversarial feature modifications.

Keywords

References (14)

  1. Al-Garadi MA, Mohamed A, Al-Ali AK, Du X, Ali I, Guizani M. A Survey of Machine and Deep Learning Methods for Internet of Things (IoT) Security. IEEE Communications Surveys & Tutorials. 2020;22(3):1646-1685. doi:10.1109/comst.2020.2988293
  2. Kumari P, Jain AK. A comprehensive study of DDoS attacks over IoT network and their countermeasures. Computers & Security. 2023;127:103096. doi:10.1016/j.cose.2023.103096
  3. Bankó MB, Dyszewski S, Králová M, Limpek MB, Papaioannou M, Choudhary G, et al. Advancements in Machine Learning-Based Intrusion Detection in IoT: Research Trends and Challenges. Algorithms. 2025;18(4):209. doi:10.3390/a18040209
  4. Liu N, Li C, Wang G, Wu Z, Li D. A Dense Mapping Algorithm Based on Spatiotemporal Consistency. Sensors. 2023;23(4):1876. doi:10.3390/s23041876
  5. Sharon Y, Berend D, Liu Y, Shabtai A, Elovici Y. TANTRA: Timing-Based Adversarial Network Traffic Reshaping Attack. IEEE Transactions on Information Forensics and Security. 2022;17:3225-3237. doi:10.1109/tifs.2022.3201377
  6. Ibrahim Adamu A, Kumar Donta P, Mohd Ali D, Sarang S, Stojanović GM, Seroja Sarnin S. A Systematic Literature Review of Advanced Machine Learning Techniques in Wireless Body Area Networks: Application, Challenges, and Future Directions. IEEE Access. 2025;13:194729-194778. doi:10.1109/access.2025.3631230
  7. Goodfellow IJ, Shlens J, Szegedy C. Explaining and harnessing adversarial examples [preprint]. 2015. arXiv:1412.6572. doi:10.48550/arXiv.1412.6572.
  8. Neto ECP, Dadkhah S, Ferreira R, Zohourian A, Lu R, Ghorbani AA. CICIoT2023: A Real-Time Dataset and Benchmark for Large-Scale Attacks in IoT Environment. Sensors. 2023;23(13):5941. doi:10.3390/s23135941
  9. Cyber Cop. (2023). IoT Intrusion Detection. [online] Kaggle.com. Available from: https://www.kaggle.com/datasets/subhajournal/iotintrusion
  10. Alotaibi A, Rassam MA. Adversarial Machine Learning Attacks against Intrusion Detection Systems: A Survey on Strategies and Defense. Future Internet. 2023;15(2):62. doi:10.3390/fi15020062
  11. Harbi Y, Medani K, Gherbi C, Aliouat Z, Harous S. Roadmap of Adversarial Machine Learning in Internet of Things-Enabled Security Systems. Sensors. 2024;24(16):5150. doi:10.3390/s24165150
  12. Jamiri H, Zyane A. Adversarial Attacks in IoT: A Performance Assessment of ML and DL Models. ICATH 2025. 2025:15. doi:10.3390/engproc2025112015
  13. Vitorino J, Praça I, Maia E. Towards adversarial realism and robust learning for IoT intrusion detection and classification. Annals of Telecommunications. 2023;78(7-8):401-412. doi:10.1007/s12243-023-00953-y
  14. Almousa O, Hamdallh B, Al-nu’man R. Enhancing IoT Security: A Comparative Analysis of Machine Learning and Deep Learning Techniques for Botnet Detection. Engineering, Technology & Applied Science Research. 2025;15(4):24498-24505. doi:10.48084/etasr.11092