Deteksi Serangan Dalam Ekosistem Iot Melalui Analisis Multi-Class Dengan Model Xgboost Dan Penerapan Teknik Imbalance Ratio Pada Dataset IoTID20
DOI:
https://doi.org/10.37859/coscitech.v6i3.9861
Abstract
This research focuses on attack detection in the Internet of Things (IoT) ecosystem using the XGBoost algorithm and the Imbalance Ratio technique on the IoTID20 dataset. The main goal is to overcome the problem of data imbalance that is common in IDS datasets and improve accuracy in classifying attack types. The methodology used includes data preprocessing, feature selection, and applying the Imbalance Ratio technique to handle class imbalance in the IoTID20 dataset. Next, the XGBoost model is implemented with the scale_pos_weight parameter to handle the class imbalance problem. This model is trained on training data and evaluated using metrics such as accuracy, precision, recall, and F1-score. The research results show that the combination of the XGBoost algorithm and the Imbalance Ratio technique is able to overcome data imbalance problems effectively. The resulting model achieved an accuracy rate of 99.32%, precision 99.32%, recall 99.32%, and F1-score 99.32% in classifying attack types on the IoTID20 dataset. These results demonstrate excellent capabilities in detecting attacks and distinguishing between normal and anomalous traffic in the IoT ecosystem. This research contributes to improving IoT network security by applying an effective Machine Learning approach to accurately detect attacks, while also addressing data imbalance problems that often occur in IDS datasets.
Downloads
References
T.-T.-H. Le, H. Kim, H. Kang, and H. Kim, “Classification and Explanation for Intrusion Detection System Based on Ensemble Trees and SHAP Method,” Sensors, vol. 22, no. 3, 2022, doi: 10.3390/s22031154.
U. Islam et al., “Detection of Distributed Denial of Service (DDoS) Attacks in IOT Based Monitoring System of Banking Sector Using Machine Learning Models,” Sustain., vol. 14, no. 14, 2022, doi: 10.3390/su14148374.
N. Dat-Thinh, H. Xuan-Ninh, and L. Kim-Hung, “MidSiot: A Multistage Intrusion Detection System for Internet of Things,” Wirel. Commun. Mob. Comput., vol. 2022, no. December 2017, 2022, doi: 10.1155/2022/9173291.
N. Abughazaleh, R. Bin, M. Btish, and H. M., “DoS Attacks in IoT Systems and Proposed Solutions,” Int. J. Comput. Appl., vol. 176, no. 33, pp. 16–19, 2020, doi: 10.5120/ijca2020920397.
M. Aljanabi, M. A. Ismail, and A. H. Ali, “Intrusion Detection Systems, Issues, Challenges, and Needs,” Int. J. Comput. Intell. Syst., vol. 14, no. 1, pp. 560–571, Jan. 2021, doi: 10.2991/IJCIS.D.210105.001.
P. Rieger, T. D. Nguyen, M. Miettinen, and A.-R. Sadeghi, “DeepSight: Mitigating Backdoor Attacks in Federated Learning Through Deep Model Inspection,” Jan. 2022, doi: 10.14722/ndss.2022.23156.
R. Yao, N. Wang, Z. Liu, P. Chen, and X. Sheng, “Intrusion detection system in the advanced metering infrastructure: A cross-layer feature-fusion CNN-LSTM-based approach,” Sensors (Switzerland), vol. 21, no. 2, pp. 1–17, 2021, doi: 10.3390/s21020626.
A. Imran, “Performance Evaluation of Classification Algorithms for Intrusion Detection on NSL- KDD Using Rapid Miner,” no. February, 2022.
A. Alsaleh and W. Binsaeedan, “The influence of salp swarm algorithm-based feature selection on network anomaly intrusion detection,” IEEE Access, vol. 9, pp. 112466–112477, 2021, doi: 10.1109/ACCESS.2021.3102095.
S. Pokhrel, R. Abbas, and B. Aryal, “IoT Security: Botnet detection in IoT using Machine learning,” Apr. 2021, [Online]. Available: http://arxiv.org/abs/2104.02231
T. T. H. Le, Y. E. Oktian, and H. Kim, “XGBoost for Imbalanced Multiclass Classification-Based Industrial Internet of Things Intrusion Detection Systems,” Sustain. 2022, Vol. 14, Page 8707, vol. 14, no. 14, p. 8707, Jul. 2022, doi: 10.3390/SU14148707.
J. Al Amien, H. A. Ghani, N. I. M. Saleh, E. Ismanto, and R. Gunawan, “Intrusion detection system for imbalance ratio class using weighted XGBoost classifier,” Telkomnika (Telecommunication Comput. Electron. Control., vol. 21, no. 5, pp. 1102–1112, 2023, doi: 10.12928/TELKOMNIKA.v21i5.24735.
I. Ullah and Q. H. Mahmoud, “A Scheme for Generating a Dataset for Anomalous Activity Detection in IoT Networks,” Lect. Notes Comput. Sci. (including Subser. Lect. Notes Artif. Intell. Lect. Notes Bioinformatics), vol. 12109 LNAI, pp. 508–520, 2020, doi: 10.1007/978-3-030-47358-7_52.
B. Li et al., “A Systematic Review of Data-Driven Attack Detection Trends in IoT,” Sensors 2023, Vol. 23, Page 7191, vol. 23, no. 16, p. 7191, Aug. 2023, doi: 10.3390/S23167191.
A. A. Alfrhan, “SMOTE : Class Imbalance Problem In Intrusion Detection System,” pp. 111–115, 2020.
M. Son, S. Jung, J. Moon, and E. Hwang, “BCGAN-based over-sampling scheme for imbalanced data,” Proc. - 2020 IEEE Int. Conf. Big Data Smart Comput. BigComp 2020, pp. 155–160, 2020, doi: 10.1109/BigComp48618.2020.00-83.
J. Li et al., “SMOTE-NaN-DE: Addressing the noisy and borderline examples problem in imbalanced classification by natural neighbors and differential evolution,” Knowledge-Based Syst., vol. 223, Jul. 2021, doi: 10.1016/j.knosys.2021.107056.
Y. Fu, Y. Du, Z. Cao, Q. Li, and W. Xiang, “binary A Deep Learning Model for Network Intrusion Detection with Imbalanced Data,” pp. 1–13, 2022.
H. A. Ahmed, A. Hameed, and N. Z. Bawany, “Network intrusion detection using oversampling technique and machine learning algorithms,” PeerJ Comput. Sci., vol. 8, 2022, doi: 10.7717/PEERJ-CS.820.
M. Koziarski, “Radial-Based Undersampling for imbalanced data classification,” Pattern Recognit., vol. 102, p. 107262, Jun. 2020, doi: 10.1016/J.PATCOG.2020.107262.
N. Abdalgawad, A. Sajun, Y. Kaddoura, I. A. Zualkernan, and F. Aloul, “Generative Deep Learning to Detect Cyberattacks for the IoT-23 Dataset,” IEEE Access, vol. 10, pp. 6430–6441, 2022, doi: 10.1109/ACCESS.2021.3140015.
R. Zhu, Y. Guo, and J. H. Xue, “Adjusting the imbalance ratio by the dimensionality of imbalanced data,” Pattern Recognit. Lett., vol. 133, pp. 217–223, May 2020, doi: 10.1016/j.patrec.2020.03.004.
K. Budholiya, S. K. Shrivastava, and V. Sharma, “An optimized XGBoost based diagnostic system for effective prediction of heart disease,” J. King Saud Univ. - Comput. Inf. Sci., vol. 34, no. 7, pp. 4514–4523, Jul. 2022, doi: 10.1016/J.JKSUCI.2020.10.013.
A. O. Alzahrani and M. J. F. Alenazi, “Designing a Network Intrusion Detection System Based on Machine Learning for Software Defined Networks,” Futur. Internet 2021, Vol. 13, Page 111, vol. 13, no. 5, p. 111, Apr. 2021, doi: 10.3390/FI13050111.
S. Ullah et al., “A New Intrusion Detection System for the Internet of Things via Deep Convolutional Neural Network and Feature Engineering,” Sensors 2022, Vol. 22, Page 3607, vol. 22, no. 10, p. 3607, May 2022, doi: 10.3390/S22103607.
Y. Song, S. Hyun, and Y.-G. Cheong, “Analysis of autoencoders for network intrusion detection†,” Sensors, vol. 21, no. 13, 2021, doi: 10.3390/s21134294.
R. Qaddoura, A. M. Al-Zoubi, I. Almomani, and H. Faris, “A multi-stage classification approach for iot intrusion detection based on clustering with oversampling,” Appl. Sci., vol. 11, no. 7, 2021, doi: 10.3390/app11073022.
A. A. Alsulami, Q. Abu Al-Haija, A. Tayeb, and A. Alqahtani, “An Intrusion Detection and Classification System for IoT Traffic with Improved Data Engineering,” Appl. Sci. 2022, Vol. 12, Page 12336, vol. 12, no. 23, p. 12336, Dec. 2022, doi: 10.3390/APP122312336.
P. Maniriho, E. Niyigaba, Z. Bizimana, V. Twiringiyimana, L. J. Mahoro, and T. Ahmad, “Anomaly-based Intrusion Detection Approach for IoT Networks Using Machine Learning,” CENIM 2020 - Proceeding Int. Conf. Comput. Eng. Network, Intell. Multimed. 2020, no. Cenim, pp. 303–308, 2020, doi: 10.1109/CENIM51130.2020.9297958.
K. Albulayhi, Q. A. Al-Haija, S. A. Alsuhibany, A. A. Jillepalli, M. Ashrafuzzaman, and F. T. Sheldon, “IoT Intrusion Detection Using Machine Learning with a Novel High Performing Feature Selection Method,” Appl. Sci., vol. 12, no. 10, 2022, doi: 10.3390/app12105015.
