Improving Classification Performance on Imbalanced Stroke Datasets Using Oversampling Techniques
DOI:
https://doi.org/10.29207/resti.v9i5.6859Keywords:
borderline-SMOTE, imbalance data, SMOTE, stroke prediction, XGBoost methodAbstract
Stroke is the second leading cause of death worldwide and a major factor in long-term disability. Although early detection based on machine learning continues to be developed, it still faces challenges in the form of data imbalance, which can reduce classification performance. This study aimed to evaluate the effectiveness of several oversampling techniques, such as SMOTE, Borderline-SMOTE, and SVM-SMOTE, in improving the performance of stroke classification models on imbalanced data. The methods used included the application of three oversampling techniques, namely SMOTE, Borderline-SMOTE, and SVM-SMOTE, to balance the data distribution. Furthermore, Random Forest and XGBoost algorithms were used as classification models to identify stroke cases. The results of this study show that the use of oversampling techniques significantly improves model performance, especially in MCC and AUC metrics, compared to models without oversampling. Borderline-SMOTE provides the best results, with the highest accuracy of 96.45% on Random Forest and 96.41% on XGBoost, as well as MCC and AUC values that are consistently superior to other techniques. Furthermore, this study highlights that the use of Borderline-SMOTE significantly enhances model performance, as evidenced by an increase in MCC of 87.51% and an AUC of 45.40% in Random Forest, along with an increase in MCC of 76.52% and an AUC of 41.81% in XGBoost. These findings confirm that Borderline-SMOTE is an effective approach for dealing with data imbalance and improving the model's ability to detect minority classes in stroke classification.
Downloads
References
G. Sailasya and G. L. A. Kumari, “Analyzing the Performance of Stroke Prediction using ML Classification Algorithms,” Int. J. Adv. Comput. Sci. Appl., vol. 12, no. 6, pp. 539–545, 2021, doi: 10.14569/IJACSA.2021.0120662.
Z. G. Al-Mekhlafi et al., “Deep Learning and Machine Learning for Early Detection of Stroke and Haemorrhage,” Comput. Mater. Contin., vol. 72, no. 1, pp. 775–796, 2022, doi: 10.32604/cmc.2022.024492.
Y. Chahine, M. J. Magoon, B. Maidu, J. C. del Álamo, P. M. Boyle, and N. Akoum, “Machine Learning and the Conundrum of Stroke Risk Prediction,” Arrhythmia Electrophysiol. Rev., vol. 12, 2023, doi: 10.15420/aer.2022.34.
M. O. Ullah, S. A. Raju, M. I. Nazir, A. Akter, and M. S. Rahman, “An Innovative Machine Learning Pipeline for Stroke Prediction on Imbalanced Data,” 2023 Int. Conf. Inf. Commun. Technol. Sustain. Dev. ICICT4SD 2023 - Proc., pp. 153–157, 2023, doi: 10.1109/ICICT4SD59951.2023.10303319.
T. Zuo, F. Li, X. Zhang, F. Hu, L. Huang, and W. Jia, “Stroke classification based on deep reinforcement learning over stroke screening imbalanced data,” Comput. Electr. Eng., vol. 114, p. 109069, 2024, doi: https://doi.org/10.1016/j.compeleceng.2023.109069.
A. Viloria, O. B. Pineda Lezama, and N. Mercado-Caruzo, “Unbalanced data processing using oversampling: Machine Learning,” Procedia Comput. Sci., vol. 175, pp. 108–113, 2020, doi: https://doi.org/10.1016/j.procs.2020.07.018.
J. Li, Q. Zhu, Q. Wu, and Z. Fan, “A novel oversampling technique for class-imbalanced learning based on SMOTE and natural neighbors,” Inf. Sci. (Ny)., vol. 565, pp. 438–455, 2021, doi: 10.1016/j.ins.2021.03.041.
S. Rahayu and Y. Yamasari, “Klasifikasi Penyakit Stroke dengan Metode Support Vector Machine (SVM),” J. Informatics Comput. Sci., vol. 5, no. 03, pp. 440–446, 2024, doi: 10.26740/jinacs.v5n03.p440-446.
M. Fadli and R. A. Saputra, “Klasifikasi Dan Evaluasi Performa Model Random Forest Untuk Prediksi Stroke,” JT J. Tek., vol. 12, no. 02, pp. 72–80, 2023.
A. F. Riany and G. Testiana, “Penerapan Data Mining untuk Klasifikasi Penyakit Stroke Menggunakan Algoritma Naïve Bayes,” J. SAINTEKOM, vol. 13, no. 1, pp. 42–54, 2023, doi: 10.33020/saintekom.v13i1.352.
L. R. Safitri, N. Chamidah, and T. Saifudin, “Modeling of Stroke Risk Using Synthetic Minority Oversampling Technique in Multivariate Adaptive Regression Spline Model,” Commun. Math. Biol. Neurosci., vol. 2025, pp. 1–10, 2025, doi: 10.28919/cmbn/9099.
L. A. Martini, G. A. Pradipta, and R. R. Huizen, “Analysis of the Impact of Data Oversampling on the Support Vector Machine Method for Stroke Disease Classification,” J. Electron. Electromed. Eng. Med. Informatics, vol. 7, no. 2, pp. 404–421, 2025, doi: 10.35882/jeeemi.v7i2.698.
Y. B. Wah et al., “Machine Learning and Synthetic Minority Oversampling Techniques for Imbalanced Data: Improving Machine Failure Prediction,” Comput. Mater. Contin., vol. 75, no. 3, pp. 4821–4841, 2023, doi: 10.32604/cmc.2023.034470.
H. Hairani, T. Widiyaningtyas, D. D. Prasetya, and A. Aminuddin, “Addressing Imbalance in Health Datasets : A New Method NR-Clustering SMOTE and Distance Metric Modification,” Comput. Mater. Contin., vol. 82, no. 2, pp. 2931–2949, 2025, doi: 10.32604/cmc.2024.060837.
M. Mujahid et al., “Data oversampling and imbalanced datasets: an investigation of performance for machine learning and feature engineering,” J. Big Data, vol. 11, no. 1, 2024, doi: 10.1186/s40537-024-00943-4.
R. Qaddoura, A. M. Al-Zoubi, I. Almomani, and H. Faris, “A multi-stage classification approach for iot intrusion detection based on clustering with oversampling,” Appl. Sci., vol. 11, no. 7, 2021, doi: 10.3390/app11073022.
D. Chicco and G. Jurman, “The advantages of the Matthews correlation coefficient ( MCC ) over F1 score and accuracy in binary classification evaluation,” BMC Genomics, vol. 21, no. 6, pp. 1–13, 2020.
N. A. Azhar, M. S. Mohd Pozi, A. Mohamed Din, and A. Jatowt, “An Investigation of SMOTE based Methods for Imbalanced Datasets with Data Complexity Analysis,” IEEE Trans. Knowl. Data Eng., pp. 1–1, 2022, doi: 10.1109/TKDE.2022.3179381.
S. Rezvani and X. Wang, “A broad review on class imbalance learning techniques,” Appl. Soft Comput., vol. 143, p. 110415, 2023, doi: 10.1016/j.asoc.2023.110415.
H. Hairani, T. Widiyaningtyas, and D. Dwi Prasetya, “Addressing Class Imbalance of Health Data: A Systematic Literature Review on Modified Synthetic Minority Oversampling Technique (SMOTE) Strategies,” JOIV Int. J. Informatics Vis., vol. 8, no. 3, pp. 1310–1318, 2024, doi: https://dx.doi.org/10.62527/joiv.8.3.2283.
L. G. R. Putra, K. Marzuki, and H. Hairani, “Correlation-based feature selection and Smote-Tomek Link to improve the performance of machine learning methods on cancer disease prediction,” Eng. Appl. Sci. Res., vol. 50, no. 6, pp. 577–583, 2023, doi: 10.14456/easr.2023.59.
S. Feng, J. Keung, X. Yu, Y. Xiao, and M. Zhang, “Investigation on the stability of SMOTE-based oversampling techniques in software defect prediction,” Inf. Softw. Technol., vol. 139, no. June, p. 106662, 2021, doi: 10.1016/j.infsof.2021.106662.
M. Khushi et al., “A Comparative Performance Analysis of Data Resampling Methods on Imbalance Medical Data,” IEEE Access, vol. 9, pp. 109960–109975, 2021, doi: 10.1109/ACCESS.2021.3102399.
P. Wibowo and C. Fatichah, “An in-depth performance analysis of the oversampling techniques for high-class imbalanced dataset,” Regist. J. Ilm. Teknol. Sist. Inf., vol. 7, no. 1, pp. 63–71, 2021, doi: 10.26594/register.v7i1.2206.
H. Sun, J. Li, and X. Zhu, “ A Novel Expandable Borderline Smote Over-Sampling Method for Class Imbalance Problem ,” IEEE Trans. Knowl. & Data Eng., vol. 37, no. 05, pp. 2183–2199, May 2025, doi: 10.1109/TKDE.2025.3544284.
M. Imani, A. Beikmohammadi, and H. R. Arabnia, “Comprehensive Analysis of Random Forest and XGBoost Performance with SMOTE , ADASYN , and GNUS Under Varying Imbalance Levels,” Technologies, vol. 13, no. 3, pp. 1–40, 2025.
Z. Shao and M. N. Ahmad, “Comparison of Random Forest and XGBoost Classifiers Using Integrated Optical and SAR Features for Mapping Urban Impervious Surface,” Remote Sens., vol. 16, no. 4, pp. 1–18, 2024.
Downloads
Published
Issue
Section
License
Copyright in each article belongs to the author
- The author acknowledges that the RESTI Journal (System Engineering and Information Technology) is the first publisher to publish with a license Creative Commons Attribution 4.0 International License.
- Authors can enter writing separately, arrange the non-exclusive distribution of manuscripts that have been published in this journal into other versions (eg sent to the author's institutional repository, publication in a book, etc.), by acknowledging that the manuscript has been published for the first time in the RESTI (Rekayasa Sistem dan Teknologi Informasi) journal ;





