Analysis of the Impact of Backpropagation Hyperparameter Optimization on Heart Disease Prediction Models

Authors

  • Nita Syahputri Universitas Potensi Utama
  • Putrama Alkhairi STIKOM Tunas Bangsa
  • Enok Tuti Alawiah Universitas Bina Sarana Informatika

DOI:

https://doi.org/10.29207/resti.v9i4.6473

Keywords:

backpropagation neural network (BPNN), early diagnosis, heart disease prediction, hyperparameter optimization, machine learning

Abstract

Heart disease is a major global health issue, highlighting the need for early and accurate prediction to reduce complications and improve patient outcomes. The Backpropagation Neural Network (BPNN) is a widely used method for heart disease prediction, but its performance relies heavily on proper hyperparameter selection, including neuron count, activation function, optimizer, and batch size. This study analyzed the impact of hyperparameter optimization on BPNN performance. A standard BPNN model was compared with an optimized version, where key hyperparameters were fine-tuned to enhance predictive accuracy and stability. Both models were trained and tested on the same dataset, and their performance was evaluated using Accuracy, Precision, Recall, Mean Squared Error (MSE), and Mean Absolute Error (MAE). The results show that the optimized model achieves a slightly better accuracy (99.11% vs. 99.09%) and lower error rates (MSE and MAE of 0.0089 vs. 0.0091). It also demonstrates higher precision, reflecting an improved capability in correctly identifying heart disease cases. Although the performance gap was small, the optimized model showed a more balanced and consistent outcome. These findings highlight the importance of hyperparameter tuning for improving neural network models for medical prediction. This study contributes to the development of more accurate and reliable AI tools for the early diagnosis of heart disease. Future studies may apply advanced optimization techniques, such as Bayesian Optimization or Genetic Algorithms, and use larger and more diverse datasets to enhance model generalization.

Downloads

Download data is not yet available.

References

A. Jasinska-Piadlo et al., “Data-driven versus a domain-led approach to k-means clustering on an open heart failure dataset,” International Journal of Data Science and Analytics, vol. 15, no. 1, pp. 49–66, 2023, doi: 10.1007/s41060-022-00346-9.

P. R. Kumar, “Identification of noteworthy features and data mining techniques for heart disease prediction,” International Journal of Modeling, Simulation, and Scientific Computing, 2024, doi: 10.1142/S1793962325500102.

T. R. Ramesh, “PREDICTIVE ANALYSIS OF HEART DISEASES WITH MACHINE LEARNING APPROACHES,” Malaysian Journal of Computer Science, vol. 2022, pp. 132–148, 2022, doi: 10.22452/mjcs.sp2022no1.10.

Saiyedfaiayazwaris and S. Koteeswaran, “Early Prediction of Heart Conditions by K-Means Consensus Clustering and Convolution Neural Network,” vol. 25, no. 3, pp. 6623–6640, 2021.

N. A. M. Zaini and M. K. Awang, “Performance Comparison between Meta-classifier Algorithms for Heart Disease Classification,” International Journal of Advanced Computer Science and Applications, vol. 13, no. 10, pp. 323–328, 2022, doi: 10.14569/IJACSA.2022.0131039.

M. Agarwal, “Methodical Implementation of Data Mining Classifiers and ANN for Prediction of Accomplishment of Student Education,” International Journal of Performability Engineering, vol. 19, no. 9, pp. 587–597, 2023, doi: 10.23940/ijpe.23.09.p4.587597.

A. P. Windarto, T. Herawan, and P. Alkhairi, “Early Detection of Breast Cancer Based on Patient Symptom Data Using Naive Bayes Algorithm on Genomic Data,” in Artificial Intelligence, Data Science and Applications, Y. Farhaoui, A. Hussain, T. Saba, H. Taherdoost, and A. Verma, Eds., Cham: Springer Nature Switzerland, 2024, pp. 478–484.

P. V Naresh, “PSO Optimized CNN-SVM Architecture for Covid - 19 Classification,” International Journal on Recent and Innovation Trends in Computing and Communication, vol. 11, pp. 205–209, 2023, doi: 10.17762/ijritcc.v11i5s.6646.

B. S. Reddy, “An optimal superpixel segmentation based transfer learning using AlexNet–SVM model for weed detection,” International Journal of System Assurance Engineering and Management, 2023, doi: 10.1007/s13198-023-02064-2.

A. E. K. Gunawan, “Stock Price Movement Classification Using Ensembled Model of Long Short-Term Memory (LSTM) and Random Forest (RF),” International Journal on Informatics Visualization, vol. 7, no. 4, pp. 2255–2262, 2023, doi: 10.30630/joiv.7.4.1640.

T. Kavzoglu, “Predictive Performances of Ensemble Machine Learning Algorithms in Landslide Susceptibility Mapping Using Random Forest, Extreme Gradient Boosting (XGBoost) and Natural Gradient Boosting (NGBoost),” Arabian Journal for Science and Engineering, vol. 47, no. 6, pp. 7367–7385, 2022, doi: 10.1007/s13369-022-06560-8.

E. Dumitrescu, “Machine learning for credit scoring: Improving logistic regression with non-linear decision-tree effects,” European Journal of Operational Research, vol. 297, no. 3, pp. 1178–1192, 2022, doi: 10.1016/j.ejor.2021.06.053.

A. H. Wibowo and T. I. Oesman, “The comparative analysis on the accuracy of k-NN, Naive Bayes, and Decision Tree Algorithms in predicting crimes and criminal actions in Sleman Regency,” Journal of Physics: Conference Series, vol. 1450, no. 1, 2020, doi: 10.1088/1742-6596/1450/1/012076.

P. Golpour et al., “Comparison of support vector machine, naïve bayes and logistic regression for assessing the necessity for coronary angiography,” International Journal of Environmental Research and Public Health, vol. 17, no. 18, pp. 1–9, 2020, doi: 10.3390/ijerph17186449.

Y. Yuhandri, A. P. Windarto, and M. N. H. Siregar, “Improving Brain Tumor Classification Efficacy through the Application of Feature Selection and Ensemble Classifiers,” Journal of Image and Graphics(United Kingdom), vol. 11, no. 4, pp. 397–404, 2023, doi: 10.18178/joig.11.4.397-404.

A. P. Windarto, Y. Yuhandri, and S. Bukhori, “a Novel Convective Cloud Segmentation for Heavy Rainfall Potential Assessment Using Deep Learning,” ICIC Express Letters, vol. 18, no. 4, pp. 313–323, 2024, doi: 10.24507/icicel.18.04.313.

P. R. Shekar, A. Mathew, and K. V. Sharma, “A hybrid CNN–RNN model for rainfall–runoff modeling in the Potteruvagu watershed of India,” CLEAN – Soil, Air, Water, vol. n/a, no. n/a, p. 2300341, 2024, doi: https://doi.org/10.1002/clen.202300341.

Enung, “Hourly Discharge Prediction Using Long Short-Term Memory Recurrent Neural Network (Lstm-Rnn) In The Upper Citarum River,” International Journal of GEOMATE, vol. 23, no. 98, pp. 147–154, 2022, doi: 10.21660/2022.98.3462.

Z. A. Sejuti and M. S. Islam, “A hybrid CNN–KNN approach for identification of COVID-19 with 5-fold cross validation,” Sensors International, vol. 4, no. November 2022, p. 100229, 2023, doi: 10.1016/j.sintl.2023.100229.

R. Kadry and O. Ismael, “A New Hybrid KNN Classification Approach based on Particle Swarm Optimization,” International Journal of Advanced Computer Science and Applications, vol. 11, no. 11, pp. 291–296, 2020, doi: 10.14569/IJACSA.2020.0111137.

W. Sinhashthita, “Improving KNN Algorithm Based on Weighted Attributes by Pearson Correlation Coefficient and PSO Fine Tuning,” 2020.

C. Karapataki and J. Adamowski, “Comparison of Multivariate Regression and Artificial Neural Networks for Peak Urban Water-Demand Forecasting: Evaluation of Different ANN Learning Algorithms,” Journal of Hydrologic Engineering, vol. 17, no. 7, pp. 834–836, 2012, doi: 10.1061/(asce)he.1943-5584.0000472.

S. Kamada, T. Ichimura, A. Hara, and K. J. Mackin, “Adaptive structure learning method of deep belief network using neuron generation – annihilation and layer generation,” Neural Computing and Applications, vol. 0123456789, 2018, doi: 10.1007/s00521-018-3622-y.

P. Alkhairi, W. Wanayumini, and B. H. Hayadi, “Analysis of the adaptive learning rate and momentum effects on prediction problems in increasing the training time of the backpropagation algorithm,” AIP Conference Proceedings, vol. 3048, no. 1, p. 20049, 2024, doi: 10.1063/5.0203374.

N. A. Setyadi, M. Nasrun, and C. Setianingsih, “Text Analysis for Hate Speech Detection Using Backpropagation Neural Network,” Proceedings - 2018 International Conference on Control, Electronics, Renewable Energy and Communications, ICCEREC 2018, pp. 159–165, 2018, doi: 10.1109/ICCEREC.2018.8712109.

L. Chen, “Intralayer-Connected Spiking Neural Network with Hybrid Training Using Backpropagation and Probabilistic Spike-Timing Dependent Plasticity,” International Journal of Intelligent Systems, vol. 2023, 2023, doi: 10.1155/2023/3135668.

A. P. Windarto, P. Alkhairi, and J. Muslim, “Enhancing Premier League Match Outcome Prediction Using Support Vector Machine with Ensemble Techniques: A Comparative Study on Bagging and Boosting,” Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi)(Rekayasa Sistem dan Teknologi Informasi), vol. 9, no. 1, pp. 94–103, 2024, doi: https://doi.org/10.29207/resti.v9i1.6173.

N. Razali, A. Mustapha, N. Arbaiy, and P. C. Lin, “Deep Learning for Football Outcomes Prediction based on Football Rating System,” AIP Conference Proceedings, vol. 2644, no. November, 2022, doi: 10.1063/5.0104587.

M. Qu, “An abnormal behaviour recognition of MOOC online learning based on multidimensional data mining,” International Journal of Autonomous and Adaptive Communications Systems, vol. 17, no. 4, pp. 369–382, 2024, doi: 10.1504/IJAACS.2024.139403.

W. N. Ismail, H. A. Alsalamah, M. M. Hassan, and E. Mohamed, “AUTO-HAR: An adaptive human activity recognition framework using an automated CNN architecture design,” Heliyon, vol. 9, no. 2, p. e13636, 2023, doi: 10.1016/j.heliyon.2023.e13636.

Downloads

Published

2025-08-17

Issue

Section

Artificial Intelligence

How to Cite

Nita Syahputri, Putrama Alkhairi, & Enok Tuti Alawiah. (2025). Analysis of the Impact of Backpropagation Hyperparameter Optimization on Heart Disease Prediction Models. Jurnal RESTI (Rekayasa Sistem Dan Teknologi Informasi), 9(4), 788-795. https://doi.org/10.29207/resti.v9i4.6473