LightGBM for Liver Disease Detection with Hybrid Hyperparameter Optimization
DOI:
https://doi.org/10.29207/resti.v10i4.7357Keywords:
bayesian optimization, hyperparameter optimization, LightGBM, liver disease, NAFLD, OptunaAbstract
In response to the growing burden of liver-related disorders, this research develops a supervised learning approach using the Light Gradient Boosting Machine (LightGBM) algorithm to support the early identification of Non-Alcoholic Fatty Liver Disease (NAFLD). The study focuses on constructing and assessing a robust classification model that differentiates individuals with NAFLD from those without the condition based on routinely collected clinical indicators and lifestyle-related characteristics. The dataset, obtained from an open-access NAFLD repository, consists of 1,700 patient records with 10 predictor variables and one binary diagnosis label. The proposed framework employs a stratified shuffle split evaluation scheme with 5-fold and 10-fold cross-validation, using out-of-fold (OOF) probabilities to compute overall performance metrics. The baseline LightGBM model already demonstrated strong performance, achieving 88.94% accuracy, 90.74% precision, 88.99% recall, 89.85% F1-score, and 92.52% AUC under 10-fold cross-validation. To further improve predictive performance, hyperparameter tuning was performed using Optuna and Bayesian Optimization. Among the evaluated approaches, Bayesian-optimized LightGBM achieved the best results, with 93.17% accuracy, 94.49% precision, 92.52% recall, 93.72% F1-score, and 93.28% AUC under 10-fold cross-validation. These findings indicate that systematic hyperparameter optimization can improve the discriminative capability of LightGBM for NAFLD detection and support its potential as a reliable decision-support tool in clinical settings.
Downloads
References
L. Yao et al., “Global trends of big data analytics in health research: a bibliometric study,” Front. Med. (Lausanne)., vol. 12, Jul. 2025, doi: https://doi.org/10.3389/fmed.2025.1456286 .
N. Shibata et al., “A machine learning algorithm for stratification of risk of cardiovascular disease in metabolic dysfunction-associated steatotic liver disease,” Eur. J. Intern. Med., vol. 129, pp. 62–70, Nov. 2024, doi: https://doi.org/10.1016/j.ejim.2024.07.005.
G. Cao, J. Liu, and M. Liu, “Global, Regional, and National Trends in Incidence and Mortality of Primary Liver Cancer and Its Underlying Etiologies from 1990 to 2019: Results from the Global Burden of Disease Study 2019,” J. Epidemiol. Glob. Health, vol. 13, no. 2, pp. 344–360, May 2023, doi: https://doi.org/10.1007/s44197-023-00109-0.
H. Zhang et al., “Development and validation of machine learning-augmented algorithm for insulin sensitivity assessment in the community and primary care settings: a population-based study in China,” Front. Endocrinol. (Lausanne)., vol. 15, Jan. 2024, doi: https://doi.org/10.3389/fendo.2024.1292346.
S. Hanifi, A. Cammarono, and H. Zare-Behtash, “Advanced hyperparameter optimization of deep learning models for wind power prediction,” Renew. Energy, vol. 221, p. 119700, Feb. 2024, doi: https://doi.org/10.1016/j.renene.2023.119700.
P. Kumar Sahu and T. Fatma, “Optimized Breast Cancer Classification Using PCA-LASSO Feature Selection and Ensemble Learning Strategies With Optuna Optimization,” IEEE Access, vol. 13, pp. 35645–35661, 2025, doi: https://doi.org/10.1109/ACCESS.2025.3539746.
A. M. Elshewey, M. Y. Shams, N. El-Rashidy, A. M. Elhady, S. M. Shohieb, and Z. Tarek, “Bayesian Optimization with Support Vector Machine Model for Parkinson Disease Classification,” Sensors, vol. 23, no. 4, p. 2085, Feb. 2023, doi: https://doi.org/10.3390/s23042085.
H. Kim and D. Sanz-Alonso, “Enhancing Gaussian Process Surrogates for Optimization and Posterior Approximation via Random Exploration,” SIAM/ASA Journal on Uncertainty Quantification, vol. 13, no. 3, pp. 1054–1084, Sep. 2025, doi: https://doi.org/10.1137/24M1677009.
S. Agrawal and D. K. Sharma, “Handling High-Dimensional Data and Classification Using a Hybrid Feature Selection Approach,” in 2022 2nd International Conference on Advance Computing and Innovative Technologies in Engineering (ICACITE), IEEE, Apr. 2022, pp. 2168–2172. doi: https://doi.org/10.1109/ICACITE53722.2022.9823878.
H. Wu, Y. Mao, J. Weng, Y. Yu, and J. Wang, “Fractional light gradient boosting machine ensemble learning model: A non-causal fractional difference descent approach,” Information Fusion, vol. 118, p. 102947, Jun. 2025, doi: https://doi.org/10.1016/j.inffus.2025.102947.
M. Hajihosseinlou, A. Maghsoudi, and R. Ghezelbash, “A Novel Scheme for Mapping of MVT-Type Pb–Zn Prospectivity: LightGBM, a Highly Efficient Gradient Boosting Decision Tree Machine Learning Algorithm,” Natural Resources Research, vol. 32, no. 6, pp. 2417–2438, Dec. 2023, doi: https://doi.org/10.1007/s11053-023-10249-6.
G. He, Z. Wang, L. Tang, W. Yu, F. Nie, and X. Li, “Reweighted-Boosting: A Gradient-Based Boosting Optimization Framework,” IEEE Trans. Neural Netw. Learn. Syst., vol. 36, no. 7, pp. 11953–11965, Jul. 2025, doi: https://doi.org/10.1109/TNNLS.2024.3457764 .
F. Yamamoto, S. Ozawa, and L. Wang, “eFL-Boost: Efficient Federated Learning for Gradient Boosting Decision Trees,” IEEE Access, vol. 10, pp. 43954–43963, 2022, doi: https://doi.org/10.1109/ACCESS.2022.3169502.
I. AlShourbaji, N. Helian, Y. Sun, A. G. Hussien, L. Abualigah, and B. Elnaim, “An efficient churn prediction model using gradient boosting machine and metaheuristic optimization,” Sci. Rep., vol. 13, no. 1, p. 14441, Sep. 2023, doi: https://doi.org/10.1038/s41598-023-41093-6.
R. Sibindi, R. W. Mwangi, and A. G. Waititu, “A boosting ensemble learning based hybrid light gradient boosting machine and extreme gradient boosting model for predicting house prices,” Engineering Reports, vol. 5, no. 4, Apr. 2023, doi: https://doi.org/10.1002/eng2.12599.
S. Hanifi, A. Cammarono, and H. Zare-Behtash, “Advanced hyperparameter optimization of deep learning models for wind power prediction,” Renew. Energy, vol. 221, p. 119700, Feb. 2024, doi: https://doi.org/10.1016/j.renene.2023.119700.
P. R, S. Obbayed, K. Manju, G. Swarnalakshmi, and N. Purushotham, “Employee Attrition Prediction based on Light Gradient Boosting Machine with Bayesian Optimization,” in 2025 International Conference on Intelligent Systems and Computational Networks (ICISCN), IEEE, Jan. 2025, pp. 1–5. doi: https://doi.org/10.1109/ICISCN64258.2025.10934683.
S. Szeghalmy and A. Fazekas, “A Comparative Study of the Use of Stratified Cross-Validation and Distribution-Balanced Stratified Cross-Validation in Imbalanced Learning,” Sensors, vol. 23, no. 4, p. 2333, Feb. 2023, doi: https://doi.org/10.3390/s23042333.
U. N. Yefou, P. O. M. Choudja, B. Sow, and A. Adejumo, “Optimized Machine Learning Models for Hepatitis C Prediction: Leveraging Optuna for Hyperparameter Tuning and Streamlit for Model Deployment,” 2024, pp. 88–100. doi: https://doi.org/10.1007/978-3-031-57624-9_5.
D. T. Anh et al., “Assessment of groundwater potential modeling using support vector machine optimization based on Bayesian multi-objective hyperparameter algorithm,” Appl. Soft Comput., vol. 132, p. 109848, Jan. 2023, doi: https://doi.org/10.1016/j.asoc.2022.109848.
E. Srivastava, S. Mohan, T. K. Gandhi, A. K. Choudhury, and S. Kumar, “Attention-driven graph-based machine learning for non-invasive diagnosis of NAFLD,” Intell. Based. Med., vol. 12, Jan. 2025, doi: https://doi.org/10.1016/j.ibmed.2025.100288.
R. Mahardika Faska, S. Kurnia Gusti, E. Budianita, and F. Syafria, “PENGARUH TEKNIK PENYEIMBANGAN DATA PADA KLASIFIKASI PENYAKIT NAFLD DENGAN ALGORITMA SVM,” Jurnal Informatika Teknologi dan Sains, vol. 7, no. 2, pp. 858–867, 2025, [Online]. Available: https://www.kaggle.com/datasets/utkarshx27/non-alcohol-
A. Atsawarungruangkit, P. Laoveeravat, and K. Promrat, “Machine learning models for predicting non-alcoholic fatty liver disease in the general United States population: NHANES database,” World J. Hepatol., vol. 13, no. 10, pp. 1418–1427, Oct. 2021, doi: https://doi.org/10.4254/wjh.v13.i10.1417.
W. Ji, M. Xue, Y. Zhang, H. Yao, and Y. Wang, “A Machine Learning Based Framework to Identify and Classify Non-alcoholic Fatty Liver Disease in a Large-Scale Population,” Front. Public Health, vol. 10, Apr. 2022, doi: https://doi.org/10.3389/fpubh.2022.846118.
C. Chen and H. Seo, “Prediction of rock mass class ahead of TBM excavation face by ML and DL algorithms with Bayesian TPE optimization and SHAP feature analysis,” Acta Geotech., vol. 18, no. 7, pp. 3825–3848, Jul. 2023, doi: https://doi.org/10.1007/s11440-022-01779-z.
Downloads
Published
Issue
Section
License
Copyright in each article belongs to the author
- The author acknowledges that the RESTI Journal (System Engineering and Information Technology) is the first publisher to publish with a license Creative Commons Attribution 4.0 International License.
- Authors can enter writing separately, arrange the non-exclusive distribution of manuscripts that have been published in this journal into other versions (eg sent to the author's institutional repository, publication in a book, etc.), by acknowledging that the manuscript has been published for the first time in the RESTI (Rekayasa Sistem dan Teknologi Informasi) journal ;
