Improving Vehicle Payment Method Classification Using XGBoost with SMOTE and SHAP Interpretation
DOI:
https://doi.org/10.29207/resti.v10i1.6935Keywords:
explainable ai, payment method classification, SHAP, SMOTE, XgboostAbstract
Class imbalance in vehicle payment method classification can cause predictive models to become biased toward the majority. This study aims to build a classification model for automotive consumer payment methods using Extreme Gradient Boosting (XGBoost), with class balancing handled through the Synthetic Minority Over-sampling Technique (SMOTE) and Adaptive Synthetic Sampling (ADASYN), and model interpretability performed using SHAP (SHapley Additive Explanations). The dataset consisted of 11,011 records and 13 attributes derived from Toyota vehicle delivery order transactions. Results show that the XGBoost model without balancing achieved 67.37% accuracy but only 0.24 recall for the Cash class. After applying SMOTE, the recall for the Cash class improved to 0.58, while ADASYN produced a similar improvement at 0.59, with overall accuracy maintained at around 61–62% and a stable ROC-AUC of 0.65. Feature importance and SHAP analysis identified c_vehicle_model and c_city as the most influential factors in predicting the payment method. From a business perspective, the improved ability to detect cash customers reduces the risk of misclassification and enables dealers to better segment customer payment preference. This supports more effective marketing campaigns, sales strategies, and financing risk management. The combination of XGBoost, SMOTE, ADASYN, and SHAP has proven effective in handling imbalanced data while offering transparent interpretability of predictions, making it a practical foundation for data-driven decision-making in the automotive industry.
Downloads
References
J. Burez and D. Van den Poel, “Handling class imbalance in customer churn prediction,” Expert Syst. Appl., vol. 36, no. 3, Part 1, pp. 4626–4636, 2009, doi: https://doi.org/10.1016/j.eswa.2008.05.027.
N. V Chawla, K. W. Bowyer, L. O. Hall, and W. P. Kegelmeyer, “SMOTE: Synthetic Minority Over-sampling Technique,” Journal of Artificial Intelligence Research, vol. 16, pp. 321–357, 2002, doi: https://doi.org/10.1613/jair.953.
G. M. Weiss, “Mining with rarity: a unifying framework,” ACM SIGKDD Explorations Newsletter, vol. 6, no. 1, pp. 7–19, Jun. 2004, doi: https://doi.org/10.1145/1007730.1007734.
M. Altalhan, A. Algarni, and M. Turki-Hadj Alouane, “Imbalanced Data Problem in Machine Learning: A Review,” IEEE Access, vol. 13, pp. 13686–13699, 2025, doi: 10.1109/ACCESS.2025.3531662.
F. Sağlam and M. A. Cengiz, “A novel SMOTE-based resampling technique trough noise detection and the boosting procedure,” Expert Syst. Appl., vol. 200, no. 9, p. 117023, Aug. 2022, doi: 10.1016/j.eswa.2022.117023.
T. Chen and C. Guestrin, “XGBoost: A scalable tree boosting system,” Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, vol. 13-17-August-2016, pp. 785–794, Aug. 2016, doi: 10.1145/2939672.2939785.
P. Zhang, Y. Jia, and Y. Shang, “Research and application of XGBoost in imbalanced data,” Int. J. Distrib. Sens. Netw., vol. 18, no. 6, pp. 1897–1906, Jun. 2022, doi: 10.1177/15501329221106935.
Z. Li, “Extracting spatial effects from machine learning model using local interpretation method: An example of SHAP and XGBoost,” Comput. Environ. Urban Syst., vol. 96, Sep. 2022, doi: 10.1016/j.compenvurbsys.2022.101845.
A. Jude and J. Uddin, “Explainable Software Defects Classification Using SMOTE and Machine Learning,” Annals of Emerging Technologies in Computing, vol. 8, no. 1, pp. 35–49, 2024, doi: 10.33166/AETiC.2024.01.00.
C. Wang, H. Jiang, X. Jin, and Z. Zhou, “Customer credit rating by machine learning,” BCP Business & Management, vol. 36, pp. 122–130, 2023, doi: https://doi.org/10.54691/bcpbm.v36i.3490.
X. Zhang, “Machine learning insights into digital payment behaviors and fraud prediction,” Applied and Computational Engineering, vol. 77, pp. 55–66, 2024, doi: 10.54254/2755-2721/77/2024MA0066.
Y. Kong, Y. Wang, S. Sun, and J. Wang, “XGB and SHAP credit scoring model based on Bayesian optimization,” Journal of Computing and Electronic Information Management, vol. 10, no. 1, pp. 46–53, Feb. 2023, doi: 10.54097/jceim.v10i1.5368.
J. West and M. Bhattacharya, “Intelligent financial fraud detection: A comprehensive review,” Comput. Secur., vol. 57, pp. 47–66, 2016, doi: https://doi.org/10.1016/j.cose.2015.09.005.
V. Çetin and O. Yıldız, “A comprehensive review on data preprocessing techniques in data analysis,” Pamukkale University Journal of Engineering Sciences, vol. 28, no. 2, pp. 299–312, 2022, doi: 10.5505/pajes.2021.62687.
B. J. Jansen, K. K. Aldous, J. Salminen, H. Almerekhi, and S. Jung, “Data Preprocessing,” 2024, pp. 65–75. doi: 10.1007/978-3-031-41933-1_6.
Q. Zheng, C. Yu, J. Cao, Y. Xu, Q. Xing, and Y. Jin, “Advanced Payment Security System:XGBoost, LightGBM and SMOTE Integrated,” Jun. 2024, [Online]. Available: http://arxiv.org/abs/2406.04658
Z. Zhao and T. Bai, “Financial Fraud Detection and Prediction in Listed Companies Using SMOTE and Machine Learning Algorithms,” Entropy, vol. 24, no. 8, p. 978, Aug. 2022, doi: 10.3390/e24081157.
I. Aruleba and Y. Sun, “Effective Credit Risk Prediction Using Ensemble Classifiers With Model Explanation,” IEEE Access, vol. 12, no. 2, pp. 115015–115025, 2024, doi: 10.1109/ACCESS.2024.3445308.
P. Thanathamathee, S. Sawangarreerak, S. Chantamunee, and D. N. M. Nizam, “SHAP-Instance Weighted and Anchor Explainable AI: Enhancing XGBoost for Financial Fraud Detection,” Emerging Science Journal, vol. 8, no. 6, pp. 2404–2430, Dec. 2024, doi: 10.28991/ESJ-2024-08-06-016.
Y. Han, Z. Wei, and G. Huang, “An imbalance data quality monitoring based on SMOTE-XGBOOST supported by edge computing,” Sci. Rep., vol. 14, no. 1, Dec. 2024, doi: 10.1038/s41598-024-60600-x.
S. Wang, Y. Dai, J. Shen, and J. Xuan, “Research on expansion and classification of imbalanced data based on SMOTE algorithm,” Sci. Rep., vol. 11, no. 1, Dec. 2021, doi: 10.1038/s41598-021-03430-5.
J. Brownlee, “How to configure XGBoost for imbalanced classification,” Machine Learning Mastery, Aug. 2020, Accessed: Jun. 16, 2025. [Online]. Available: https://machinelearningmastery.com
A. Maurya, A. Kumar, and S. Prakash, “Credit Card Fraud Detection using XGBoost Classifier with a Threshold Value,” Jun. 2022, doi: 10.21203/rs.3.rs-1722294/v1.
T. Saito and M. Rehmsmeier, “The precision-recall plot is more informative than the ROC plot when evaluating binary classifiers on imbalanced datasets,” PLoS One, vol. 10, no. 3, Mar. 2015, doi: 10.1371/journal.pone.0118432.
R. Rodríguez-Pérez and J. Bajorath, “Interpretation of machine learning models using shapley values: application to compound potency and multi-target activity predictions,” J. Comput. Aided. Mol. Des., vol. 34, no. 10, pp. 1013–1026, Oct. 2020, doi: 10.1007/s10822-020-00314-0.
P. C. Y. Cheah, Y. Yang, and B. G. Lee, “Enhancing Financial Fraud Detection through Addressing Class Imbalance Using Hybrid SMOTE-GAN Techniques,” International Journal of Financial Studies, vol. 11, no. 3, p. 12, Sep. 2023, doi: 10.3390/ijfs11030110.
Y. Chen, R. Calabrese, and B. Martin-Barragan, “Interpretable machine learning for imbalanced credit scoring datasets,” Eur. J. Oper. Res., vol. 312, no. 1, pp. 357–372, Jan. 2024, doi: 10.1016/j.ejor.2023.06.036.
S. M. Lundberg, P. G. Allen, and S.-I. Lee, “A Unified Approach to Interpreting Model Predictions,” Advances in Neural Information Processing Systems (NeurIPS), vol. 30, 2017, doi: 10.48550/arXiv.1705.07874.
Y. Wang, Y. Jia, Y. Zhong, J. Huang, and J. Xiao, “Balanced incremental deep reinforcement learning based on variational autoencoder data augmentation for customer credit scoring,” Eng. Appl. Artif. Intell., vol. 122, p. 106056, Jun. 2023, doi: 10.1016/j.engappai.2023.106056.
D. Vijayanand and G. S. Smrithy, “Explainable AI - enhanced ensemble learning for financial fraud detection in mobile money transactions,” Intelligent Decision Technologies, vol. 19, no. 1, pp. 52–67, Jan. 2025, doi: 10.1177/18724981241289751.
K. Handayani et al., “Comparison of XGboost, Extra Trees, and LightGBM with SMOTE for Fetal Health Classification,” 2024. doi: https://doi.org/10.32520/stmsi.v13i3.3646.
M. Imani, A. Beikmohammadi, and H. R. Arabnia, “Comprehensive Analysis of Random Forest and XGBoost Performance with SMOTE, ADASYN, and GNUS Under Varying Imbalance Levels,” Technologies (Basel)., vol. 13, no. 3, Mar. 2025, doi: 10.3390/technologies13030088.
M. Yusoff, Y. Mahmud, P. A. R. Azmi, and M. T. M. Sallehud-din, “The improvement of SMOTE-ENN-XGBoost through Yeo Johnson strategy on Dissolved Gas Analysis dataset,” Energy Reports, vol. 13, pp. 6281–6290, Jun. 2025, doi: 10.1016/j.egyr.2025.05.013.
Downloads
Published
Issue
Section
License
Copyright in each article belongs to the author
- The author acknowledges that the RESTI Journal (System Engineering and Information Technology) is the first publisher to publish with a license Creative Commons Attribution 4.0 International License.
- Authors can enter writing separately, arrange the non-exclusive distribution of manuscripts that have been published in this journal into other versions (eg sent to the author's institutional repository, publication in a book, etc.), by acknowledging that the manuscript has been published for the first time in the RESTI (Rekayasa Sistem dan Teknologi Informasi) journal ;





