Leveraging Machine Learning to Predict Academic Specialization Pathways in Higher Education

Authors

  • Rendy Wirawan Tamrin Universitas Multimedia Nusantara
  • Wella Universitas Multimedia Nusantara

DOI:

https://doi.org/10.29207/resti.v10i1.6941

Keywords:

decision tree, random forest, specialization prediction, XGBoost

Abstract

This study developed a machine learning-based model to predict academic concentration selection among information systems students at Universitas Multimedia Nusantara (UMN). A survey of 125 students from the 2024 cohort revealed that 90% experienced difficulties in choosing a specialization, primarily due to limited information on course relevance, unclear academic pathways, and career uncertainty. While the survey provides a contextual background, the predictive model was trained using historical academic performance data from the 2021–2023 cohorts. The three classification algorithms, Decision Tree, Random Forest, and Extreme Gradient Boosting (XGBoost) were implemented following the CRISP-ML methodology. To address class imbalance in the dataset, the Synthetic Minority Over-sampling Technique (SMOTE) was applied, followed by hyperparameter tuning and feature selection. The Random Forest model demonstrated superior performance, achieving an accuracy of 78.08% on the 2021–2022 cohort data, outperforming Decision Tree and XGBoost across all experimental settings. This result highlights Random Forest's robustness in this context, particularly after the integration of SMOTE and optimization procedures. The main contribution of this study lies in the application of machine learning for academic pathway prediction in an Indonesian higher education setting, providing a data-driven decision support tool to assist students in making informed and personalized specialization choices.

Downloads

Download data is not yet available.

References

A. Cattaneo, M. L. Schmitz, P. Gonon, C. Antonietti, T. Consoli, and D. Petko, “The role of personal and contextual factors when investigating technology integration in general and vocational education,” Comput Human Behav, vol. 163, no. May 2024, 2025, doi: 10.1016/j.chb.2024.108475.

A. Marks and M. Al-Ali, “Digital Transformation in Higher Education: A Framework for Maturity Assessment,” COVID-19 Challenges to University Information Technology Governance, vol. 11, no. 12, pp. 61–81, 2022, doi: 10.1007/978-3-031-13351-0_3.

Made Pradnyana Ambara and I Nyoman Suraja Antarajaya, “Development of Academic Information Systems to Support the Lecture Process in Educational Institutions,” Jurnal Teknologi Informasi dan Komputer, vol. 9, no. 3, pp. 291–297, 2023, doi: 10.36002/jutik.v9i3.2505.

“Sistem Informasi | Universitas Multimedia Nusantara.” Accessed: Apr. 29, 2025. [Online]. Available: https://www.umn.ac.id/sistem-informasi/

Umn.ac.id, “To Become a Leading Global University in ICT & Entrepreneurship,” 2024. [Online]. Available: https://www.umn.ac.id/profil/#:~:text=2005-,2005,yang

D. A. N. Arah and K. Mahasiswa, “Socialization of Selection of Interest in The Islamic Economics Study Program as an Effort to Strengthen Students’ Competencies and Career Direction,” vol. 1, no. 1, pp. 55–64, 2025, doi: https://doi.org/10.71312/mrdimas.v1i1.243

F. Mahardika, F. Supriadi, and A. Guntara, “Analysis of student interest distribution in informatics concentration using the data-driven decision-making approach,” vol. 19, no. 2, pp. 278–287, 2025, doi: https://doi.org/10.33480/inti.v19i2.6347.

H. Ar - Rasyid, S. F. Pane, and M. Y. H. Setyawan, “Student Profile Mapping to Predict Student Interests,” Petir, vol. 16, no. 1, pp. 1–10, 2023, doi: 10.33322/petir.v16i1.1337.

S. Gheewala, S. Xu, and S. Yeom, “Deep attention dynamic representation learning networks for recommender system review modeling,” Big Data Research, vol. 40, no. March, p. 100521, 2025, doi: 10.1016/j.bdr.2025.100521.

I. Cahyati et al., “Implementation of Business Intelligence with Artificial Intelligence in E-Commerce,” SENTRI: Jurnal Riset Ilmiah, vol. 3, no. 6, pp. 2741–2756, 2024, doi: 10.55681/sentri.v3i6.2904.

Y. Kadam, Y. Kadulkar, V. Moolya, and S. Agrawal, “University Recommendation System for Abroad Studies using Machine Learning,” Int J Res Appl Sci Eng Technol, vol. 11, no. 4, pp. 2954–2962, 2023, doi: 10.22214/ijraset.2023.50835.

Y. Zayed, Y. Salman, and A. Hasasneh, “A Recommendation System for Selecting the Appropriate Undergraduate Program at Higher Education Institutions Using Graduate Student Data,” Applied Sciences (Switzerland), vol. 12, no. 24, 2022, doi: 10.3390/app122412525.

A. M. Purnamasari, “E-Commerce Product Recommendations using XGBoost with User Clusters and Clickstream,” International Journal of Advanced Trends in Computer Science and Engineering, vol. 9, no. 4, pp. 5942–5948, 2020, doi: 10.30534/ijatcse/2020/258942020.

S. Hakkal and A. A. Lahcen, “XGBoost To Enhance Learner Performance Prediction,” Computers and Education: Artificial Intelligence, vol. 7, no. June, p. 100254, 2024, doi: 10.1016/j.caeai.2024.100254.

“CRISP-ML(Q).” Accessed: May 10, 2025. [Online]. Available: https://ml-ops.org/content/crisp-ml

S. Studer et al., “Towards CRISP-ML(Q): A Machine Learning Process Model with Quality Assurance Methodology,” Mach Learn Knowl Extr, vol. 3, no. 2, pp. 392–413, 2021, doi: 10.3390/make3020020.

J. Rosemeyer, C. Neunzig, C. Akbal, J. Metternich, and B. Kuhlenkötter, “A maturity model for digital ML tools to be used in manufacturing environments”, 2024, doi: https://doi.org/10.26083/tuprints-00026519.

B. Charbuty and A. Abdulazeez, “Classification Based on Decision Tree Algorithm for Machine Learning,” Journal of Applied Science and Technology Trends, vol. 2, no. 01, pp. 20–28, 2021, doi: 10.38094/jastt20165.

C. Gupta and A. K. Ramdas, “Distribution-free calibration guarantees for histogram binning without sample splitting,” pp. 1–25, 2021., doi: https://doi.org/10.48550/arXiv.2105.04656

I. D. Mienye and N. Jere, “A Survey of Decision Trees : Concepts , Algorithms , and Applications,” IEEE Access, vol. 12, no. June, pp. 86716–86727, 2024, doi: 10.1109/ACCESS.2024.3416838.

Y. Sun and R. Quinlan, “Prediction performance of improved decision tree-based algorithms : Prediction performance of improved decision tree-based algorithms : a review,” Procedia Manuf, vol. 35, pp. 698–703, 2019, doi: 10.1016/j.promfg.2019.06.011.

H. Tan, “Machine Learning Algorithm for Classification,” J Phys Conf Ser, vol. 1994, no. 1, 2021, doi: 10.1088/1742-6596/1994/1/012016.

N. Younas, A. Ali, H. Hina, M. Hamraz, Z. Khan, and S. Aldahmani, “Optimal Causal Decision Trees Ensemble for Improved Prediction and Causal Inference,” IEEE Access, vol. 10, pp. 13000–13011, 2022, doi: 10.1109/ACCESS.2022.3146406.

I. D. Mienye, Y. Sun, and S. Member, “A Survey of Ensemble Learning : Concepts , Algorithms , Applications , and Prospects,” IEEE Access, vol. 10, no. August, pp. 99129–99149, 2022, doi: 10.1109/ACCESS.2022.3207287.

H. A. Salman, A. Kalakech, and A. Steiti, “Random Forest Algorithm Overview,” vol. 2024, pp. 69–79, 2024.

M. Imani, A. Beikmohammadi, and H. R. Arabnia, “Comprehensive Analysis of Random Forest and XGBoost Performance with SMOTE, ADASYN, and GNUS Under Varying Imbalance Levels,” Technologies (Basel), vol. 13, no. 3, pp. 1–40, 2025, doi: 10.3390/technologies13030088.

“Apa itu Python? ? - Penjelasan Bahasa Python - AWS.” Accessed: May 10, 2025. [Online]. Available: https://aws.amazon.com/id/what-is/python/

“Library Python yang Populer di Kalangan Data Scientist - Algoritma.” Accessed: May 10, 2025. [Online]. Available: https://algorit.ma/blog/library-python/

O. N. Abdumalikovich, “Classification of Python Language Modules,” Indonesian Journal of Innovation Studies, vol. 19, no. July, 2022, doi: http://dx.doi.org/10.21070/ijins.v19i.672.

“Streamlit • A faster way to build and share data apps.” Accessed: May 10, 2025. [Online]. Available: https://streamlit.io/

Downloads

Published

2026-02-14

Issue

Section

Artificial Intelligence

How to Cite

Tamrin, R. W., & Wella. (2026). Leveraging Machine Learning to Predict Academic Specialization Pathways in Higher Education. Jurnal RESTI (Rekayasa Sistem Dan Teknologi Informasi), 10(1), 1-10. https://doi.org/10.29207/resti.v10i1.6941