A Comparative Evaluation of Federated Learning Algorithms for Privacy-Preserving Academic Prediction on Heterogeneous Data

Authors

  • Michael Angello Qadosy Riyadi Telkom University
  • Adinda Mariasti Dewi Telkom University

DOI:

https://doi.org/10.29207/resti.v10i1.7288

Keywords:

academic, educational, federated learning, machine learning, privacy

Abstract

The rapid growth of educational data enables predictive analytics for academic performance, yet privacy regulations like GDPR and FERPA severely restrict centralized data sharing. Although Federated Learning (FL) has succeeded in privacy-sensitive fields such as healthcare, its application in education remains underexplored, lacking systematic comparative studies of multiple FL algorithms across diverse educational datasets—especially emphasizing recall and ROC-AUC as critical metrics for early identification of students at academic risk. This study fills this gap by evaluating five FL algorithms—Federated Averaging (FedAvg), Federated Proximal (FedProx), Federated Dynamics (FedDyn), Fair Federated Averaging (q-FedAvg), and SCAFFOLD—for privacy-preserving prediction of academic outcomes. Three public datasets were purposefully selected for their representativeness and heterogeneity: Predict Students Dropout and Academic Success (binary dropout prediction with socioeconomic factors), Student Performance (multi-class grade prediction in secondary education), and xAPI-Edu-Data (multi-class performance based on online learning activities). Local neural networks employed Stratified 5-Fold Cross-Validation, while FL algorithms ran for 50 communication rounds. Global models, particularly q-FedAvg and FedProx, consistently surpassed local models, with q-FedAvg achieving 0.7668 accuracy, 0.6813 recall, and 0.8810 ROC-AUC on Predict Students Dropout; 0.8580 accuracy and 0.9871 recall on Student Performance; and 0.7396 accuracy and 0.8815 ROC-AUC on xAPI-Edu-Data. Paired T-tests confirmed significant recall gains for most global models (p < 0.05). These results highlight FL’s ability to handle data heterogeneity and privacy constraints while improving predictive performance, thereby supporting timely educational interventions and enhanced student retention policies.

Downloads

Download data is not yet available.

References

S. Hilbert et al., “Machine learning for the educational sciences,” Rev. Educ., vol. 9, no. 3, p. e3310, 2021, doi: 10.1002/rev3.3310.

W. Forero-Corba and F. N. Bennasar, “Techniques and applications of Machine Learning and Artificial Intelligence in education: a systematic review,” RIED-Rev. Iberoam. Educ. Distancia, vol. 27, no. 1, 2024, doi: doi.org/10.5944/ried.27.1.37491.

L. O. Ofusori and R. Hendradi, “ChatGPT and Its Impact on Students Assessment Practices in the Higher Educational Sector: A Systematic Review,” J. Inf. Syst. Eng. Bus. Intell., vol. 11, no. 1, pp. 65–78, Mar. 2025, doi: 10.20473/jisebi.11.1.65-78.

L. R. Pelima, Y. Sukmana, and Y. Rosmansyah, “Predicting University Student Graduation Using Academic Performance and Machine Learning: A Systematic Literature Review,” IEEE Access, vol. 12, pp. 23451–23465, 2024, doi: 10.1109/ACCESS.2024.3361479.

M. Taufiq and A. S. Kenyo, “The Legal Protection of Personal Data in the Digital Era: A Comparative Study of Indonesian Law and the GDPR,” Int. J. Bus. Law Educ., vol. 6, no. 2, pp. 1260–1268, Aug. 2025, doi: 10.56442/ijble.v6i2.1178.

S. Radway, K. Quintanilla, C. Ludden, and D. Votipka, “An Investigation of US Universities’ Implementation of FERPA Student Directory Policies and Student Privacy Preferences,” in Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems, New York, NY, USA: Association for Computing Machinery, 2024, pp. 1–35. doi: 10.1145/3613904.3642066.

C. Prince, N. Omrani, and F. Schiavone, “Online privacy literacy and users’ information privacy empowerment: the case of GDPR in Europe,” Inf. Technol. People, vol. 37, no. 8, pp. 1–24, Jan. 2024, doi: 10.1108/ITP-05-2023-0467.

A. B. F. Mansur and N. Yusof, “The Latent of Student Learning Analytic with K-mean Clustering for Student Behaviour Classification,” J. Inf. Syst. Eng. Bus. Intell., vol. 4, no. 2, pp. 156–161, Oct. 2018, doi: 10.20473/jisebi.4.2.156-161.

E. W. T. Darmaningrat, H. M. Astuti, and F. Alfi, “Information Privacy Concerns Among Instagram Users: The Case of Indonesian College Students,” J. Inf. Syst. Eng. Bus. Intell., vol. 6, no. 2, pp. 159–168, Oct. 2020, doi: 10.20473/jisebi.6.2.159-168.

R. G. Santosa, Y. Lukito, and A. R. Chrismanto, “Classification and Prediction of Students’ GPA Using K-Means Clustering Algorithm to Assist Student Admission Process,” J. Inf. Syst. Eng. Bus. Intell., vol. 7, no. 1, pp. 1–10, Apr. 2021, doi: 10.20473/jisebi.7.1.1-10.

R. Prabaswara, J. Lemantara, and J. Jusak, “Classification of Secondary School Destination for Inclusive Students using Decision Tree Algorithm,” J. RESTI Rekayasa Sist. Dan Teknol. Inf., vol. 7, no. 5, pp. 1009–1017, Aug. 2023, doi: 10.29207/resti.v7i5.5081.

E. Sutoyo and A. Almaarif, “Educational Data Mining for Predicting Student Graduation Using the Naïve Bayes Classifier Algorithm,” J. RESTI Rekayasa Sist. Dan Teknol. Inf., vol. 4, no. 1, pp. 95–101, Feb. 2020, doi: 10.29207/resti.v4i1.1502.

L. Chen, W. Liu, Y. Chen, and W. Wang, “Communication-Efficient Design for Quantized Decentralized Federated Learning,” IEEE Trans. Signal Process., vol. 72, pp. 1175–1188, 2024, doi: 10.1109/TSP.2024.3363887.

H. Chen, H. Wang, Q. Long, D. Jin, and Y. Li, “Advancements in Federated Learning: Models, Methods, and Privacy,” ACM Comput Surv, vol. 57, no. 2, Nov. 2024, doi: 10.1145/3664650.

K. Hu, S. Gong, Q. Zhang, and others, “An overview of implementing security and privacy in federated learning,” Artif. Intell. Rev., vol. 57, p. 204, 2024, doi: 10.1007/s10462-024-10846-8.

J. Wen, Z. Zhang, Y. Lan, and others, “A survey on federated learning: challenges and applications,” Int. J. Mach. Learn. Cybern., vol. 14, no. 2, pp. 513–535, 2023, doi: 10.1007/s13042-022-01647-y.

M. Ye, W. Shen, B. Du, E. Snezhko, V. Kovalev, and P. C. Yuen, “Vertical federated learning for effectiveness, security, applicability: A survey,” ACM Comput. Surv., vol. 57, no. 9, pp. 1–32, 2025, doi: 10.1145/3720539.

H. Guan, P.-T. Yap, A. Bozoki, and M. Liu, “Federated learning for medical image analysis: A survey,” Pattern Recognit., vol. 151, p. 110424, 2024, doi: https://doi.org/10.1016/j.patcog.2024.110424.

Y. Zhang and Y. Liu, “The Research of Predicting Student’s Academic Performance Based on Educational Data,” in Proceedings of the 2021 5th International Conference on Computer Science and Artificial Intelligence, in CSAI ’21. New York, NY, USA: Association for Computing Machinery, 2022, pp. 193–201. doi: 10.1145/3507548.3507578.

Tao-Hongli, “Educational data mining for student performance prediction: feature selection and model evaluation,” J. Electr. Syst., vol. 20, pp. 1063–1074, Apr. 2024, doi: 10.52783/jes.3434.

H. Yuan, F. Zhang, and L. Liu, “Research on Course Recommendation Model Based on MLP and Attention Mechanism,” in Proceedings of the 2024 International Conference on Intelligent Education and Computer Technology, in IECT ’24. New York, NY, USA: Association for Computing Machinery, 2024, pp. 99–103. doi: 10.1145/3687311.3687330.

D. C. E. Saputra, A. Azhari, and A. Ma’arif, “K-Nearest Neighbor of Beta Signal Brainwave to Accelerate Detection of Concentration on Student Learning Outcomes,” Eng. Lett., vol. 30, Feb. 2022.

H. Zhu, J. Xu, S. Liu, and Y. Jin, “Federated learning on non-IID data: A survey,” Neurocomputing, vol. 465, Sept. 2021, doi: 10.1016/j.neucom.2021.07.098.

T. Li, A. K. Sahu, A. Talwalkar, and V. Smith, “Federated Learning: Challenges, Methods, and Future Directions,” IEEE Signal Process. Mag., vol. 37, no. 3, pp. 50–60, 2020, doi: 10.1109/MSP.2020.2975749.

X. Li, S. Zhao, C. Chen, and Z. Zheng, “Heterogeneity-aware fair federated learning,” Inf. Sci., vol. 619, pp. 968–986, 2023, doi: https://doi.org/10.1016/j.ins.2022.11.031.

M. Noble, A. Bellet, and A. Dieuleveut, “Differentially Private Federated Learning on Heterogeneous Data,” in Proceedings of The 25th International Conference on Artificial Intelligence and Statistics, G. Camps-Valls, F. J. R. Ruiz, and I. Valera, Eds., in Proceedings of Machine Learning Research, vol. 151. PMLR, Mar. 2022, pp. 10110–10145. [Online]. Available: https://proceedings.mlr.press/v151/noble22a.html

J. Wang and Y. Yu, “Machine learning approach to student performance prediction of online learning,” PloS One, vol. 20, no. 1, p. e0299018, 2025, doi: 10.1371/journal.pone.0299018.

W. Zou, W. Zhong, J. Du, and L. Yuan, “Prediction of Student Academic Performance Utilizing a Multi-Model Fusion Approach in the Realm of Machine Learning,” Appl. Sci., vol. 15, no. 7, p. 3550, 2025, doi: 10.3390/app15073550.

S. N. Thakur and B. Rawat, “Prediction of Student Performance in E-Learning Environment using Machine Learning Techniques,” Procedia Comput. Sci., vol. 259, pp. 1416–1425, 2025, doi: 10.51201/JUSST/21/05179.

G. L. E. M. Niño et al., “Machine learning model for classifying high school students’ academic performance in mathematics amidst the COVID-19 context,” JOTSE, vol. 15, no. 2, pp. 322–334, 2025, doi: 10.3926/jotse.2945.

G. Al-Tameemi, J. Xue, I. H. Ali, and S. Ajit, “A hybrid machine learning approach for predicting student performance using multi-class educational datasets,” Procedia Comput. Sci., vol. 238, pp. 888–895, 2024, doi: https://doi.org/10.1016/j.procs.2024.06.108

E. F. Agyemang et al., “Predicting Students’ Academic Performance Via Machine Learning Algorithms: An Empirical Review and Practical Application,” Comput. Eng. Intell. Syst., vol. 15, no. 1, p. 86, 2024, doi: 10.7176/CEIS/15-1-09.

T. Kołodziej and P. Rościszewski, “Towards Scalable Simulation of Federated Learning,” in International Conference on Neural Information Processing, Springer, 2021, pp. 248–256, doi: https://doi.org/10.1007/978-3-030-92307-5_29

M. Djukic, I. Prokić, M. Popovic, and others, “Correct orchestration of federated learning generic algorithms: Python translation to CSP and verification by PAT,” Int. J. Softw. Tools Technol. Transf., vol. 27, pp. 21–34, 2025, doi: 10.1007/s10009-025-00795-0.

A. Dureja and P. Pahwa, “Analysis of Non-Linear Activation Functions for Classification Tasks Using Convolutional Neural Networks,” Recent Patents on Computer Science, vol. 12, no. 3. Bentham Science Publishers, pp. 156–161, 2019. doi: https://doi.org/10.2174/2213275911666181025143029.

C. Zhang, Y. Xie, H. Bai, B. Yu, W. Li, and Y. Gao, “A survey on federated learning,” Knowl.-Based Syst., vol. 216, p. 106775, 2021, doi: https://doi.org/10.1016/j.knosys.2021.106775.

J. Chen, H. Yan, Z. Liu, M. Zhang, H. Xiong, and S. Yu, “When Federated Learning Meets Privacy-Preserving Computation,” ACM Comput Surv, vol. 56, no. 12, Oct. 2024, doi: 10.1145/3679013.

A. Khraisat, A. Alazab, S. Singh, T. Jan, and A. Jr. Gomez, “Survey on Federated Learning for Intrusion Detection System: Concept, Architectures, Aggregation Strategies, Challenges, and Future Directions,” ACM Comput Surv, vol. 57, no. 1, Oct. 2024, doi: 10.1145/3687124.

B. Casella and S. Fonio, “Architecture-Based FedAvg for Vertical Federated Learning,” in Proceedings of the IEEE/ACM 16th International Conference on Utility and Cloud Computing, in UCC ’23. New York, NY, USA: Association for Computing Machinery, 2024. doi: 10.1145/3603166.3632559.

J. Cui, Y. Li, Q. Zhang, Z. He, and S. Zhao, “A Federated Learning Framework Using FedProx Algorithm for Privacy-Preserving Palmprint Recognition,” in Biometric Recognition, S. Yu, W. Jia, X. Shu, X. Yuan, J. Gui, J. Tang, C. Shan, and Q. Liu, Eds., Singapore: Springer Nature Singapore, 2025, pp. 187–196, doi: https://doi.org/10.1007/978-981-96-1071-6_17

Y. Song, H.-H. Chang, and L. Liu, “Federated Dynamic Spectrum Access through Multi-Agent Deep Reinforcement Learning,” in GLOBECOM 2022 - 2022 IEEE Global Communications Conference, 2022, pp. 3466–3471. doi: 10.1109/GLOBECOM48099.2022.10001688.

S. P. Karimireddy, S. Kale, M. Mohri, S. Reddi, S. Stich, and A. T. Suresh, “SCAFFOLD: Stochastic Controlled Averaging for Federated Learning,” in Proceedings of the 37th International Conference on Machine Learning, H. D. III and A. Singh, Eds., in Proceedings of Machine Learning Research, vol. 119. PMLR, July 2020, pp. 5132–5143. [Online]. Available: https://proceedings.mlr.press/v119/karimireddy20a.html

G. Naidu, T. Zuva, and E. M. Sibanda, “A Review of Evaluation Metrics in Machine Learning Algorithms,” in Artificial Intelligence Application in Networks and Systems, R. Silhavy and P. Silhavy, Eds., Cham: Springer International Publishing, 2023, pp. 15–25, doi: https://doi.org/10.1007/978-3-031-35314-7_2

I. Issah, O. Appiah, P. Appiahene, and F. Inusah, “A systematic review of the literature on machine learning application of determining the attributes influencing academic performance,” Decis. Anal. J., vol. 7, p. 100204, 2023, doi: https://doi.org/10.1016/j.dajour.2023.100204.

S. Bates, T. Hastie, and R. Tibshirani, “Cross-Validation: What Does It Estimate and How Well Does It Do It?,” J. Am. Stat. Assoc., vol. 119, no. 546, pp. 1434–1445, 2024, doi: 10.1080/01621459.2023.2197686.

Downloads

Published

2026-02-16

Issue

Section

Artificial Intelligence

How to Cite

Angello Qadosy Riyadi, M., & Mariasti Dewi, A. (2026). A Comparative Evaluation of Federated Learning Algorithms for Privacy-Preserving Academic Prediction on Heterogeneous Data. Jurnal RESTI (Rekayasa Sistem Dan Teknologi Informasi), 10(1), 41-52. https://doi.org/10.29207/resti.v10i1.7288