Detecting Language Anxiety in Indonesian Students: Deep Learning and Traditional Classification Methods for English Learning Anxiety

Authors

  • Kemas Muslim Lhaksmana Telkom University
  • Muhammad Sya’bani Falif Telkom University
  • Iis Kurnia Nurhayati Telkom University
  • Muhammad Yudhi Rezaldi BRIN, Telkom University
  • Esa Prakasa BRIN
  • Rickman Roedavan Telkom University

DOI:

https://doi.org/10.29207/resti.v10i1.7109

Keywords:

classification, deep learning, english learning, GRU, language anxiety

Abstract

Mastery of the English language represents a fundamental determinant of professional achievement, particularly for individuals seeking to develop their careers and participate in international contexts. However, when learning a foreign language such as English, Indonesian students may experience language anxiety that cause them to hesitate to practicing English in the class, both in orally and in writing. For English teachers, it is crucial to identify students experiencing language anxiety early on, so that they may provide appropriate teaching strategies and interventions from the first class meeting. To address this issue, this study compares machine learning methods to provide a solution for early detection of students experiencing language anxiety. Furthermore, these methods are classification models, including LSTM, GRU, decision tree, naïve Bayes, logistic regression, and SVM. The implementation of each of these models is combined with different text representation techniques, such as Word2Vec, BERT, FastText, Glove, and TF-IDF. The advantage of our model is that despite the imbalance, limited, and smaller than baseline dataset size, this research finds that GRU with focal loss achieves the highest F1 score of 0.89. This result outperforms our baseline and thus suggests that this method is effective in detecting students who experience language anxiety.

Downloads

Download data is not yet available.

References

E. K. Horwitz, M. B. Horwitz, and J. Cope, “Foreign language classroom anxiety,” Mod. Lang. J., vol. 70, no. 2, pp. 125–132, 1986. https://doi.org/10.1111/j.1540-4781.1986.tb05256.x

P. D. MacIntyre and R. C. Gardner, “Methods and results in the study of anxiety and language learning: A review of the literature,” Lang. Learn., vol. 41, no. 1, pp. 85–117, 1991. https://doi.org/10.1111/j.1467-1770.1991.tb00677.x

E. K. Horwitz, “Language anxiety and achievement,” Annu. Rev. Appl. Linguist., vol. 21, pp. 112–126, 2001.

https://doi.org/10.1017/S0267190501000071

S. Han, Y. Li, and S. A. Haider, “Impact of foreign language classroom anxiety on higher education students' academic success: Mediating role of emotional intelligence and moderating influence of classroom environment,” Front. Psychol., vol. 13, Art. no. 945062, 2022.

https://doi.org/10.3389/fpsyg.2022.945062

V. Russell, “Language anxiety and the online learner,” Foreign Lang. Ann., vol. 53, no. 2, pp. 338–352, 2020.

https://doi.org/10.1111/flan.12461

Y. Yang, H. Zhao, and Y. Wang, “LSTM and GRU Neural Network Performance Comparison Study: Taking Yelp Review Dataset as an Example,” in Proc. 2020 Int. Conf. Big Data Soc. Sci. (ICBDSS), pp. 94–98, 2020. https://doi.org/10.1109/IWECAI50956.2020.00027

L. Chen, P. Chen, and Z. Lin, “Artificial intelligence in education: A review,” IEEE Access, vol. 8, pp. 75264–75278, 2020. https://doi.org/10.1109/ACCESS.2020.2988510

Y. Ruan, Y. Xia, Q. Liu, and Y. Chen, “EnglishBot: A conversational system for spoken English learning,” Int. J. Artif. Intell. Educ., vol. 31, pp. 123–140, 2021.

https://doi.org/10.1145/3397481.3450648

H. Ji, I. Han, and Y. Kang, “A systematic review of conversational AI in language education: Focusing on the collaboration with human teachers,” Comput. Educ.: Artif. Intell., vol. 3, Art. no. 100070, 2022.

https://doi.org/10.1080/15391523.2022.2142873

E. Yu, E. Pineda, I. Tano, A. Lagman, J. Victoriano, J. Mababa, and J. Pulumbarit, “Predicting programming anxiety among computer studies students using automated machine learning,” Int. J. Latest Technol. Eng. Manag. Appl. Sci., vol. 14, pp. 314–324, 2025.

https://doi.org/10.51583/IJLTEMAS.2025.140500034

T. Ai Hanai, M. Ghassemi, and J. Glass, “Detecting Depression with Audio/Text Sequence Modeling of Interviews,” in Proc. Interspeech, 2018. https://doi.org/10.21437/Interspeech.2018-2522

A. Oflaz, “The foreign language anxiety in learning German and the effects of total physical response method on students' speaking skill,” J. Lang. Linguist. Stud., vol. 15, no. 1, pp. 70–82, 2019. https://doi.org/10.17263/jlls.547616

Ş. Elaldı, “Foreign language anxiety of students studying English language and literature: A sample from Turkey,” Educ. Res. Rev., vol. 11, no. 6, pp. 219–228, 2016. https://doi.org/10.5897/ERR2015.2507

A. A. Gozali, I. K. Nurhayati, G. Rahmasari, and R. Andriani, “Analyzing key predictors of language anxiety: Machine learning models for ELAS prediction,” in Proc. 2024 Int. Conf. Intell. Cybern. Technol. Appl. (ICICyTA), Bali, Indonesia, 2024, pp. 1095–1100, https://doi.org/10.1109/ICICYTA64807.2024.10913470

M. S. Falif, K. M. Lhaksmana, M. A. Bijaksana, and E. Prakasa, “Identifying Language Anxiety Among Foreign Language Learners Using GRU,” in Proc. 2024 Int. Conf. Artif. Intell., Blockchain, Cloud Comput., Data Anal. (ICoABCD), Indonesia, 2024, pp. 315–320. https://doi.org/10.1109/ICoABCD63526.2024.10704343

M. Ali Khalaf Ali, “English language anxiety: Development and validation of a brief measure,” Int. J. Engl. Lang. Educ., vol. 3, no. 1, pp. 1–15, 2015.

https://doi.org/10.17220/ijpes.2017.02.005

J.-M. Dewaele, “Why the dichotomy ‘L1 versus LX user’ is better than ‘native versus non-native speaker’,” Appl. Linguist., vol. 39, no. 2, pp. 236–240, 2017. https://doi.org/10.1093/applin/amw055

D. Ismail and P. Hastings, “Toward ubiquitous foreign language learning anxiety detection,” in Proc. 23rd Int. Conf. Artif. Intell. Educ. (AIED 2022), pp. 298–301, 2022.

https://doi.org/10.1007/978-3-031-11647-6_56

D. Ismail and P. Hastings, “Emotionally adaptive intelligent tutoring system to reduce foreign language anxiety,” in Proc. Artif. Intell. Educ. (Posters and Late Breaking Results), vol. 1822, pp. 353–358, 2023.

https://doi.org/10.1007/978-3-031-36336-8_55

T.-Y. Lin, P. Goyal, R. Girshick, K. He, and P. Dollár, “Focal loss for dense object detection,” in Proc. IEEE Int. Conf. Comput. Vis. (ICCV), pp. 2980–2988, 2017.

https://doi.org/10.1109/ICCV.2017.324

C. D. Manning, P. Raghavan, and H. Schütze, Introduction to Information Retrieval. Cambridge, U.K.: Cambridge Univ. Press, 2008. https://dl.acm.org/doi/abs/10.5555/1394399

S. Kemmis, R. McTaggart, and R. Nixon, The Action Research Planner: Doing Critical Participatory Action Research. Singapore: Springer, 2014.

https://doi.org/10.1007/978-981-4560-67-2

E. Sudina, “Study and scale quality in second language survey research: The case of anxiety and motivation,” Lang. Learn., vol. 71, no. 3, pp. 799–845, 2021.

https://doi.org/10.1111/lang.12468

Jugo, R. R. (2020). Language Anxiety in Focus: The Case of Filipino Undergraduate Teacher Education Learners. Education Research International, 2020, Article ID 7049837. https://doi.org/10.1155/2020/7049837

T. Zhang, A. M. Schoene, S. Ji, and S. Ananiadou, “Natural language processing applied to mental illness detection: A narrative review,” npj Digit. Med., vol. 5, Art. no. 46, 2022.

https://doi.org/10.1038/s41746-022-00589-7

T. Young, D. Hazarika, S. Poria, and E. Cambria, “Recent trends in deep learning based natural language processing,” IEEE Comput. Intell. Mag., vol. 13, no. 3, pp. 55–75, 2018. https://doi.org/10.48550/arXiv.1708.02709

J. Devlin, M. W. Chang, K. Lee, and K. Toutanova, “BERT: Pre-training of deep bidirectional transformers for language understanding,” in Proc. NAACL-HLT, 2019, pp. 4171–4186. http://dx.doi.org/10.48550/arXiv.1810.04805

T. Mikolov, K. Chen, G. Corrado, and J. Dean, “Efficient estimation of word representations in vector space,” arXiv preprint arXiv:1301.3781, 2013. https://doi.org/10.48550/arXiv.1301.3781

A. Najjar, M. Sanderson, and Y. Wang, "Detecting AI-generated text in educational content," in Proc. 2025 ACM Conf. Learning at Scale, 2025, pp. 1–10. doi: 10.1145/1234567.1234568. https://doi.org/10.48550/arXiv.2501.03203

M. M. Oghaz and H. Veisi, "Detection and classification of ChatGPT-generated content using deep transformer models," Computers & Security, vol. 137, Art. no. 103275, 2025. https://doi.org/10.3389/frai.2025.1458707

S. Hochreiter and J. Schmidhuber, “Long short-term memory,” Neural Comput., vol. 9, no. 8, pp. 1735–1780, 1997. https://doi.org/10.1162/neco.1997.9.8.1735

K. Cho et al., “Learning phrase representations using RNN encoder-decoder for statistical machine translation,” arXiv preprint arXiv:1406.1078, 2014. https://doi.org/10.48550/arXiv.1406.1078

D. W. Hosmer, S. Lemeshow, and R. X. Sturdivant, Applied Logistic Regression, 3rd ed. Wiley, 2013. ISBN: 978-0-470-58247-3. https://doi.org/10.1002/9781118548387

C. Cortes and V. Vapnik, “Support-vector networks,” Mach. Learn., vol. 20, no. 3, pp. 273–297, 1995. http://dx.doi.org/10.1007/BF00994018

A. McCallum and K. Nigam, “A comparison of event models for Naive Bayes text classification,” in Proc. AAAI-98 Workshop Learn. Text Categorization, pp. 41–48, 1998.

AAAI Press. https://www.aaai.org/Papers/Workshops/1998/WS-98-05/WS98-05-007.pdf

J. R. Quinlan, “Induction of decision trees,” Mach. Learn., vol. 1, no. 1, pp. 81–106, 1986. https://doi.org/10.1023/A:1022643204877

Qaiser, S., & Ali, R. (2018). Text mining: Use of TF-IDF to examine the relevance of words to documents. International Journal of Computer Applications, 181(1), 25–29. https://doi.org/10.5120/ijca2018917395

J. Pennington, R. Socher, and C. D. Manning, “GloVe: Global vectors for word representation,” in Proc. 2014 Conf. Empir. Methods Nat. Lang. Process. (EMNLP), pp. 1532–1543, 2014. https://doi.org/10.3115/v1/D14-1162

P. Bojanowski, E. Grave, A. Joulin, and T. Mikolov, “Enriching word vectors with subword information,” Trans. Assoc. Comput. Linguist., vol. 5, pp. 135–146, 2017. https://doi.org/10.1162/tacl_a_00051

J. D. M. Rennie, Improving Multi-Class Text Classification with Naive Bayes (Master’s thesis). Massachusetts Institute of Technology, 2001. https://dspace.mit.edu/handle/1721.1/7074

Downloads

Published

2026-02-25

Issue

Section

Artificial Intelligence

How to Cite

Lhaksmana, K. M., Falif , M. S., Nurhayati, I. K., Rezaldi, M. Y., Prakasa, E., & Roedavan, R. (2026). Detecting Language Anxiety in Indonesian Students: Deep Learning and Traditional Classification Methods for English Learning Anxiety. Jurnal RESTI (Rekayasa Sistem Dan Teknologi Informasi), 10(1), 150-159. https://doi.org/10.29207/resti.v10i1.7109

Most read articles by the same author(s)