Interdisciplinary Analysis of Machine Learning Applications: Focus on Intent Classification

Authors

  • Nabila Khouya Mohammed V University in Rabat
  • Asmaâ Retbi Mohammed V University in Rabat
  • Samir Bennani Mohammed V University in Rabat

DOI:

https://doi.org/10.29207/resti.v9i5.6899

Keywords:

academic research, intent classification, language models, machine learning, natural language processing

Abstract

Given the rapid growth of machine learning publications on platforms such as arXiv, there is a need for systematic approaches to understand their objectives and contributions. This study aimed to analyze scientific intentions across domains, identify research trends, and evaluate the impact of external contextual enrichment on automatic intent classification. We perform a cross-domain comparison of research objectives, methodological designs, and application scenarios in machine learning publications, focusing on computer science and biology. We propose IntentBERT-Wiki, an enhanced BERT model enriched with contextual knowledge from Wikipedia, designed for intent classification in scientific documents. Our dataset comprises annotated sentences extracted from arXiv articles, categorized according to established rhetorical role taxonomies. The model’s performance is evaluated using standard classification metrics and compared to a baseline BERT model. Experimental results show that IntentBERT-Wiki achieves F1-scores of 95.9% in computer science and 87.4% in biology, with corresponding accuracies of 96.5% and 91.4%, outperforming the baseline. These findings demonstrate that Wikipedia-based contextual enrichment can significantly improve intent classification accuracy, enhance the organization of academic discourse, and facilitate cross-domain knowledge transfers. This study contributes to the understanding of how machine learning research is framed across disciplines and provides a scalable framework for scientific content analysis.

Downloads

Download data is not yet available.

References

B. S. Lubis and A. Yus, “Mapping knowledge and research trend on technology adoption in higher education: A bibliometric analysis,” Educ. Inf. Technol., Jun. 2024, doi: 10.1007/s10639-024-12801-0.

Cornell University Library, “arXiv.org e-Print archive,” [Online]. Available: https://arxiv.org/. Accessed: Jun. 20, 2025.

H. Gbada, K. Kalti, and M. A. Mahjoub, “Deep learning approaches for information extraction from visually rich documents: Datasets, challenges and methods,” IJDAR, vol. 28, no. 1, pp. 121–142, Mar. 2025, doi: 10.1007/s10032-024-00493-8.

H. Zhu and L. Lei, “The research trends of text classification studies (2000–2020): A bibliometric analysis,” Sage Open, vol. 12, no. 2, Art. no. 21582440221089963, Apr. 2022, doi: 10.1177/21582440221089963.

C. B. Chandrakala, R. Bhardwaj, and C. Pujari, “An intent recognition pipeline for conversational AI,” Int. J. Inf. Technol., vol. 16, no. 2, pp. 731–743, Feb. 2024, doi: 10.1007/s41870-023-01642-8.

Y. Wang, L. Zhou, W. Zhang, F. Zhang, and Y. Wang, “A soft prompt learning method for medical text classification with simulated human cognitive capabilities,” Artif. Intell. Rev., vol. 58, no. 4, Art. no. 118, Jan. 2025, doi: 10.1007/s10462-025-11121-0.

V. Desai, S. Wadhwa, A. A., and B. Bajaj, “Text-based intent analysis using deep learning,” IJISRT, vol. 5, no. 7, pp. 267–274, Jul. 2020, doi: 10.38124/IJISRT20JUL342.

C. Wang, S.-J. Cai, B.-X. Shi, and Z.-H. Chong, “Visual topic semantic enhanced machine translation for multi-modal data efficiency,” J. Comput. Sci. Technol., vol. 38, no. 6, pp. 1223–1236, Dec. 2023, doi: 10.1007/s11390-023-1302-6.

M. D. Oliveira, A. I. Tavares, R. Miranda, R. Trindade, and A. C. L. Vieira, “A novel policy dialogue to build sustainable and resilient health systems: Findings from PHSSR Portugal,” Health Res. Policy Syst., vol. 23, no. 1, Art. no. 58, May 2025, doi: 10.1186/s12961-025-01329-5.

A. Hao, H. Yuan, S. C. Hui, and J. Su, “Effective type label-based synergistic representation learning for biomedical event trigger detection,” BMC Bioinformatics, vol. 25, no. 1, Art. no. 251, Jul. 2024, doi: 10.1186/s12859-024-05851-1.

T. Sellhorn, “Machine learning und empirische Rechnungslegungsforschung: Einige Erkenntnisse und offene Fragen,” Schmalenbachs Z. betriebswirtsch. Forsch., vol. 72, no. 1, pp. 49–69, Mar. 2020, doi: 10.1007/s41471-020-00086-1.

R. Nacheva, M. Czaplewski, and P. Petrov, “Data mining model for scientific research classification: The case of digital workplace accessibility,” Decision, vol. 51, no. 1, pp. 3–16, Mar. 2024, doi: 10.1007/s40622-024-00378-z.

R. Lenart-Gansiniec, W. Czakon, and N. Meyer, “Antecedents of researchers’ behavioral intentions to use crowdsourcing in science: A multilevel approach,” Rev. Manag. Sci., vol. 19, no. 5, pp. 1411–1445, May 2025, doi: 10.1007/s11846-024-00797-3.

M. A. Ayanwale, R. R. Molefi, and S. Oyeniran, “Analyzing the evolution of machine learning integration in educational research: A bibliometric perspective,” Discov. Educ., vol. 3, no. 1, Art. no. 47, May 2024, doi: 10.1007/s44217-024-00119-5.

Z. Zhong, H. Guo, and K. Qian, “Deciphering the impact of machine learning on education: Insights from a bibliometric analysis using bibliometrix R-package,” Educ. Inf. Technol., vol. 29, no. 16, pp. 21995–22022, Nov. 2024, doi: 10.1007/s10639-024-12734-8.

O. Ovtšarenko, “Opportunities of machine learning algorithms for education,” Discov. Educ., vol. 3, no. 1, Art. no. 209, Nov. 2024, doi: 10.1007/s44217-024-00313-5.

S. B. Yoon, J. Lee, H.-C. Lee, C.-W. Jung, and H. Lee, “Comparison of NLP machine learning models with human physicians for ASA physical status classification,” npj Digit. Med., vol. 7, no. 1, Art. no. 259, Sep. 2024, doi: 10.1038/s41746-024-01259-6.

S. Liu, L. Li, M. Fang, C.-C. Hung, and S. Yang, “A prompt learning-based intent recognition method on a Chinese implicit intent dataset CIID,” Neural Process. Lett., vol. 55, no. 8, pp. 11017–11034, Dec. 2023, doi: 10.1007/s11063-023-11362-6.

R. Qi et al., “Multi-task learning model for citation intent classification in scientific publications,” Scientometrics, vol. 128, no. 12, pp. 6335–6355, Dec. 2023, doi: 10.1007/s11192-023-04858-4.

T. Ghosal, K. K. Varanasi, and V. Kordoni, “A deep multi-tasking approach leveraging cited–citing paper relationships for citation intent classification,” Scientometrics, vol. 129, no. 2, pp. 767–783, Feb. 2024, doi: 10.1007/s11192-023-04811-5.

N. El-Rashidy, Z. Tarek, A. M. Elshewey, and M. Y. Shams, “Multitask multilayer-prediction model for predicting mechanical ventilation and the associated mortality rate,” Neural Comput. Appl., vol. 37, no. 3, pp. 1321–1343, Jan. 2025, doi: 10.1007/s00521-024-10468-9.

C. Zhou et al., “A comprehensive survey on pretrained foundation models: A history from BERT to ChatGPT,” Int. J. Mach. Learn. Cybern., Nov. 2024, doi: 10.1007/s13042-024-02443-6.

N. Khouya, A. Retbi, and S. Bennani, “Contextual revelation of intentions in machine learning articles on arXiv: A new dimension in academic content analysis,” in Proc. 2024 IEEE 12th Int. Symp. Signal, Image, Video and Communications (ISIVC), 2024, pp. 1–6, doi: 10.1109/ISIVC57473.2024.10577900.

H. M. Tanrikulu and H. Pabuccu, “The effect of data types on the performance of machine learning algorithms for cryptocurrency prediction,” Comput. Econ., Mar. 2025, doi: 10.1007/s10614-025-10919-y.

S. Ferro, R. Giovanelli, M. Leeson, M. De Bernardin, and A. Traviglia, “A novel NLP-driven approach for enriching artefact descriptions, provenance, and entities in cultural heritage,” Neural Comput. Appl., Aug. 2025, doi: 10.1007/s00521-025-11449-2.

D. Khurana, A. K. Koli, K. Khatter, and S. Singh, “Natural language processing: State of the art, current trends and challenges,” Multimed. Tools Appl., vol. 82, no. 3, pp. 3713–3744, Jan. 2023, doi: 10.1007/s11042-022-13428-4.

S. Gorla, S. S. Tangeda, L. B. M. Neti, and A. Malapati, “Telugu named entity recognition using BERT,” Int. J. Data Sci. Anal., vol. 14, no. 2, pp. 127–140, Aug. 2022, doi: 10.1007/s41060-021-00305-w.

S. Chopra, P. Agarwal, J. Ahmed, S. S. Biswas, and A. J. Obaid, “RoBERTa and BERT: Revolutionizing mental healthcare through natural language,” SN Comput. Sci., vol. 5, no. 7, Art. no. 889, Sep. 2024, doi: 10.1007/s42979-024-03202-8.

M. Jojoa, P. Eftekhar, B. Nowrouzi-Kia, and B. Garcia-Zapirain, “Natural language processing analysis applied to COVID-19 open-text opinions using a DistilBERT model for sentiment categorization,” AI Soc., vol. 39, no. 3, pp. 883–890, Jun. 2024, doi: 10.1007/s00146-022-01594-w.

F. Petroni et al., “Improving Wikipedia verifiability with AI,” Nat. Mach. Intell., vol. 5, no. 10, pp. 1142–1148, Oct. 2023, doi: 10.1038/s42256-023-00726-1.

Downloads

Published

2025-10-26

Issue

Section

Artificial Intelligence

How to Cite

Khouya, N., Retbi, A., & Bennani, S. (2025). Interdisciplinary Analysis of Machine Learning Applications: Focus on Intent Classification. Jurnal RESTI (Rekayasa Sistem Dan Teknologi Informasi), 9(5), 1234-1241. https://doi.org/10.29207/resti.v9i5.6899