Interdisciplinary Analysis of Machine Learning Applications: Focus on Intent Classification
DOI:
https://doi.org/10.29207/resti.v9i5.6899Keywords:
academic research, intent classification, language models, machine learning, natural language processingAbstract
Given the rapid growth of machine learning publications on platforms such as arXiv, there is a need for systematic approaches to understand their objectives and contributions. This study aimed to analyze scientific intentions across domains, identify research trends, and evaluate the impact of external contextual enrichment on automatic intent classification. We perform a cross-domain comparison of research objectives, methodological designs, and application scenarios in machine learning publications, focusing on computer science and biology. We propose IntentBERT-Wiki, an enhanced BERT model enriched with contextual knowledge from Wikipedia, designed for intent classification in scientific documents. Our dataset comprises annotated sentences extracted from arXiv articles, categorized according to established rhetorical role taxonomies. The model’s performance is evaluated using standard classification metrics and compared to a baseline BERT model. Experimental results show that IntentBERT-Wiki achieves F1-scores of 95.9% in computer science and 87.4% in biology, with corresponding accuracies of 96.5% and 91.4%, outperforming the baseline. These findings demonstrate that Wikipedia-based contextual enrichment can significantly improve intent classification accuracy, enhance the organization of academic discourse, and facilitate cross-domain knowledge transfers. This study contributes to the understanding of how machine learning research is framed across disciplines and provides a scalable framework for scientific content analysis.
Downloads
References
B. S. Lubis and A. Yus, “Mapping knowledge and research trend on technology adoption in higher education: A bibliometric analysis,” Educ. Inf. Technol., Jun. 2024, doi: 10.1007/s10639-024-12801-0.
Cornell University Library, “arXiv.org e-Print archive,” [Online]. Available: https://arxiv.org/. Accessed: Jun. 20, 2025.
H. Gbada, K. Kalti, and M. A. Mahjoub, “Deep learning approaches for information extraction from visually rich documents: Datasets, challenges and methods,” IJDAR, vol. 28, no. 1, pp. 121–142, Mar. 2025, doi: 10.1007/s10032-024-00493-8.
H. Zhu and L. Lei, “The research trends of text classification studies (2000–2020): A bibliometric analysis,” Sage Open, vol. 12, no. 2, Art. no. 21582440221089963, Apr. 2022, doi: 10.1177/21582440221089963.
C. B. Chandrakala, R. Bhardwaj, and C. Pujari, “An intent recognition pipeline for conversational AI,” Int. J. Inf. Technol., vol. 16, no. 2, pp. 731–743, Feb. 2024, doi: 10.1007/s41870-023-01642-8.
Y. Wang, L. Zhou, W. Zhang, F. Zhang, and Y. Wang, “A soft prompt learning method for medical text classification with simulated human cognitive capabilities,” Artif. Intell. Rev., vol. 58, no. 4, Art. no. 118, Jan. 2025, doi: 10.1007/s10462-025-11121-0.
V. Desai, S. Wadhwa, A. A., and B. Bajaj, “Text-based intent analysis using deep learning,” IJISRT, vol. 5, no. 7, pp. 267–274, Jul. 2020, doi: 10.38124/IJISRT20JUL342.
C. Wang, S.-J. Cai, B.-X. Shi, and Z.-H. Chong, “Visual topic semantic enhanced machine translation for multi-modal data efficiency,” J. Comput. Sci. Technol., vol. 38, no. 6, pp. 1223–1236, Dec. 2023, doi: 10.1007/s11390-023-1302-6.
M. D. Oliveira, A. I. Tavares, R. Miranda, R. Trindade, and A. C. L. Vieira, “A novel policy dialogue to build sustainable and resilient health systems: Findings from PHSSR Portugal,” Health Res. Policy Syst., vol. 23, no. 1, Art. no. 58, May 2025, doi: 10.1186/s12961-025-01329-5.
A. Hao, H. Yuan, S. C. Hui, and J. Su, “Effective type label-based synergistic representation learning for biomedical event trigger detection,” BMC Bioinformatics, vol. 25, no. 1, Art. no. 251, Jul. 2024, doi: 10.1186/s12859-024-05851-1.
T. Sellhorn, “Machine learning und empirische Rechnungslegungsforschung: Einige Erkenntnisse und offene Fragen,” Schmalenbachs Z. betriebswirtsch. Forsch., vol. 72, no. 1, pp. 49–69, Mar. 2020, doi: 10.1007/s41471-020-00086-1.
R. Nacheva, M. Czaplewski, and P. Petrov, “Data mining model for scientific research classification: The case of digital workplace accessibility,” Decision, vol. 51, no. 1, pp. 3–16, Mar. 2024, doi: 10.1007/s40622-024-00378-z.
R. Lenart-Gansiniec, W. Czakon, and N. Meyer, “Antecedents of researchers’ behavioral intentions to use crowdsourcing in science: A multilevel approach,” Rev. Manag. Sci., vol. 19, no. 5, pp. 1411–1445, May 2025, doi: 10.1007/s11846-024-00797-3.
M. A. Ayanwale, R. R. Molefi, and S. Oyeniran, “Analyzing the evolution of machine learning integration in educational research: A bibliometric perspective,” Discov. Educ., vol. 3, no. 1, Art. no. 47, May 2024, doi: 10.1007/s44217-024-00119-5.
Z. Zhong, H. Guo, and K. Qian, “Deciphering the impact of machine learning on education: Insights from a bibliometric analysis using bibliometrix R-package,” Educ. Inf. Technol., vol. 29, no. 16, pp. 21995–22022, Nov. 2024, doi: 10.1007/s10639-024-12734-8.
O. Ovtšarenko, “Opportunities of machine learning algorithms for education,” Discov. Educ., vol. 3, no. 1, Art. no. 209, Nov. 2024, doi: 10.1007/s44217-024-00313-5.
S. B. Yoon, J. Lee, H.-C. Lee, C.-W. Jung, and H. Lee, “Comparison of NLP machine learning models with human physicians for ASA physical status classification,” npj Digit. Med., vol. 7, no. 1, Art. no. 259, Sep. 2024, doi: 10.1038/s41746-024-01259-6.
S. Liu, L. Li, M. Fang, C.-C. Hung, and S. Yang, “A prompt learning-based intent recognition method on a Chinese implicit intent dataset CIID,” Neural Process. Lett., vol. 55, no. 8, pp. 11017–11034, Dec. 2023, doi: 10.1007/s11063-023-11362-6.
R. Qi et al., “Multi-task learning model for citation intent classification in scientific publications,” Scientometrics, vol. 128, no. 12, pp. 6335–6355, Dec. 2023, doi: 10.1007/s11192-023-04858-4.
T. Ghosal, K. K. Varanasi, and V. Kordoni, “A deep multi-tasking approach leveraging cited–citing paper relationships for citation intent classification,” Scientometrics, vol. 129, no. 2, pp. 767–783, Feb. 2024, doi: 10.1007/s11192-023-04811-5.
N. El-Rashidy, Z. Tarek, A. M. Elshewey, and M. Y. Shams, “Multitask multilayer-prediction model for predicting mechanical ventilation and the associated mortality rate,” Neural Comput. Appl., vol. 37, no. 3, pp. 1321–1343, Jan. 2025, doi: 10.1007/s00521-024-10468-9.
C. Zhou et al., “A comprehensive survey on pretrained foundation models: A history from BERT to ChatGPT,” Int. J. Mach. Learn. Cybern., Nov. 2024, doi: 10.1007/s13042-024-02443-6.
N. Khouya, A. Retbi, and S. Bennani, “Contextual revelation of intentions in machine learning articles on arXiv: A new dimension in academic content analysis,” in Proc. 2024 IEEE 12th Int. Symp. Signal, Image, Video and Communications (ISIVC), 2024, pp. 1–6, doi: 10.1109/ISIVC57473.2024.10577900.
H. M. Tanrikulu and H. Pabuccu, “The effect of data types on the performance of machine learning algorithms for cryptocurrency prediction,” Comput. Econ., Mar. 2025, doi: 10.1007/s10614-025-10919-y.
S. Ferro, R. Giovanelli, M. Leeson, M. De Bernardin, and A. Traviglia, “A novel NLP-driven approach for enriching artefact descriptions, provenance, and entities in cultural heritage,” Neural Comput. Appl., Aug. 2025, doi: 10.1007/s00521-025-11449-2.
D. Khurana, A. K. Koli, K. Khatter, and S. Singh, “Natural language processing: State of the art, current trends and challenges,” Multimed. Tools Appl., vol. 82, no. 3, pp. 3713–3744, Jan. 2023, doi: 10.1007/s11042-022-13428-4.
S. Gorla, S. S. Tangeda, L. B. M. Neti, and A. Malapati, “Telugu named entity recognition using BERT,” Int. J. Data Sci. Anal., vol. 14, no. 2, pp. 127–140, Aug. 2022, doi: 10.1007/s41060-021-00305-w.
S. Chopra, P. Agarwal, J. Ahmed, S. S. Biswas, and A. J. Obaid, “RoBERTa and BERT: Revolutionizing mental healthcare through natural language,” SN Comput. Sci., vol. 5, no. 7, Art. no. 889, Sep. 2024, doi: 10.1007/s42979-024-03202-8.
M. Jojoa, P. Eftekhar, B. Nowrouzi-Kia, and B. Garcia-Zapirain, “Natural language processing analysis applied to COVID-19 open-text opinions using a DistilBERT model for sentiment categorization,” AI Soc., vol. 39, no. 3, pp. 883–890, Jun. 2024, doi: 10.1007/s00146-022-01594-w.
F. Petroni et al., “Improving Wikipedia verifiability with AI,” Nat. Mach. Intell., vol. 5, no. 10, pp. 1142–1148, Oct. 2023, doi: 10.1038/s42256-023-00726-1.
Downloads
Published
Issue
Section
License
Copyright in each article belongs to the author
- The author acknowledges that the RESTI Journal (System Engineering and Information Technology) is the first publisher to publish with a license Creative Commons Attribution 4.0 International License.
- Authors can enter writing separately, arrange the non-exclusive distribution of manuscripts that have been published in this journal into other versions (eg sent to the author's institutional repository, publication in a book, etc.), by acknowledging that the manuscript has been published for the first time in the RESTI (Rekayasa Sistem dan Teknologi Informasi) journal ;





