Improving Data Completeness in SINTA Publication Scraping  Using an Iterative Method

Muhammad Arfah Asis; St. Hajrah Mansyur; Nia Kurniati

doi:10.29207/resti.v10i3.6952

Authors

Muhammad Arfah Asis Universitas Muslim Indonesia
St. Hajrah Mansyur Universitas Muslim Indonesia
Nia Kurniati Universitas Muslim Indonesia

DOI:

https://doi.org/10.29207/resti.v10i3.6952

Keywords:

author profile, iterative scraping, publication data, SINTA, web scraping

Abstract

The structure of publication data on lecturer profiles in SINTA, particularly those indexed by SCOPUS, often results in data duplication and missing records. This issue arises because articles are distributed by year across multiple pages, making standard single-pass scraping methods unable to guarantee data completeness. This study aims to develop and evaluate the effectiveness of an iterative scraping method in improving the accuracy of publication data retrieval from SINTA. The proposed method involves a series of ten experimental trials, in which the results of single-pass scraping are compared with those of iterative scraping. The evaluated parameters include the level of data completeness and the number of iterations required to achieve optimal results. The findings indicate that single-pass scraping captures only an average of 70.7% of publications in the first iteration, with frequent occurrences of duplicated and missing data. In contrast, the iterative scraping method consistently achieves 100% publication retrieval across all trials, although it requires a varying number of iterations ranging from four to eleven. Therefore, it can be concluded that iterative scraping is a more reliable approach for ensuring the completeness and accuracy of publication data. Although this approach demands greater computational resources than standard methods, it is well suited for large-scale bibliometric studies, institutional evaluations, and more comprehensive monitoring of research trends.

Downloads

Download data is not yet available.

References

N. Adila, “Implementation of Web Scraping for Journal Data Collection on the SINTA Website,” Sinkron, vol. 7, no. 4, pp. 2478–2485, Oct. 2022, doi: 10.33395/sinkron.v7i4.11576.

A. Ulfah and I. Najiah, “Implementasi Web Scraping pada Situs Jurnal Sinta Menggunakan Framework Selenium Webdriver Python,” JIKA (Jurnal Inform., vol. 7, no. 1, p. 29, Feb. 2023, doi: 10.31000/jika.v7i1.7037.

E. D. Widianto, Hadiyanto, T. Mantoro, and R. S. Wardoyo, “The promotion of university journals published by Universitas Diponegoro, Indonesia, from 2018 to 2024: a descriptive study,” Sci. Ed., vol. 12, no. 1, pp. 43–49, Feb. 2025, doi: 10.6087/kcse.353.

M. K. Hidayat, D. Sugiarto, R. Fitriana, and Y.-C. Liang, “Business intelligence system model to measure the performance of lecturers’ scientific publications,” TELKOMNIKA (Telecommunication Comput. Electron. Control., vol. 23, no. 4, p. 954, Aug. 2025, doi: 10.12928/telkomnika.v23i4.26221.

E. D. Widianto, Hadiyanto, T. Mantoro, and A. S. Nugroho, “Subject area mapping of Indonesian journals from GARUDA (Garba Rujukan Digital) and SINTA (Science Technology Index) databases: a descriptive study,” Sci. Ed., vol. 12, no. 2, pp. 175–182, Aug. 2025, doi: 10.6087/kcse.382.

A. Nugrohoadhi, “Pemanfaatan Publikasi Ilmiah di Perguruan Tinggi,” Pustakaloka, vol. 9, no. 2, Nov. 2017, doi: 10.21154/pustakaloka.v9i2.1087.

A. Mubarok and P. Istiana, “Mengkaji Publikasi Dosen Menggunakan Analisis Bibliometrik,” Media Inf., vol. 31, no. 2, pp. 146–156, Nov. 2022, doi: 10.22146/mi.v31i2.5402.

A. Nurohman and A. Aprillilah, “Riset kebijakan publikasi repositori institusi Perguruan Tinggi Keagamaan Islam Negeri Indonesia,” AL-KUTTAB J. Kaji. Perpustakaan, Inf. dan Kearsipan, vol. 6, no. 1, pp. 52–70, 2024, doi: 10.24952/ktb.v6i1.10443.

Y. S and D. F. Prakash, “Exploring Web Scraping Techniques for Data Extraction in E-Commerce Platforms: A Comprehensive Analysis,” Int. Res. J. Mod. Eng. Technol. Sci., vol. 6, no. 3, Mar. 2024, doi: 10.56726/IRJMETS50725.

J. Ward, Instant PHP Web Scraping. Packt Publishing, 2013.

U. Kumaresan and K. Ramanujam, “A Framework for Automated Scraping of Structured Data Records From the Deep Web Using Semantic Labeling,” Int. J. Inf. Retr. Res., vol. 12, no. 1, pp. 1–18, Nov. 2021, doi: 10.4018/IJIRR.290830.

M. Dogucu and M. Çetinkaya-Rundel, “Web Scraping in the Statistics and Data Science Curriculum: Challenges and Opportunities,” J. Stat. Data Sci. Educ., vol. 29, no. sup1, pp. S112–S122, Jan. 2021, doi: 10.1080/10691898.2020.1787116.

A. Rahmatulloh and R. Gunawan, “Web Scraping with HTML DOM Method for Data Collection of Scientific Articles from Google Scholar,” Indones. J. Inf. Syst., vol. 2, no. 2, pp. 95–104, Feb. 2020, doi: 10.24002/ijis.v2i2.3029.

A. F. Putri, G. Manik, F. Nabila, and N. Chamidah, “Implementasi Scraping Google Scholar Menggunakan HTML DOM Untuk Pengumpulan Data Artikel Dosen UPN Veteran Jakarta Berbasis Web,” in Prosiding Seminar Nasional Mahasiswa Bidang Ilmu Komputer dan Aplikasinya, 2021, vol. 2, no. 1, pp. 668–678.

M. R. Rafsanjani, “ScrapPaper: A web scrapping method to extract journal information from PubMed and Google Scholar search result using Python,” bioRxiv. Mar. 2022. doi: 10.1101/2022.03.08.483427.

M. Koprawi and W. S. Putra, “Implementasi Web Scraping pada Google Cendekia sebagai Sarana Profiling Penelitian Dosen,” Sci. Tech J. Ilmu Pengetah. dan Teknol., vol. 9, no. 1, pp. 59–72, Feb. 2023, doi: 10.30738/st.vol9.no1.a14188.

Y. A. Mahmood and B. Mahmood, “A Web Scraper for Data Mining Purposes,” SISTEMASI, vol. 13, no. 3, p. 1243, May 2024, doi: 10.32520/stmsi.v13i3.4107.

Y. I. Sulistya, A. C. Wardhana, M. Istighosah, and A. Riyandi, “Automated Google Scholar Crawling with a Web-Based Tool for Publication Data Management,” J. Teknol. Dan Sist. Inf. Bisnis, vol. 6, no. 4, pp. 768–773, Oct. 2024, doi: 10.47233/jteksis.v6i4.1604.

S. R. Shrestha, L. Olivetti, S. Pandey, K. Worou, and E. Raffetti, “The Citation Gap: An overview of academic output in the field of Natural Hazards and Climate Extremes analyzed through Google Scholar data.” Mar. 2025. doi: 10.31235/osf.io/az784_v1.

J. Räsänen, “Missing references and citations at Google Scholar,” Bioethics, vol. 39, no. 4, pp. 399–400, May 2025, doi: 10.1111/bioe.13403.

F. Hanifah, A. Rahmatulloh, and R. N. Shofa, “Implementasi Web Scraping Dalam Pengembangan Aplikasi Super Untuk Menunjang Kegiatan Tugas Akhir,” J. Nas. Teknol. dan Sist. Inf., vol. 11, no. 3, pp. 369–376, Jan. 2026, doi: 10.25077/TEKNOSI.v11i3.2025.369-376.

Y. Sahria, “Implementasi Teknik Web Scraping pada Jurnal SINTA Untuk Analisis Topik Penelitian Kesehatan Indonesia,” in URECOL (Unversity Research Colloqium), 2020, pp. 297–306.

L. M. Purnomo and M. Ayub, “Analisis Data Hasil Web Scraping untuk Menentukan Kualitas Jurnal Ilmiah,” J. Strateg., vol. 3, no. 1, pp. 122–132, 2021.

S. I. Nurhafida, “Optimasi Query Database Webscraping pada Jurnal Sinta,” JATISI (Jurnal Tek. Inform. dan Sist. Informasi), vol. 9, no. 3, pp. 2521–2532, Sep. 2022, doi: 10.35957/jatisi.v9i3.2806.

T. M. Fahrudin et al., “An Improved Reference Paper Collection System Using Web Scraping with Three Enhancements,” Futur. Internet, vol. 17, no. 5, p. 195, Apr. 2025, doi: 10.3390/fi17050195.

M. I. Al Amin, “PARSING DOM Method Implementation for Web Scraping to Identify Pornographic Websites,” JESII J. Elektron. Sist. Inf., vol. 2, no. 1, pp. 171–178, Jul. 2024, doi: 10.31848/jesii.v2i1.3414.

B.-V. Truong, L. T. T. Nguyen, P. Pham, and B. Vo, “HTMLDownloader: An open-source tool for dynamic web scraping and archiving using WebView2,” SoftwareX, vol. 32, p. 102373, Dec. 2025, doi: 10.1016/j.softx.2025.102373.

S. jahro Maulidiyah and A. I. Syahyadi, “Analysis Of E-Commerce Product With Web Scraping Technique,” CoreID J., vol. 3, no. 1, pp. 37–46, Mar. 2025, doi: 10.60005/coreid.v3i1.90.

R. Ulloa, F. Mangold, F. Schmidt, J. Gilsbach, and S. Stier, “Beyond time delays: how web scraping distorts measures of online news consumption,” Commun. Methods Meas., pp. 1–22, Mar. 2025, doi: 10.1080/19312458.2025.2482538.