Application of The Naïve Bayes Classifier Algorithm to Classify Community Complaints

Keszya Wabang; Oky Dwi Nurhayati; Farikhin

doi:10.29207/resti.v6i5.4498

Keszya Wabang Universitas Diponegoro
Oky Dwi Nurhayati Universitas Diponegoro
Farikhin Universitas Diponegoro

DOI: https://doi.org/10.29207/resti.v6i5.4498

Keywords: classification, complaints/ community reports, Naive Bayes Classifier

Abstract

Unsatisfactory public services encourage the public to submit complaints/ reports to public service providers to improve their services. However, each complaint/ report submitted varies. Therefore, the first step of the community complaint resolution process is to classify every incoming community complaint. The Ombudsman of The Republic of Indonesia annually receives a minimum of 10,000 complaints with an average of 300-500 reports per province per year, classifies complaints/ community reports to divide them into three classes, namely simple reports, medium reports, and heavy reports. The classification process is carried out using a weight assessment of each complaint/ report using 5 (five) attributes. It becomes a big job if done manually. This impacts the inefficiency of the performance time of complaint management officers. As an alternative solution, in this study, a machine learning method with the Naïve Bayes Classifier algorithm was applied to facilitate the process of automatically classifying complaints/ community reports to be more effective and efficient. The results showed that the classification of complaints/ community reports by applying the Naïve Bayes Classifier algorithm gives a high accuracy value of 92%. In addition, the average precision, recall, and f1-score values, respectively, are 91%, 93%, and 92%.

Downloads

Download data is not yet available.

References

N. Safarov, “Personal experiences of digital public services access and use: Older migrants’ digital choices,” Technol. Soc., vol. 66, no. May, p. 101627, 2021, doi: 10.1016/j.techsoc.2021.101627.

S. Shokouhyar, S. Shokoohyar, and S. Safari, “Research on the influence of after-sales service quality factors on customer satisfaction,” J. Retail. Consum. Serv., vol. 56, no. May, p. 102139, 2020, doi: 10.1016/j.jretconser.2020.102139.

J. L. Stevens, B. I. Spaid, M. Breazeale, and C. L. Esmark Jones, “Timeliness, transparency, and trust: A framework for managing online customer complaints,” Bus. Horiz., vol. 61, no. 3, pp. 375–384, 2018, doi: 10.1016/j.bushor.2018.01.007.

H. Moon, W. Wei, and L. Miao, “Complaints and resolutions in a peer-to-peer business model,” Int. J. Hosp. Manag., vol. 81, no. May, pp. 239–248, 2019, doi: 10.1016/j.ijhm.2019.04.026.

N. Yan, X. Xu, T. Tong, and L. Huang, “Examining consumer complaints from an on-demand service platform,” Int. J. Prod. Econ., vol. 237, no. March, 2021, doi: 10.1016/j.ijpe.2021.108153.

D. C. Ferreira, R. C. Marques, A. M. Nunes, and J. R. Figueira, “Customers satisfaction in pediatric inpatient services: A multiple criteria satisfaction analysis,” Socioecon. Plann. Sci., 2021, doi: 10.1016/j.seps.2021.101036.

S. Khedkar and S. Shinde, “Deep Learning and Ensemble Approach for Praise or Complaint Classification,” Procedia Comput. Sci., vol. 167, no. 2019, pp. 449–458, 2020, doi: 10.1016/j.procs.2020.03.254.

A. Ghazzawi and B. Alharbi, “Analysis of Customer Complaints Data using Data Mining Techniques,” Procedia Comput. Sci., vol. 163, pp. 62–69, 2019, doi: 10.1016/j.procs.2019.12.087.

Y. HaCohen-Kerner, R. Dilmon, M. Hone, and M. A. Ben-Basan, “Automatic classification of complaint letters according to service provider categories,” Inf. Process. Manag., vol. 56, no. 6, pp. 1–20, 2019, doi: 10.1016/j.ipm.2019.102102.

E. K. Jacob, “Classification and categorization: A difference that makes a difference,” Libr. Trends, vol. 52, no. 3, 2004.

Samsir, Kusmanto, Abdul Hakim Dalimunthe, Rahmad Aditiya, and Ronal Watrianthos, “Implementation Naïve Bayes Classification for Sentiment Analysis on Internet Movie Database,” Building of Informatics, Technology and Science (BITS), vol. 4, no. 1, pp. 1–6, Jun. 2022

A. Singh, S. Saha, M. Hasanuzzaman, and A. Jangra, “Identifying complaints based on semi-supervised mincuts,” Expert Syst. Appl., vol. 186, no. November 2020, p. 115668, 2021, doi: 10.1016/j.eswa.2021.115668.

H. Zhang et al., “Developing novel computational prediction models for assessing chemical-induced neurotoxicity using naïve Bayes classifier technique,” Food Chem. Toxicol., vol. 143, no. July, 2020, doi: 10.1016/j.fct.2020.111513.

Hubert, P. Phoenix, R. Sudaryono, and D. Suhartono, “Classifying Promotion Images Using Optical Character Recognition and Naïve Bayes Classifier,” Procedia Comput. Sci., vol. 179, no. 2020, pp. 498–506, 2021, doi: 10.1016/j.procs.2021.01.033.

C. Patgiri and A. Ganguly, “Adaptive thresholding technique based classification of red blood cell and sickle cell using Naïve Bayes Classifier and K-nearest neighbor classifier,” Biomed. Signal Process. Control, vol. 68, no. April, 2021, doi: 10.1016/j.bspc.2021.102745.

C. Zhou et al., “Recognizing black point in wheat kernels and determining its extent using multidimensional feature extraction and a naive Bayes classifier,” Comput. Electron. Agric., vol. 180, no. November 2020, 2021, doi: 10.1016/j.compag.2020.105919.

J. Han, M. Kamber, and J. Pei, Data mining: Data mining concepts and techniques, Morgan Kaufmann Publishers, 2014.

S. Kapoor, R. Verma, and S. N. Panda, “Detecting kidney disease using Naïve bayes and decision tree in machine learning,” Int. J. Innov. Technol. Explor. Eng., vol. 9, no. 1, pp. 498–501, 2019, doi: 10.35940/ijitee.A4377.119119.

Y. Ghatas, M. Fayek, and M. Hadhoud, “A hybrid deep learning approach for musical difficulty estimation of piano symbolic music,” Alexandria Eng. J., vol. 61, no. 12, pp. 10183–10196, 2022, doi: 10.1016/j.aej.2022.03.060.