Gradient Boosting Machine, Random Forest dan Light GBM untuk Klasifikasi Kacang Kering
Gradient Boosting Machine, Random Forest and Light GBM for Classification of Dried Beans
Abstract
Bean seed classification is critical in determining the quality of beans. Previously, the same dataset was tested using the MLP, SVM, KNN, and DT algorithms, with SVM producing the best results. The purpose of this study is to determine the most effective model through the use of the BoxCox transformation selection feature and the random forest (RF) algorithm, as well as the gradient boosting machine (GBM), light GBM, and repeated k-folds evaluation model. The bean dataset is available on the UCI Repository website. The BoxCox transformation and repeated k-folds improved the classification prediction's accuracy. The model is used in the optimal training phase for a random forest with decision tree parameters 50 and depth 10, a gradient boosting machine model with a learning rate of 1, and a light gradient boosting machine model with a learning rate of 0.5 and estimator of 500. The best training accuracy results are obtained with light GBM. which is 99 percent accurate, but only 91 percent accurate in terms of validation. According research, the Barbunya, Bombay, Cali, Dermason, Horoz, Seker, and Sira beans classes provided accuracy values of 91 percent, 100 percent, 92 percent, 92 percent, 95 percent, 94 percent, and 84 percent, respectively.
Downloads
References
D. F. Barbin et al., "Classification and compositional characterization of different varieties of cocoa beans by near infrared spectroscopy and multivariate statistical analyses," J. Food Sci. Technol. 2018 557, vol. 55, no. 7, pp. 2457-2466, Apr. 2018.
https://doi.org/10.1007/s13197-018-3163-5
R. Megías-Pérez, S. Grimbs, R. N. D'Souza, H. Bernaert, and N. Kuhnert, "Profiling, quantification and classification of cocoa beans based on chemometric analysis of carbohydrates using hydrophilic interaction liquid chromatography coupled to mass spectrometry," Food Chem., vol. 258, pp. 284-294, Aug. 2018.
https://doi.org/10.1016/j.foodchem.2018.03.026
A. J. Myles, S. D. Brown, and T. A. Zimmerman, "Transfer of Multivariate Classification Models Between Laboratory and Process Near-Infrared Spectrometers for the Discrimination of Green Arabica and Robusta Coffee Beans," Appl. Spectrosc. Vol. 60, Issue 10, pp. 1198-1203, vol. 60, no. 10, pp. 1198-1203, Oct. 2006.
https://doi.org/10.1366/000370206778664581
F. Kurniawan, I. W. Budiastra, Sutrisno, and S. Widyotomo, "Classification of Arabica Java Coffee Beans Based on Their Origin using NIR Spectroscopy," IOP Conf. Ser. Earth Environ. Sci., vol. 309, no. 1, p. 012006, Sep. 2019.
https://doi.org/10.1088/1755-1315/309/1/012006
A. Vázquez-Ovando, F. Molina-Freaner, J. Nuñez-Farfán, D. Betancur-Ancona, and M. Salvador-Figueroa, "Classification of cacao beans (Theobroma cacao L.) of southern Mexico based on chemometric analysis with multivariate approach," Eur. Food Res. Technol. 2015 2406, vol. 240, no. 6, pp. 1117-1128, Feb. 2015.
https://doi.org/10.1007/s00217-015-2415-0
Y. Li, J. Sun, X. Wu, Q. Chen, B. Lu, and C. Dai, "Detection of viability of soybean seed based on fluorescence hyperspectra and CARS-SVM-AdaBoost model," J. Food Process. Preserv., vol. 43, no. 12, p. e14238, Dec. 2019.
https://doi.org/10.1111/jfpp.14238
M. Koklu and I. A. Ozkan, "Multiclass classification of dry beans using computer vision and machine learning techniques," Comput. Electron. Agric., vol. 174, p. 105507, Jul. 2020.
https://doi.org/10.1016/j.compag.2020.105507
S. A. Araújo, W. A. L. Alves, P. A. Belan, and K. P. Anselmo, "A Computer Vision System for Automatic Classification of Most Consumed Brazilian Beans," Lect. Notes Comput. Sci. (including Subser. Lect. Notes Artif. Intell. Lect. Notes Bioinformatics), vol. 9475, pp. 45-53, Dec. 2015.
https://doi.org/10.1007/978-3-319-27863-6_5
E. M. De Oliveira, D. S. Leme, B. H. G. Barbosa, M. P. Rodarte, and R. G. F. Alvarenga Pereira, "A computer vision system for coffee beans classification based on computational intelligence techniques," J. Food Eng., vol. 171, pp. 22-27, Feb. 2016.
https://doi.org/10.1016/j.jfoodeng.2015.10.009
F. A. Santos, A. M. P. Canuto, B. R. C. Bedregal, E. S. Palmeira, and I. N. P. Silva, "Supervised Methods Applied to the Construction of a Vision System for the Classification of Cocoa Beans in the Cut-Test," An. do Encontro Nac. Inteligência Artif. e Comput., pp. 72-83, Oct. 2019.
A. J. Ona Ona, F. Grijalva, K. Proano, B. Acuna, and M. Garcia, "Classification of fresh cocoa beans with pulp based on computer vision," 2020 IEEE ANDESCON, ANDESCON 2020, Oct. 2020.
https://doi.org/10.1109/ANDESCON50619.2020.9272188
R. M. Sakia, "The Box‐Cox transformation technique: a review," J. R. Stat. Soc. Ser. D …, 1992.
https://doi.org/10.2307/2348250
M. J. Gurka, L. J. Edwards, K. E. Muller, and L. L. Kupper, "Extending the Box-Cox transformation to the linear mixed model," J. R. Stat. Soc. Ser. A (Statistics Soc., vol. 169, no. 2, pp. 273-288, Mar. 2006.
https://doi.org/10.1111/j.1467-985X.2005.00391.x
J. Osborne, "Improving your data transformations: Applying the Box-Cox transformation," Pract. Assessment, Res. …, 2010.
M. Z. Hossain, "The use of Box-Cox transformation technique in economic and statistical analyses," J. Emerg. Trends Econ. …, 2011.
L. Wang, X. Zhou, X. Zhu, Z. Dong, and W. Guo, "Estimation of biomass in wheat using random forest regression algorithm and remote sensing data," Crop J., vol. 4, no. 3, pp. 212-219, Jun. 2016.
https://doi.org/10.1016/j.cj.2016.01.008
A. T. Azar, H. I. Elshazly, A. E. Hassanien, and A. M. Elkorany, "A random forest classifier for lymph diseases," Comput. Methods Programs Biomed., vol. 113, no. 2, pp. 465-473, Feb. 2014.
https://doi.org/10.1016/j.cmpb.2013.11.004
S. Vitrack-Tamam et al., "Random Forest Algorithm Improves Detection of Physiological Activity Embedded within Reflectance Spectra Using Stomatal Conductance as a Test Case," Remote Sens. 2020, Vol. 12, Page 2213, vol. 12, no. 14, p. 2213, Jul. 2020.
https://doi.org/10.3390/rs12142213
S. Agajanian, O. Oluyemi, and G. M. Verkhivker, "Integration of random forest classifiers and deep convolutional neural networks for classification and biomolecular modeling of cancer driver mutations," Front. Mol. Biosci., vol. 6, no. JUN, p. 44, 2019.
https://doi.org/10.3389/fmolb.2019.00044
C. L. Eng, J. C. Tong, and T. W. Tan, "Predicting host tropism of influenza A virus proteins using random forest," BMC Med. Genomics, vol. 7, no. 3, pp. 1-11, Dec. 2014.
https://doi.org/10.1186/1755-8794-7-S3-S1
S. Touzani, J. Granderson, and S. Fernandes, "Gradient boosting machine for modeling the energy consumption of commercial buildings," Energy Build., vol. 158, pp. 1533-1543, Jan. 2018.
https://doi.org/10.1016/j.enbuild.2017.11.039
Y. Zhang and A. Haghani, "A gradient boosting method to improve travel time prediction," Transp. Res. Part C Emerg. Technol., vol. 58, pp. 308-324, Sep. 2015.
https://doi.org/10.1016/j.trc.2015.02.019
C. Bentéjac, A. Csörgő, and G. Martínez-Muñoz, "A comparative analysis of gradient boosting algorithms," Artif. Intell. Rev. 2020 543, vol. 54, no. 3, pp. 1937-1967, Aug. 2020.
https://doi.org/10.1007/s10462-020-09896-5
G. Ke et al., "LightGBM: A Highly Efficient Gradient Boosting Decision Tree," Adv. Neural Inf. Process. Syst., vol. 30, 2017.
X. Ma, J. Sha, D. Wang, Y. Yu, Q. Yang, and X. Niu, "Study on a prediction of P2P network loan default based on the machine learning LightGBM and XGboost algorithms according to different high dimensional data cleaning," Electron. Commer. Res. Appl., vol. 31, pp. 24-39, Sep. 2018.
https://doi.org/10.1016/j.elerap.2018.08.002
D. Wang, Y. Zhang, and Y. Zhao, "LightGBM: An effective miRNA classification method in breast cancer patients," ACM Int. Conf. Proceeding Ser., pp. 7-11, Oct. 2017.
https://doi.org/10.1145/3155077.3155079
"UCI Machine Learning Repository: Dry Bean Dataset Data Set." [Online]. Available: https://archive.ics.uci.edu/ml/datasets/Dry+Bean+Dataset. [Accessed: 26-Nov-2021].
M. Pal, "Random forest classifier for remote sensing classification," http://dx.doi.org/10.1080/01431160412331269698, vol. 26, no. 1, pp. 217-222, Jan. 2007.
Copyright (c) 2022 Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi)
This work is licensed under a Creative Commons Attribution 4.0 International License.
Copyright in each article belongs to the author
- The author acknowledges that the RESTI Journal (System Engineering and Information Technology) is the first publisher to publish with a license Creative Commons Attribution 4.0 International License.
- Authors can enter writing separately, arrange the non-exclusive distribution of manuscripts that have been published in this journal into other versions (eg sent to the author's institutional repository, publication in a book, etc.), by acknowledging that the manuscript has been published for the first time in the RESTI (Rekayasa Sistem dan Teknologi Informasi) journal ;
