Image Preprocessing Approaches Toward Better Learning Performance with CNN
Abstract
Convolutional neural networks (CNNs) are at the forefront of computer vision, relying heavily on the quality of input data determined by the preprocessing method. An undue preprocessing approach will result in poor learning performance. This study critically examines the impact of advanced image pre-processing techniques on computational neural networks (CNNs) in facial recognition. Emphasizing the importance of data quality, we explore various pre-processing approaches, including noise reduction, histogram equalization, and image hashing. Our methodology involves feature visualization to improve facial feature discernment, training convergence analysis, and real-time model testing. The results demonstrate significant improvements in model performance with the preprocessed dataset: average accuracy, recall, precision, and F1 score enhancements of 4.17%, 3.45%, 3.45%, and 3.81%, respectively. Additionally, real-time testing shows a 21% performance increase and a 1.41% reduction in computing time. This study not only underscores the effectiveness of preprocessing in boosting CNN capabilities, but also opens avenues for future research in applying these methods to diverse image types and exploring various CNN architectures for comprehensive understanding.
Downloads
References
S. and Z. A. Razzak Muhammad Imran and Naz, “Deep Learning for Medical Image Processing: Overview, Challenges and the Future,” in Classification in BioApps: Automation of Decision Making, A. S. and B. S. Dey Nilanjan and Ashour, Ed., Cham: Springer International Publishing, 2018, pp. 323–350.
https://doi.org/10.1007/978-3-319-65981-7_12
H. P. Wei, Y. Y. Deng, F. Tang, X. J. Pan, and W. M. Dong, “A Comparative Study of CNN- and Transformer-Based Visual Style Transfer,” J Comput Sci Technol, vol. 37, no. 3, pp. 601–614, Jun. 2022.
https://doi.org/10.1007/s11390-022-2140-7
J. Naranjo-Torres, M. Mora, R. Hernández-García, R. J. Barrientos, C. Fredes, and A. Valenzuela, “A review of convolutional neural network applied to fruit image processing,” Applied Sciences (Switzerland), vol. 10, no. 10. MDPI AG, May 01, 2020.
https://doi.org/10.3390/app10103443
R. Zebari, A. Abdulazeez, D. Zeebaree, D. Zebari, and J. Saeed, “A Comprehensive Review of Dimensionality Reduction Techniques for Feature Selection and Feature Extraction,” Journal of Applied Science and Technology Trends, vol. 1, no. 2, pp. 56–70, May 2020.
https://doi.org/10.38094/jastt1224
S. Wei, S. Ji, and M. Lu, “Toward Automatic Building Footprint Delineation From Aerial Images Using CNN and Regularization,” IEEE Transactions on Geoscience and Remote Sensing, vol. 58, no. 3, pp. 2178–2189, 2020.
https://doi.org/10.1109/TGRS.2019.2954461
J. Waleed, S. Albawi, H. Q. Flayyih, and A. Alkhayyat, “An Effective and Accurate CNN Model for Detecting Tomato Leaves Diseases,” in 2021 4th International Iraqi Conference on Engineering Technology and Their Applications (IICETA), 2021, pp. 33–37.
https://doi.org/10.1109/IICETA51758.2021.9717816
Y. Sonawane, D. Khachane, and O. Khaire, “Classification of Plant Leaf Diseases Using Machine Learning and Image Preprocessing Techniques with Smart Agriculture,” International Journal of Scientific Research in Engineering and Management (IJSREM), vol. 06, no. 06, pp. 1–5, 2022.
https://doi.org/10.55041/IJSREM13932
F. A. Zeiser et al., “Segmentation of Masses on Mammograms Using Data Augmentation and Deep Learning,” J Digit Imaging, vol. 33, no. 4, pp. 858–868, 2020.
https://doi.org/10.1007/s10278-020-00330-4
L. Alzubaidi et al., “Review of deep learning: concepts, CNN architectures, challenges, applications, future directions,” J Big Data, vol. 8, no. 1, Dec. 2021.
https://doi.org/10.1186/s40537-021-00444-8
K. Maharana, S. Mondal, and B. Nemade, “A review: Data pre-processing and data augmentation techniques,” Global Transitions Proceedings, vol. 3, no. 1, pp. 91–99, Jun. 2022.
https://doi.org/10.1016/j.gltp.2022.04.020
H. Chougrad, H. Zouaki, and O. Alheyane, “Deep Convolutional Neural Networks for breast cancer screening,” Comput Methods Programs Biomed, vol. 157, pp. 19–30, 2018.
https://doi.org /10.1016/j.cmpb.2018.01.011
J. Liu, Y. Feng, and H. Wang, “Facial Expression Recognition Using Pose-Guided Face Alignment and Discriminative Features Based on Deep Learning,” IEEE Access, vol. 9, pp. 69267–69277, 2021.
https://doi.org/10.1109/ACCESS.2021.3078258
J. Liu, H. Wang, and Y. Feng, “An End-to-End Deep Model with Discriminative Facial Features for Facial Expression Recognition,” IEEE Access, vol. 9, pp. 12158–12166, 2021.
https://doi.org/10.1109/ACCESS.2021.3051403
S. J. Elias et al., “Face recognition attendance system using local binary pattern (LBP),” Bulletin of Electrical Engineering and Informatics, vol. 8, no. 1, pp. 239–245, Mar. 2019.
https://doi.org/10.11591/eei.v8i1.1439
M. O. Oloyede, G. P. Hancke, and H. C. Myburgh, “Improving face recognition systems using a new image enhancement technique, hybrid features and the convolutional neural network,” IEEE Access, vol. 6, pp. 75181–75191, 2018.
https://doi.org/10.1109/ACCESS.2018.2883748
R. Ullah et al., “A Real-Time Framework for Human Face Detection and Recognition in CCTV Images,” Math Probl Eng, vol. 2022, 2022.
https://doi.org/10.1155/2022/3276704
J. Zeng, X. Qiu, and S. Shi, “Image processing effects on the deep face recognition system,” Mathematical Biosciences and Engineering, vol. 18, no. 2, pp. 1187–1200, 2021.
https://doi.org/10.3934/MBE.2021064
L. Rai, Z. Wang, A. Rodrigo, Z. Deng, and H. Liu, “Software development framework for real-time face detection and recognition in mobile devices,” International Journal of Interactive Mobile Technologies, vol. 14, no. 4, pp. 103–120, 2020.
https://doi.org/10.3991/IJIM.V14I04.12077
B. Qin, L. Liang, J. Wu, Q. Quan, Z. Wang, and D. Li, “Automatic identification of Down syndrome using facial images with deep convolutional neural network,” Diagnostics, vol. 10, no. 7, Jul. 2020.
https://doi.org/10.3390/diagnostics10070487
T. Hussain et al., “Internet of Things with Deep Learning-Based Face Recognition Approach for Authentication in Control Medical Systems,” Comput Math Methods Med, vol. 2022, 2022.
https://doi.org/10.1155/2022/5137513
D. S. AbdELminaam, A. M. Almansori, M. Taha, and E. Badr, “A deep facial recognition system using computational intelligent algorithms,” PLoS One, vol. 15, no. 12 December, Dec. 2020.
https://doi.org/10.1371/journal.pone.0242269
X. Liu, Y. Zou, H. Kuang, and X. Ma, “Face image age estimation based on data augmentation and lightweight convolutional neural network,” Symmetry (Basel), vol. 12, no. 1, 2020.
https://doi.org/10.3390/SYM12010146
M. S. Hadis, J. Akita, M. Toda, and Nurzaenab, “The Impact of Preprocessing on Face Recognition using Pseudorandom Pixel Placement,” in 2022 29th International Conference on Systems, Signals and Image Processing (IWSSIP), 2022, pp. 1–5.
https://doi.org/10.1109/IWSSIP55020.2022.9854474
I. Ahmad, I. Moon, and S. J. Shin, “Color-to-grayscale algorithms effect on edge detection — A comparative study,” in 2018 International Conference on Electronics, Information, and Communication (ICEIC), 2018, pp. 1–4
https://doi.org/10.23919/ELINFOCOM.2018.8330719
Shaik, G. Azeem, and E. C. Jones, “Image Classification Using Deep Learning Architecture-EfficientNET for COVID-19 Medicine Consumption,” International Supply Chain Technology Journal, vol. 7, no. 07, 2021.
https://doi.org/10.20545/isctj.v07.i07.01
T. Ayyavoo and J. J. Suseela, “Illumination pre-processing method for face recognition using 2D DWT and CLAHE,” in IET Biometrics, Institution of Engineering and Technology, Jul. 2018, pp. 380–390.
https://doi.org/10.1049/iet-bmt.2016.0092
L. Alzubaidi et al., “Review of deep learning: concepts, CNN architectures, challenges, applications, future directions,” J Big Data, vol. 8, no. 1, Dec. 2021.
https://doi.org/10.1186/s40537-021-00444-8
A. Taner, Y. B. Öztekin, and H. Duran, “Performance analysis of deep learning cnn models for variety classification in Hazelnut,” Sustainability (Switzerland), vol. 13, no. 12, Jun. 2021. https://doi.org/10.3390/su13126527
M. Heidari, S. Mirniaharikandehei, A. Z. Khuzani, G. Danala, Y. Qiu, and B. Zheng, “Improving the performance of CNN to predict the likelihood of COVID-19 using chest X-ray images with preprocessing algorithms,” Int J Med Inform, vol. 144, Dec. 2020.
https://doi.org/10.1016/j.ijmedinf.2020.104284
R. Chelghoum, A. Ikhlef, A. Hameurlaine, and S. Jacquir, “Transfer learning using convolutional neural network architectures for brain tumour classification from MRI images,” in IFIP Advances in Information and Communication Technology, Springer, 2020, pp. 189–200.
https://doi.org/10.1007/978-3-030-49161-1_17
S. Saponara, A. Elhanashi, and A. Gagliardi, “Real-time video fire/smoke detection based on CNN in antifire surveillance systems,” J Real-Time Image Process, vol. 18, no. 3, pp. 889–900, Jun. 2021.
Copyright (c) 2024 Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi)
This work is licensed under a Creative Commons Attribution 4.0 International License.
Copyright in each article belongs to the author
- The author acknowledges that the RESTI Journal (System Engineering and Information Technology) is the first publisher to publish with a license Creative Commons Attribution 4.0 International License.
- Authors can enter writing separately, arrange the non-exclusive distribution of manuscripts that have been published in this journal into other versions (eg sent to the author's institutional repository, publication in a book, etc.), by acknowledging that the manuscript has been published for the first time in the RESTI (Rekayasa Sistem dan Teknologi Informasi) journal ;
