Automated Indonesian Plate Recognition: YOLOv8 Detection and TensorFlow-CNN Character Classification
Abstract
The precise identification and reading of Indonesian vehicle number plates are important in many areas, including the enforcement of law, collection of charges, management of parking areas, and safety measures. This study integrates the implementation of the YOLOv8 object detection algorithm with three OCR methods: EasyOCR, TesseractOCR, and TensorFlow. YOLOv8 is capable of identifying license plates from images and videos at a high speed and reliability under different conditions and therefore is used in this study to perform plate detection in images and videos. After licenses are detected, OCR techniques are performed to segment and read the letters. Both EasyOCR and TesseractOCR performed moderately well on static images achieving accuracy rates of 70% and 68% respectively, but both suffered significantly lower performance in video scenarios. Of the 100 video frames, EasyOCR was able to correctly identify characters in 61 frames and TesseractOCR in 58 frames, while the TensorFlow-based model outperformed the other two with 75 correct recognitions. Furthermore, easy OCR and static images as input while the TensorFlow-based models completed them with 100% accuracy. This observation can be explained by its design, which utilizes a CNN with ReLU activation and Softmax outputs, trained on 10,261 annotated characters and was enhanced with five different data augmentation techniques. The model shows strong performance in its ability to handle dynamic conditions such as motion blur, changing light conditions, and rotation of the plate angle. The results underscore the drawbacks of one-size-fits-all OCR applications in real-world use cases and stress the need for bespoke model training, as well as hierarchical contouring, in the context of automatic license plate recognition (ALPR). This study provides additional insights into ALPR systems by delivering a robust, scalable, and real-time tool for plate and character recognition, which is essential for intelligent transportation systems.
Downloads
References
P. R. K. Varma, S. Ganta, B. K. H., and P. Svsrk, “A novel method for Indian vehicle registration number plate detection and recognition using image processing techniques,” Procedia Computer Science, vol. 167, pp. 2623–2633, 2020, doi: 10.1016/j.procs.2020.03.324.
K. Anusha, S. Nachiyappan, M. Braveen, K. V. Pradeep, and S. R. Yarlagadda, “A simple number plate detection technique with support vector machine for on-road vehicles,” in 2022 International Virtual Conference on Power Engineering Computing and Control (PECCON), Chennai, India, May 2022, pp. 1–6. doi: 10.1109/PECCON55017.2022.9851000.
R. Boliwala and M. Pawar, “Automatic number plate detection for varying illumination conditions,” in 2016 International Conference on Communication and Signal Processing (ICCSP), Melmaruvathur, India, Apr. 2016, pp. 658–661. doi: 10.1109/ICCSP.2016.7754224.
R. R. Chandrika and others, “Number plate recognition using OpenCV,” in 2024 International Conference on Emerging Smart Computing and Informatics (ESCI), Pune, India, Mar. 2024, pp. 1–4. doi: 10.1109/ESCI59607.2024.10497253.
Y. P. Pasrun, M. Muchtar, A. N. Basyarah, and Noorhasanah, “Indonesian license plate detection using morphological operation,” IOP Conference Series: Materials Science and Engineering, vol. 797, no. 1, p. 012037, Mar. 2020, doi: 10.1088/1757-899X/797/1/012037.
I. M. Gorovyi and I. O. Smirnov, “Robust number plate detector based on stroke width transform and neural network,” in 2015 Signal Processing Symposium (SPSympo), Debe, Poland, Jun. 2015, pp. 1–4. doi: 10.1109/SPS.2015.7168289.
G. Kothai, E. Povammal, A. S., and D. V., “An efficient deep learning approach for automatic license plate detection with novel feature extraction,” Procedia Computer Science, vol. 235, pp. 2822–2832, 2024, doi: 10.1016/j.procs.2024.04.267.
A. C. Bukola, P. A. Owolawi, C. Du, and E. Van Wyk, “A systematic review and comparative analysis approach to boom gate access using plate number recognition,” Computers, vol. 13, no. 11, p. 286, Nov. 2024, doi: 10.3390/computers13110286.
N. Supriya and others, “An efficient license plate recognition model through deep learning integration with YOLO and OCR techniques,” in 2024 International Conference on Advances in Modern Age Technologies for Health and Engineering Sciences (AMATHE), Shivamogga, India, May 2024, pp. 1–5. doi: 10.1109/AMATHE61652.2024.10582121.
A. U. Nawawi and others, “Automatic license plate recognition: Automated tax verification for registered vehicles via SAMBARA server,” in 2024 10th International Conference on Wireless and Telematics (ICWT), Batam, Indonesia, Jul. 2024, pp. 1–5. doi: 10.1109/ICWT62080.2024.10674718.
J. Joshua, J. Hendryli, and D. E. Herwindiati, “Automatic license plate recognition for parking system using convolutional neural networks,” in 2020 International Conference on Information Management and Technology (ICIMTech), Bandung, Indonesia, Aug. 2020, pp. 71–74. doi: 10.1109/ICIMTech50083.2020.9211173.
I. Varalakshmi, M. K. Santhoshi, and S. Swetha, “Automatic number plate recognition system using deep learning YOLOv5 algorithm,” in 2023 International Conference on System, Computation, Automation and Networking (ICSCAN), Puducherry, India, Nov. 2023, pp. 1–6. doi: 10.1109/ICSCAN58655.2023.10395604.
D. R. Vedhaviyassh and others, “Comparative analysis of EasyOCR and TesseractOCR for automatic license plate recognition using deep learning algorithm,” in 2022 6th International Conference on Electronics, Communication and Aerospace Technology (ICECA), Coimbatore, India, Dec. 2022, pp. 966–971. doi: 10.1109/ICECA55336.2022.10009215.
A. Fathi, B. Moradi, I. Zarei, and A. Shirbandi, “Deep learning-based system for automatic motorcycle license plates detection and recognition,” Signal, Image and Video Processing, vol. 18, no. 12, pp. 8869–8879, Dec. 2024, doi: 10.1007/s11760-024-03514-5.
H. Shi and D. Zhao, “License plate recognition system based on improved YOLOv5 and GRU,” IEEE Access, vol. 11, pp. 10429–10439, 2023, doi: 10.1109/ACCESS.2023.3240439.
A. Kathirvel and others, “Systematic number plate detection using improved YOLOv5 detector,” in 2023 2nd International Conference on Vision Towards Emerging Trends in Communication and Networking Technologies (ViTECoN), Vellore, India, May 2023, pp. 1–6. doi: 10.1109/ViTECoN58111.2023.10157727.
D. U. Nayak and others, “SecurePark: Vehicle intrusion detection system,” in 2021 Asian Conference on Innovation in Technology (ASIANCON), Pune, India, Aug. 2021, pp. 1–6. doi: 10.1109/ASIANCON51346.2021.9544923.
X. Li, “Real-time license plate number detection based on image contour,” Journal of Physics: Conference Series, vol. 1650, no. 3, p. 032073, Oct. 2020, doi: 10.1088/1742-6596/1650/3/032073.
A. D. Iriawan and A. Sunyoto, “Automatic license plate recognition system in Indonesia using YOLOv8 and EasyOCR algorithm,” in 2023 6th International Conference on Information and Communications Technology (ICOIACT), Yogyakarta, Indonesia, Nov. 2023, pp. 384–388. doi: 10.1109/ICOIACT59844.2023.10455908.
S. Khan and others, “A computer vision-based vehicle detection system leveraging deep learning,” in 2024 IEEE 1st Karachi Section Humanitarian Technology Conference (KHI-HTC), Tandojam, Pakistan, Jan. 2024, pp. 1–7. doi: 10.1109/KHI-HTC60760.2024.10482163.
U. L. Yuhana, G. Edo, and H. Syarif, “Enhancement of blurred Indonesian license plate number identification using multi-scale information CNN,” in 2023 3rd International Conference on Smart Generation Computing, Communication and Networking (SMART GENCON), Bangalore, India, Dec. 2023, pp. 1–6. doi: 10.1109/SMARTGENCON60755.2023.10442912.
A. T. Musaddid, A. Bejo, and R. Hidayat, “Improvement of character segmentation for Indonesian license plate recognition algorithm using CNN,” in 2019 International Seminar on Research of Information Technology and Intelligent Systems (ISRITI), Yogyakarta, Indonesia, Dec. 2019, pp. 279–283. doi: 10.1109/ISRITI48646.2019.9034614.
I. W. Notonogoro, Jondri, and A. Arifianto, “Indonesian license plate recognition using convolutional neural network,” in 2018 6th International Conference on Information and Communication Technology (ICoICT), Bandung, Indonesia, May 2018, pp. 366–369. doi: 10.1109/ICoICT.2018.8528761.
S. J. Fusic, S. Karthikeyan, H. Ramesh, and A. Subbiah, “Vehicle license plate detection and recognition using neural network,” in 2020 4th International Conference on Computing, Communication and Signal Processing (ICCCSP), Chennai, India, Sep. 2020, pp. 1–5. doi: 10.1109/ICCCSP49186.2020.9315206.
A. Rocque and others, “Enhancing traffic violation enforcement: A system utilizing helmet and number plate detection,” in 2023 OITS International Conference on Information Technology (OCIT), Raipur, India, Dec. 2023, pp. 598–604. doi: 10.1109/OCIT59427.2023.10431231.
C. K. Sahu and others, “A comparative analysis of deep learning approach for automatic number plate recognition,” in 2020 4th International Conference on I-SMAC (IoT in Social, Mobile, Analytics and Cloud) (I-SMAC), Palladam, India, Oct. 2020, pp. 932–937. doi: 10.1109/I-SMAC49090.2020.9243424.
A. C. Jeba Malar and others, “Automatic number plate recognition system using deep learning algorithms and image processing for surveillance,” in 2024 9th International Conference on Science, Technology, Engineering and Mathematics (ICONSTEM), Chennai, India, Apr. 2024, pp. 1–5. doi: 10.1109/ICONSTEM60960.2024.10568583.
Copyright (c) 2025 Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi)
This work is licensed under a Creative Commons Attribution 4.0 International License.
Copyright in each article belongs to the author
- The author acknowledges that the RESTI Journal (System Engineering and Information Technology) is the first publisher to publish with a license Creative Commons Attribution 4.0 International License.
- Authors can enter writing separately, arrange the non-exclusive distribution of manuscripts that have been published in this journal into other versions (eg sent to the author's institutional repository, publication in a book, etc.), by acknowledging that the manuscript has been published for the first time in the RESTI (Rekayasa Sistem dan Teknologi Informasi) journal ;
