Devising a method for processing the image of a vehicle's license plate when shooting with a smartphone camera

Authors

DOI:

https://doi.org/10.15587/1729-4061.2022.252310

Keywords:

image processing, license plate, vehicle, character recognition, smartphone camera

Abstract

This paper reports an improved method for processing the image of a vehicle's license plate when shooting with a smartphone camera. The method for processing the image of a vehicle's license plate includes the following stages:

– enter the source data; 

– split the video streaming into frames; 

– preliminary process the image of a vehicle's license plate;

– find the area of a vehicle's license plate;

– refine character recognition using the signature of a vehicle's license plate; 

– refine character recognition using the combined results from frames in the streaming video; 

– obtain the result of processing.

Experimental studies were conducted on the processing of images of a vehicle's license plate. During the experimental studies, the license plate of a military vehicle (Ukraine) was considered. The original image was the color image of a vehicle. The results of experimental studies are given. A comparison of the quality of character recognition in a license plate has been carried out. It was established that the improved method that uses the combined results from streaming video frames works out efficiently at the end of the sequence. The improved method that employs the combined results from streaming video frames operates with numerical probability vectors.

The assessment of errors of the first and second kind in processing the image of a license plate was carried out. The total accuracy of finding the area of a license plate by known method is 61 % while the improved method's result is 76 %. It has been established that the minimization of errors of the first kind is more important than reducing errors of the second kind. If a license plate is incorrectly identified, these results would certainly be discarded at the character recognition stage.

Author Biographies

Hennadii Khudov, Ivan Kozhedub Kharkiv National Air Force University

Doctor of Technical Sciences, Professor, Head of Department

Department of Radar Troops Tactic

Oleksandr Makoveichuk, Kharkiv National University of Radio Electronics

Doctor of Technical Sciences, Associate Professor

Department of Electronic Computers

Dmytro Misiuk, Ivan Kozhedub Kharkiv National Air Force University

Lecturer

Department of Tactical and Tactical Special Training

Hennadii Pievtsov, Ivan Kozhedub Kharkiv National Air Force University

Doctor of Technical Sciences, Professor, Deputy Head of Science

Irina Khizhnyak, Ivan Kozhedub Kharkiv National Air Force University

PhD

Department of Radar Troops Tactic

Yuriy Solomonenko, Ivan Kozhedub Kharkiv National Air Force University

PhD, Deputy Head of Department

Department of Radar Troops Tactic

Iryna Yuzova, Civil Aviation Institute

PhD, Lecturer

Department of Information Technologies

Volodymyr Cherneha, The National Defence University of Ukraine named after Ivan Cherniakhovskyi

PhD, Associate Professor

Department of Information Technology and Information Security

Valerii Vlasiuk, National Academy of the National Guard of Ukraine

PhD, Associate Professor

Department of Tactics

Vladyslav Khudov, Kharkiv National University of Radio Electronics

PhD, Junior Researcher

Department of Information Technology Security

References

  1. OSCE Special Monitoring Mission to Ukraine (SMM) Daily Report 11/2022 issued on 18 January 2022. Organization for Security and Co-operation in Europe. Available at: https://www.osce.org/special-monitoring-mission-to-ukraine/510200
  2. Nechepurenko, I., Higgins, A. (2022). In Kazakhstan’s Street Battles, Signs of Elites Fighting Each Other. The New York Times. Available at: https://www.nytimes.com/2022/01/07/world/asia/kazakhstan-protests.html
  3. Lee, H., Kim, D., Kim, D., Bang, S. Y. (2003). Real-Time Automatic Vehicle Management System Using Vehicle Tracking and Car Plate Number Identification. 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698). doi: https://doi.org/10.1109/icme.2003.1221626
  4. Kirpichnikov, A. P., Lyasheva, S. A., Obukhov, A. V., Shleymovich, M. P. (2015). Avtomaticheskoe raspoznavanie avtomobil'nyh nomerov. Vestnik tekhnologicheskogo universiteta, 18 (4), 218–222. Available at: https://cyberleninka.ru/article/n/avtomaticheskoe-raspoznavanie-avtomobilnyh-nomerov
  5. Viola, P., Jones, M. (2001). Rapid Object Detection Using a Boosted Cascade of Simple Features. Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001. doi: https://doi.org/10.1109/cvpr.2001.990517
  6. Gholami, R., Fakhari, N. (2017). Support Vector Machine: Principles, Parameters, and Applications. Handbook of Neural Computation, 515–535. doi: https://doi.org/10.1016/b978-0-12-811318-9.00027-2
  7. Awad, M., Khanna, R. (2015). Support Vector Machines for Classification. Efficient Learning Machines, 39–66. doi: https://doi.org/10.1007/978-1-4302-5990-9_3
  8. Jun, Z. (2021). The Development and Application of Support Vector Machine. Journal of Physics: Conference Series, 1748 (5), 052006. doi: https://doi.org/10.1088/1742-6596/1748/5/052006
  9. Hung, K.-M., Hsieh, C.-T. (2010). A Real-Time Mobile Vehicle License Plate Detection and Recognition. Tamkang Journal of Science and Engineering, 13 (4), 433–442. doi: https://doi.org/10.6180/jase.2010.13.4.09
  10. Hassanein, A. S., Mohammad, S., Sameer, M., Ragab, M. E. (2015). A Survey on Hough Transform, Theory, Techniques and Applications. International Journal of Computer Science Issues, 12 (1 (2)), 139–156. Available at: https://www.researchgate.net/publication/272195556_A_Survey_on_Hough_Transform_Theory_Techniques_and_Applications
  11. Ruban, I., Khudov, H., Makoveichuk, O., Khizhnyak, I., Lukova-Chuiko, N., Pevtsov, H. et. al. (2019). Method for determining elements of urban infrastructure objects based on the results from air monitoring. Eastern-European Journal of Enterprise Technologies, 4 (9 (100)), 52–61. doi: https://doi.org/10.15587/1729-4061.2019.174576
  12. Yoo, S. B., Han, M. (2020). Temporal matching prior network for vehicle license plate detection and recognition in videos. ETRI Journal, 42 (3), 411–419. doi: https://doi.org/10.4218/etrij.2019-0245
  13. Wang, D., Tian, Y., Geng, W., Zhao, L., Gong, C. (2020). LPR-Net: Recognizing Chinese license plate in complex environments. Pattern Recognition Letters, 130, 148–156. doi: https://doi.org/10.1016/j.patrec.2018.09.026
  14. Li, H., Wang, P., Shen, C. (2019). Toward End-to-End Car License Plate Detection and Recognition With Deep Neural Networks. IEEE Transactions on Intelligent Transportation Systems, 20 (3), 1126–1136. doi: https://doi.org/10.1109/tits.2018.2847291
  15. Raghunandan, K. S., Shivakumara, P., Jalab, H. A., Ibrahim, R. W., Kumar, G. H., Pal, U., Lu, T. (2018). Riesz Fractional Based Model for Enhancing License Plate Detection and Recognition. IEEE Transactions on Circuits and Systems for Video Technology, 28 (9), 2276–2288. doi: https://doi.org/10.1109/tcsvt.2017.2713806
  16. Chen, S.-L., Tian, S., Ma, J.-W., Liu, Q., Yang, C., Chen, F., Yin, X.-C. (2021). End-to-end trainable network for degraded license plate detection via vehicle-plate relation mining. Neurocomputing, 446, 1–10. doi: https://doi.org/10.1016/j.neucom.2021.03.040
  17. Astawa, I., Gusti Ngurah Bagus Caturbawa, I., Made Sajayasa, I., Made Ari Dwi Suta Atmaja, I. (2018). Detection of License Plate using Sliding Window, Histogram of Oriented Gradient, and Support Vector Machines Method. Journal of Physics: Conference Series, 953, 012062. doi: https://doi.org/10.1088/1742-6596/953/1/012062
  18. Zhao, Y., Gu, J., Liu, C., Han, S., Gao, Y., Hu, Q. (2010). License Plate Location Based on Haar-Like Cascade Classifiers and Edges. 2010 Second WRI Global Congress on Intelligent Systems. doi: https://doi.org/10.1109/gcis.2010.55
  19. Gou, C., Wang, K., Yao, Y., Li, Z. (2016). Vehicle License Plate Recognition Based on Extremal Regions and Restricted Boltzmann Machines. IEEE Transactions on Intelligent Transportation Systems, 17 (4), 1096–1107. doi: https://doi.org/10.1109/tits.2015.2496545
  20. Khan, K., Imran, A., Rehman, H. Z. U., Fazil, A., Zakwan, M., Mahmood, Z. (2021). Performance enhancement method for multiple license plate recognition in challenging environments. EURASIP Journal on Image and Video Processing, 2021 (1). doi: https://doi.org/10.1186/s13640-021-00572-4
  21. Khudov, H., Khudov, V., Yuzova, I., Solomonenko, Y., Khizhnyak, I. (2021). The Method of Determining the Elements of Urban Infrastructure Objects Based on Hough Transformation. Studies in Systems, Decision and Control, 247–265. doi: https://doi.org/10.1007/978-3-030-87675-3_15
  22. Stepanenko, A., Oliinyk, A., Deineha, L., Zaiko, T. (2018). Development of the method for decomposition of superpositions of unknown pulsed signals using the second­order adaptive spectral analysis. Eastern-European Journal of Enterprise Technologies, 2 (9 (92)), 48–54. doi: https://doi.org/10.15587/1729-4061.2018.126578
  23. Ruban, I., Khudov, H. (2019). Swarm Methods of Image Segmentation. Studies in Computational Intelligence, 53–99. doi: https://doi.org/10.1007/978-3-030-35480-0_2
  24. Ruban, I., Khudov, H., Makoveichuk, O., Khizhnyak, I., Khudov, V., Podlipaiev, V. et. al. (2019). Segmentation of optical-electronic images from on-board systems of remote sensing of the earth by the artificial bee colony method. Eastern-European Journal of Enterprise Technologies, 2 (9 (98)), 37–45. doi: https://doi.org/10.15587/1729-4061.2019.161860
  25. Dorigo, M., Stützle, T. (2018). Ant Colony Optimization: Overview and Recent Advances. International Series in Operations Research & Management Science, 311–351. doi: https://doi.org/10.1007/978-3-319-91086-4_10
  26. Ruban, I., Khudov, H., Makoveichuk, O., Chomik, M., Khudov, V., Khizhnyak, I. et. al. (2019). Construction of methods for determining the contours of objects on tonal aerospace images based on the ant algorithms. Eastern-European Journal of Enterprise Technologies, 5 (9 (101)), 25–34. doi: https://doi.org/10.15587/1729-4061.2019.177817
  27. Khudov, H., Oleksenko, O., Lukianchuk, V., Herasymenko, V., Yaroshenko, Y. et. al. (2021). The Determining the Flight Routes of Unmanned Aerial Vehicles Groups Based on Improved Ant Colony Algorithms. International Journal of Emerging Technology and Advanced Engineering, 11 (9), 23–32. doi: https://doi.org/10.46338/ijetae0921_03
  28. Gonzalez, R. C., Woods, R. E. (2018). Digital Image Processing. Pearson. Available at: https://www.codecool.ir/extra/2020816204611411Digital.Image.Processing.4th.Edition.www.EBooksWorld.ir.pdf
  29. Khudov, H., Ruban, I., Makoveichuk, O., Pevtsov, H., Khudov, V., Khizhnyak, I. et. al. (2020). Development of methods for determining the contours of objects for a complex structured color image based on the ant colony optimization algorithm. EUREKA: Physics and Engineering, 1, 34–47. doi: https://doi.org/10.21303/2461-4262.2020.001108
  30. Top-hat transform. Wikipedia. Available at: https://en.wikipedia.org/wiki/Top-hat_transform
  31. Choudhary, R., Gupta, R. (2017). Recent Trends and Techniques in Image Enhancement using Differential Evolution- A Survey. International Journal of Advanced Research in Computer Science and Software Engineering, 7 (4), 106–112. doi: https://doi.org/10.23956/ijarcsse/v7i4/0108
  32. Tesseract Open Source OCR Engine (main repository). Available at: https://github.com/tesseract-ocr/tesseract
  33. Hunter LPR Prohramnyi modul dlia rozpiznavannia avtomobilnykh nomeriv. Available at: https://elsy.com.ua/uk/videoanalitika/13-hunter-lpr-programnij-modul-dlya-rozpiznavannya-avtomobilnikh-nomeriv.html

Downloads

Published

2022-02-25

How to Cite

Khudov, H., Makoveichuk, O., Misiuk, D., Pievtsov, H., Khizhnyak, I., Solomonenko, Y., Yuzova, I., Cherneha, V., Vlasiuk, V., & Khudov, V. (2022). Devising a method for processing the image of a vehicle’s license plate when shooting with a smartphone camera . Eastern-European Journal of Enterprise Technologies, 1(2(115), 6–21. https://doi.org/10.15587/1729-4061.2022.252310

Issue

Vol. 1 No. 2(115) (2022): Information technology. Industry control systems

Section

Information technology

License

Copyright (c) 2022 Hennadii Khudov, Oleksandr Makoveichuk, Dmytro Misiuk, Hennadii Pievtsov, Irina Khizhnyak, Yuriy Solomonenko, Iryna Yuzova, Volodymyr Cherneha, Valerii Vlasiuk, Vladyslav Khudov

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

The consolidation and conditions for the transfer of copyright (identification of authorship) is carried out in the License Agreement. In particular, the authors reserve the right to the authorship of their manuscript and transfer the first publication of this work to the journal under the terms of the Creative Commons CC BY license. At the same time, they have the right to conclude on their own additional agreements concerning the non-exclusive distribution of the work in the form in which it was published by this journal, but provided that the link to the first publication of the article in this journal is preserved.

A license agreement is a document in which the author warrants that he/she owns all copyright for the work (manuscript, article, etc.).
The authors, signing the License Agreement with TECHNOLOGY CENTER PC, have all rights to the further use of their work, provided that they link to our edition in which the work was published.
According to the terms of the License Agreement, the Publisher TECHNOLOGY CENTER PC does not take away your copyrights and receives permission from the authors to use and dissemination of the publication through the world's scientific resources (own electronic resources, scientometric databases, repositories, libraries, etc.).
In the absence of a signed License Agreement or in the absence of this agreement of identifiers allowing to identify the identity of the author, the editors have no right to work with the manuscript.
It is important to remember that there is another type of agreement between authors and publishers – when copyright is transferred from the authors to the publisher. In this case, the authors lose ownership of their work and may not use it in any way.