INFORMATION TECHNOLOGY FOR RECOGNITION OF ROAD SIGNS USING A NEURAL NETWORK

Authors

DOI:

https://doi.org/10.30837/2522-9818.2019.8.130

Keywords:

image recognition, neural network, computer vision, information technology

Abstract

The subject of the study is the methods and tools for automation of recognition of road signs at the level of software implementation. Detection of road signs is associated with the processing of a significant amount of video data in real time, which requires significant computing power. Therefore, the purpose of the work is to automate the process of recognition of road signs for filling the databases of navigators, which will allow operatively provide drivers with up-to-date information on established road signs. The following tasks are solved: analysis of methods and software for image recognition; development of the search algorithm for characters in the video frame; implementation of the definition of the contour of the sign; realization of a convolutional neural network for recognition of a sign; testing of applied information technology work. Methods are used: convolutional neural networks;  Viola-Jones's method for recognizing objects in an image, the Bousting method as a way to accelerate the recognition process with a large amount of information. Results: Different approaches to the identification of symbols on images, various software tools for object recognition, image transformation for optimal fragment are considered. An algorithm for detecting and recognizing the sign is developed. Using the Viola-Jones method, a fast way to calculate the values of attributes using the integral representation of an image is implemented. The recognition process takes place by constructing a convolutional neural network. Features of the layers of the roller network are considered.  Schematically illustrated script recognition. The process of interaction of the system with different data sources is represented by a diagram of precedents. The main result is the creation of information technology for the automated recognition of road signs. The algorithm of its work is presented in the form of a sequence diagram. Conclusions. Using the applied application information technology, recognition of road signs is made with an average probability of 88%, which allows automating the process of filling the database of navigators to a large extent, to increase the reliability and productivity of the given process.

Author Biographies

Elena Yashina, National Aerospace N. E. Zhukovskiy University "Kharkov Aviation Institute"

PhD (Engineering Sciences), Associate Professor of the Department of Computer Science and Information Technologies

Roman Artiukh, State Enterprise "National Design & Research Institute of Aerospace Industries"

PhD (Engineering Sciences), Director

Nikolai Рan, O. M. Beketov National University of Urban Economy in Kharkiv

PhD (Engineering Sciences), Associate Professor, Associate Professor of the Department of Applied Mathematics and Information Technology

Andrei Zelensky, National Aerospace N. E. Zhukovskiy University "Kharkov Aviation Institute"

Student of Department of Computer Science and Information Technologies

References

Shneier, M. (2006), "Road sign detection and recognition", Unmanned Systems Technology VIII, International Society for Optics and Photonics, Vol. 6230 (623016). DOI: https://doi.org/10.1117/12.660219

Yakimov, P. Yu. (2013), "Preliminary processing of digital images in the systems of localization and recognition of road signs" ["Predvaritel'naya obrabotka tsifrovykh izobrazheniy v sistemakh lokalizatsii i raspoznavaniya dorozhnykh znakov. Komp'yuternaya optika"], Computer Optics, Vol. 37, No. 3. P. 401–405.

Malyeyeva, О., Nosova, N., Fedorovych, O., Kosenko, V. (2019), "The Semantic Network Creation for an Innovative Project Scope as a Part of Project Knowledge Ontology", CEUR Workshop Proceedings. Proceedings of the 3rd International Conference on Computational Linguistics and Intelligent Systems (COLINS-2019), Vol. I, P. 301–311.

Bolohova, N. Ruban, I. (2019), "Image processing models and methods research and ways of improving marker recognition technologies in added reality systems", Innovative Technologies and Scientific Solutions for Industries, No. 1 (7), P. 25–33. DOI: https://doi.org/10.30837/2522-9818.2019.7.025

Lisitsyn, S. O., Baida, O. A. (2012), "Recognition of road signs using the method of support vectors and histograms of oriented gradients" ["Raspoznavaniye dorozhnykh znakov s pomoshch'yu metoda opornykh vektorov i gistogramm oriyentirovannykh gradiyentov"], Computer optics, Vol. 36, No. 2, P. 289–295.

Zhu, Y., Zhang, C., Zhou, D., Wang, X., Bai, X., Liu, W. (2016), "Traffic sign detection and recognition using fully convolutional network guided proposals", Neurocomputing, Vol. 214, P. 758–766. DOI: http://dx.doi.org/10.1016/j.neucom.2016.07.009

Bodyanskiy, Y., Perova, I., Zhernova, P. (2019) "Online fuzzy clustering of high dimension data streams based on neural network ensembles", Innovative Technologies and Scientific Solutions for Industries, No. 1 (7), P. 16–24. DOI: https://doi.org/10.30837/2522-9818.2019.7.016

Chigorin, A. A., Konushin, A. S. (2013), "Experiments with learning methods for recognizing road signs on synthetic data" ["Eksperimenty s obucheniyem metodov raspoznavaniya dorozhnykh znakov na sinteticheskikh dannykh"], Science and education: a scientific publication MSTU. N.E. Bauman, No. 08, P. 315–324. DOI: https://doi.org/10.7463/0813.0603378, available at : https://bmstu.ru/doc/603378.html

Viola, P. A., Jones, M. J. (2004), "Robust real­time face detection", International journal of computer vision, Vol. 57, No. 2, P. 137–154.

LeCun, Y., Bengio, Y. (1994), "Word­level training of a handwritten word recognizer based on convolutional neural networks", Proceedings of the International Conference on Pattern Recognition, Jerusalem, Israel, Vol. 2, P. 88–92.

Lawrence, S., Giles, C. L., Tsoi, A. C., Back, A. D. (1997), "Face recognition: a convolutional neural network approach", IEEE Transactions on Neural Networks, Vol. 8, No. 1, P. 98–113.

Open Source Computer Vision, available at : https://docs.opencv.org/3.4/index.html

Kaehler, A., Bradski, G. (2016), Learning OpenCV 3: computer vision in C++ with the OpenCV library, Reilly Media, Inc., 1024 р.

Dergachev, K. Yu., Krasnov, L. A., Pyavka, I. A. (2018), "Analysis of the performance of technical vision algorithms in trajectory measurement problems" ["Analiz raboty algoritmov tekhnicheskogo zreniya v zadachakh trayektornykh izmereniy"], Electrotechnic and Computer Systems, No. 27 (103), P. 187–195. DOI: https://doi.org/10.15276/eltecs.27.103.2018.21

Yaloveha, V., Hlavcheva, D., Podorozhniak, A. (2019), "Usage of convolutional neural network for multispectral image processing applied to the problem of detecting fire hazardous forest areas", Advanced Information Systems, Vol. 3, No. 1, P. 116–120. DOI: https://doi.org/10.20998/2522-9052.2019.1.19

Krizhevsky, A., Sutskever, I., Hinton, G. E. (2012), ЄImagenet classification with deep convolutional neural networks", Advances in neural information processing systems, No. 25, P. 1097–1105.

Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., Darrell, T. (2014), "Caffe: Convolutional architecture for fast feature embedding", Proceedings of the 22nd ACM international conference on Multimedia, ACM, P. 675–678.

Downloads

Published

2019-06-24

How to Cite

Yashina, E., Artiukh, R., Рan N., & Zelensky, A. (2019). INFORMATION TECHNOLOGY FOR RECOGNITION OF ROAD SIGNS USING A NEURAL NETWORK. INNOVATIVE TECHNOLOGIES AND SCIENTIFIC SOLUTIONS FOR INDUSTRIES, (2 (8), 130–141. https://doi.org/10.30837/2522-9818.2019.8.130

Issue

Section

INFORMATION TECHNOLOGY