DEVELOPMENT OF A VIDEO PROCESSING MODULE FOR THE TASK OF AIR OBJECT RECOGNITION BASED ON THEIR CONTOURS
DOI:
https://doi.org/10.30837/ITSSI.2022.21.016Keywords:
image segmentation, background subtraction, recognition of air objects, optical monitoring of the air situationAbstract
The subject of research in the article is the module of automatic segmentation and subtraction of the background, which is created, based on the sequential application of methods of image preprocessing and modified method of interactive segmentation of images and implemented in the system of optical monitoring of the air situation. The aim of the work is to develop an image segmentation module to increase the efficiency of recognition of an air object type on a video image in the system of visual monitoring of the air environment by means of qualitative automatic segmentation. To solve this problem, a modified interactive algorithm in the mode of automatic selection of an object in the image, which allows more accurately, without the participation of the operator, to determine the foreground pixels of the image for further recognition of the type of airborne object. The following tasks are solved in the article: the analysis of existing methods of binarization of color images for semantic segmentation of images, which are used in image recognition systems; the development of a pipeline of methods for automatic segmentation of images in the system of optical monitoring of the air environment. In the work, the following methods are used: methods of digital image processing, methods of filtering and semantic segmentation of images, methods of graph analysis. The following results are obtained: the results of image processing with the proposed module of segmentation and background subtraction confirm the performance of the module procedures. The developed pipeline of methods included in the module demonstrates correct segmentation in 93% of test images in automatic mode without operator participation, which allows us to conclude about the effectiveness of the proposed module. Conclusions: The implementation of the developed module of segmentation and background subtraction for the system of optical monitoring of the air environment allowed to solve the problem of segmentation of video images for further recognition of aerial objects in the system of optical monitoring of the air environment in automatic mode with a high degree of reliability, thus increasing the operational efficiency of this system.
References
Yesilevskyi, V., Tevyashev, A., Koliadin, A. (2020), "A method of air object recognition based on the normalized contour descriptors and a complex-valued neural network", Eastern-European Journal of Enterprise Technologies, No. 6, Р. 48–57. DOI: 10.15587/1729-4061.2020.22003
Garcia-Garcia, B., Bouwmans, T., Rosales Silva, A. J. (2020), "Background subtraction in real applications: Challenges, current models and future directions", Computer Science Review, Vol. 35, P. 1–42. DOI: 10.1016/j.cosrev.2019.100204
Molloy, Timothy L., Jason, J. Ford and Luis Mejías Alvarez (2017), "Detection of aircraft below the horizon for
vision‐based detect and avoid in unmanned aircraft systems", Journal of Field Robotics, Vol. 34.Issue7, P. 1378–1391.
DOI: 10.1002/rob.21719
Huihui, Li, Xing, Jin, Ning Yang, Zhe Yang (2015), "The recognition of landed aircrafts based on PCNN model and
affine moment invariants", Pattern Recognition Letters, Vol. 51. P. 23–29. DOI: 10.1016/j.patrec.2014.07.021
Suzuki, S. (1985), "Topological structural analysis of digitized binary images by border following", Computer Vision, Graphics, and Image Processing, Vol. 30 (1), P. 32–46. DOI: 10.1016/0734-189X(85)90016-7
Neha, Sh., Vibhor, J., Anju, M. (2018), "An Analysis Of Convolutional Neural Networks For Image Classification",
Procedia Computer Science, No. 132, P. 377–384. DOI: 10.1016/j.procs.2018.05.198
Krizhevsky, A., Sutskever, I., Hinton, G. E. (2017), "ImageNet classification with deep convolutional neural networks", Commun. ACM 2017, No. 60, P. 84–90. DOI: 10.1145/3065386
Szegedy, C., Liu, W., Jia (2015), "Going deeper with convolutions", 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), P. 1–9. DOI: 10.1109/CVPR.2015.7298594
Yesilevskyi, V., Tevyashev, A., Koliadin, A. (2019), "Transfer learning in aircraft classification", Information systems
and technologies IST-2019, The 8-th International Scientific and Technical Conference September 9–14, Kobleve–Kharkiv, Ukraine, P. 132–135.
Ishchenko, A. (2019), "Development of an intelligent processing system module for scanned documents based on the
combined image segmentation method", Innovative Technologies and Scientific Solutions for Industries, No. 2 (8), P. 44–53. DOI: 10.30837/2522-9818.2019.8.044
Strotov, V., Babyan, P., Smirnov, S. (2017), "Аerial object recognition algorithm based on contour descriptor",
ISPRS – International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XLII-2/W4,
P. 91–95. DOI: 10.5194/isprs-archives-XLII-2-W4-91-2017
Thai, V.-P., Zhong, W., Pham, T., Alam, S., Duong, V. (2019), "Detection, Tracking and Classification of Aircraft and
Drones in Digital Towers Using Machine Learning on Motion Patterns", 2019 Integrated Communications, Navigation
and Surveillance Conference (ICNS), P. 1–8. DOI: 10.1109/ICNSURV.2019.8735240
Jie, Z. (2020), "An Aircraft Image Detection and Tracking Method Based on Improved Optical Flow Method", 2020 Chinese Automation Congress (CAC), P. 2512–2516. DOI: 10.1109/CAC51589.2020.9326473
Bengtsson, T., Mckelvey, T., Lindström, K. (2016), "On Robust Optical Flow Estimation on Image Sequences
with Differently Exposed Frames using Primal-Dual Optimization", Image and Vision Computing, No. 57. DOI: 10.1016/j.imavis.2016.11.003
Rashid, M., Thomas, V. (2016), "A Background Foreground Competitive Model for Background Subtraction in Dynamic Background", Procedia Technol, No. 25, P. 536–543. DOI:10.1016/j.protcy.2016.08.142
Sobral, A., Vacavant, A. (2014), "A comprehensive review of background subtraction algorithms evaluated with synthetic
and real videos", Comput. Vis. Image Underst, No. 122, P. 4–21. DOI: 10.1016/j.cviu.2013.12.005
Recommendation ITU-R BT.709-6 (2015), Parameter values for the HDTV standards for production and international programme exchange, 19 p.
Rother, C., Kolmogorov, V., Blake, A. (2004), "GrabCut": interactive foreground extraction using iterated graph cuts»,
ACM SIGGRAPH 2004 Papers, P. 309–314. DOI:10.1145/1186562.1015720
Downloads
Published
How to Cite
Issue
Section
License
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
Our journal abides by the Creative Commons copyright rights and permissions for open access journals.
Authors who publish with this journal agree to the following terms:
Authors hold the copyright without restrictions and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License (CC BY-NC-SA 4.0) that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
Authors are able to enter into separate, additional contractual arrangements for the non-commercial and non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
Authors are permitted and encouraged to post their published work online (e.g., in institutional repositories or on their website) as it can lead to productive exchanges, as well as earlier and greater citation of published work.
