Intelligent assistance system for people with visual impairments

Authors

DOI:

https://doi.org/10.30837/2522-9818.2024.28.006

Keywords:

system; assistant; vision; LiDAR; video; trajectory; prediction; intelligent system; recognition; classification.

Abstract

 

Subject of the Research: The creation of an intelligent assistance system for people with visual impairments. Nowadays, the task of developing effective intelligent assistance systems that allow people with vision problems to achieve maximum independence is important and relevant, as existing systems have a number of drawbacks, such as limited autonomy, limited integration with other devices and systems, limited analysis of dynamic obstacles, and limited user feedback capabilities, which in most cases are restricted to voice guidance. Objective: The objective of this work is to create a generalized functional model of an intelligent assistance system for people with visual impairments, which has enhanced autonomy, integration with other devices and systems, the ability to analyze dynamic objects and predict their movement trajectory, and provide diverse feedback to the user. Tasks: To achieve the set objective, the following tasks were accomplished: a generalized functional model of the proposed intelligent assistance system for people with visual impairments was created; the functional dependencies of the components of the developed model were substantiated; a review of the basic modules of the proposed system model was conducted. Methods: The methods used include functional modeling methods and system analysis methods. Results: The following results were obtained: a functional model of an intelligent assistance system for people with visual impairments was proposed. This system surpasses existing analogs in a number of functional capabilities: detection of static and dynamic obstacles with prediction of dynamic obstacles’ movement trajectory, the ability to operate in various conditions (indoors, outdoors, in light or dark, in different weather conditions), support for integration with other systems and devices, and a high level of autonomy. Conclusions: The developed system model has enhanced autonomy, integration with other devices and systems, the ability to analyze dynamic objects and predict their movement trajectory, and provides diverse feedback to the user.

Author Biographies

Olessia Barkovska, Kharkiv National University of Radio Electronics

PhD (Engineering Sciences), Docent, Associate Professor at the Department of Electronic Computers

Vitalii Serdechnyi, Kharkiv National University of Radio Electronics

PhD student at the Department of Electronic Computers

References

References

IAPB (2020), "Global Estimates of Vision Loss. The International Agency for the Prevention of Blindness", available at: https://www.iapb.org/learn/vision-atlas/magnitude-and-projections/global/ (last accessed 25 March 2024).

WHO (2023), "Blindness and vision impairment. World Health Organization", available at: https://www.who.int/news-room/fact-sheets/detail/blindness-and-visual-impairment (last accessed 25 March 2024).

Lynsey, K. Romo,1, Cimmiaron, Alvarez, Melissa, J. Taussig (2023), "An examination of visually impaired individuals communicative negotiation of face threats", Journal of Social and Personal RelationshipsVolume 40, Issue 1, January 2023, DOI: https://doi.org/10.1177/02654075221114048

Samyak, Lalit, Wecapable (2021), "Daily Life Problems, Struggle and Challenges Faced by Blind People. Wecapable", available at: https://wecapable.com/problems-faced-by-blind-people/ (last accessed 25 March 2024)

Shubham, Melvin Felix, Sumer, Kumar, A. Veeramuthu (2018), "A Smart Personal AI Assistant for Visually Impaired People", Proceedings of the 2nd International Conference on Trends in Electronics and Informatics (ICOEI 2018), DOI: http://dx.doi.org/10.1109/ICOEI.2018.8553750

Xiaochen, Zhang, Xiaoyu, Yao, Yi Zhu, Fei Hu (2019), "An ARCore Based User Centric Assistive Navigation System for Visually Impaired People", Appl. Sci. 9(5), 989 р, DOI: https://doi.org/10.3390/app9050989

Bineeth, Kuriakose, Raju, Shrestha, Frode, Eika Sandnes (2023), "DeepNAVI: A deep learning based smartphone navigation assistant for people with visual impairments", Expert Systems with Applications 212 (2023) 118720, DOI: https://doi.org/10.1016/j.eswa.2022.118720

Audun, Brunes, Trond, Heir (2021), "Serious Life Events in People with Visual Impairment Versus the General Population", Int. J. Environ. Res. Public Health, 18, 11536 р, DOI: https://doi.org/10.3390/ijerph182111536

Kaushal, Kumar (2023), "An intelligent Assistant for the Visually Impaired & blind people using machine learning, International Journal of Imaging and Robotics 20(3)". available at: https://www.researchgate.net/publication/342561852_An_intelligent_Assistant_for_the_Visually_Impaired_blind_people_using_machine_learning (last accessed 25 March 2024)

Surabhi, Suresh, Sandra S, Aisha Thajudheen, Subina Hussain, Amitha R (2023), "An Intelligent Voice Assistance System For The Visually Impaired People", International Journal of Engineering Research & Technology (IJERT) Volume 11, Issue 04 (2023), DOI: https://doi.org/10.17577/IJERTCONV11IS04022

"YOLOv9: A Leap Forward in Object Detection Technology", available at: https://docs.ultralytics.com/models/yolov9/ (last accessed 22 May 2024).

Real, S., Araujo, A. (2029), "Navigation systems for the blind and visually impaired: Past work, challenges, and open problems" Sensors. Vol. 19. №. 15. 3404 р. DOI:10.3390/s19153404

Bhowmick, A., Hazarika, S. M. (2017), "An insight into assistive technology for the visually impaired and blind people: state-of-the-art and future trends", Journal on Multimodal User Interfaces. Т. 11. Р. 149–172. DOI: 10.1007/s12193-016-0235-6

Elmannai, W., Elleithy, K. (2017), "Sensor-based assistive devices for visually-impaired people: Current status, challenges, and future directions", Sensors. Vol. 17. №. 3. Р. 565. DOI: 10.3390/s17030565

Sayama, H. (2015), "Introduction to the modeling and analysis of complex systems. Open SUNY Textbooks". available at: https://open.umn.edu/opentextbooks/textbooks/233 (last accessed 25 March 2024)

Yildirim, U., Campean, F., Williams, H. (2017), "Function modeling using the system state flow diagram", Artificial Intelligence for Engineering Design Analysis and Manufacturing. Vol.31. №. 4. Р. 413–435. DOI: 10.1017/S0890060417000294

Downloads

Published

2024-06-30

How to Cite

Barkovska, O., & Serdechnyi, V. (2024). Intelligent assistance system for people with visual impairments. INNOVATIVE TECHNOLOGIES AND SCIENTIFIC SOLUTIONS FOR INDUSTRIES, (2(28), 6–16. https://doi.org/10.30837/2522-9818.2024.28.006