Abstract
We advocate that technology can make it possible to develop devices capable of recognizing people and objects, mainly with the aid of machine learning, computer vision, and cloud computing. Such devices can be used in the daily life of a visually impaired person, providing valuable information for guiding their steps, providing a better quality of life. This paper proposes an architecture that uses computer vision and applies deep learning techniques to an Internet of Things (IoT) assistant for people with visual impairment. Considering that an IoT device is a limited device, it’s used edge computing to improve the proposed architecture so that the device may be updated over time. The recognized object is converted into Text To Speech (TTS), allowing the user to listen to what has been recognized and also the distance from the user to the object. Unrecognized objects are sent to the cloud, and the device receives a re-trained network. The proposed architecture has been implemented using known and proved technologies such as Raspberry Pi 3, USB camera, Ultrasonic Sensor module, You Only Look Once (YOLO) algorithm, Google-TTS, and Python. Experimental results demonstrate that our architecture is feasible and promising.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
The Lancet Global Health. https://www.thelancet.com/journals/langlo/article /PIIS2214-109X(17)30293-0/fulltext. Accessed 19 Apr 2019
Joseph Chet Redmon. https://pjreddie.com/darknet/yolo/. Accessed 18 Apr 2019
United Nations - Convention on the Rights of Persons with Disabilities. https://www.un.org/development/desa/disabilities/convention-on-the-rights-of-persons-with-disabilities.html. Accessed 21 May 2019
Raspberry Organization. https://www.raspberrypi.org/documentation/usage/gpio/. Accessed 23 Apr 2019
Heya, T.A., Arefin, S.E., Chakrabarty, A., Alam, M.: Image processing based indoor localization system for assisting visually impaired people. In: 2018 Ubiquitous Positioning, Indoor Navigation and Location-Based Services (UPINLBS), Wuhan, pp. 1-7 (2018)
Choudhury, A.A., Saha, R., Shoumo, S.Z.H., Tulon, S.R., Uddin, J., Rahman, M.K.: An efficient way to represent braille using YOLO algorithm. In: 2018 Joint 7th International Conference on Informatics, Electronics & Vision (ICIEV) and 2018 2nd International Conference on Imaging, Vision & Pattern Recognition (icIVPR), Kitakyushu, Japan, pp. 379–383 (2018)
Alam, M.M., Arefin, S.E., Alim, M.A., Adib, S.I., Rahman, M.A.: Indoor localization system for assisting visually impaired people. In: 2017 International Conference on Electrical, Computer and Communication Engineering (ECCE), Cox’s Bazar, pp. 333–338 (2017)
Li, H., Ota, K., Dong, M.: Learning IoT in edge: deep learning for the internet of things with edge computing. IEEE Netw. 32(1), 96–101 (2018). https://doi.org/10.1109/MNET.2018.1700202
Lan, F., Zhai, G., Lin, W.: Lightweight smart glass system with audio aid for visually impaired people. In: TENCON 2015–2015 IEEE Region 10 Conference, Macao, pp. 1–4 (2015)
Fadlullah, Z.M., et al.: State-of-the-art deep learning: evolving machine intelligence toward tomorrow’s intelligent network traffic control systems. IEEE Commun. Surv. Tutorials 19(4) 2432–2455, Fourthquarter 2017
Verhelst, M., Moons, B.: Embedded deep neural network processing: algorithmic and processor techniques bring deep learning to IoT and edge devices. IEEE Solid-State Circ. Mag. 9(4), 55–65, Fall 2017
Rani, K.R.: An audio aided smart vision system for visually impaired. In: 2017 International Conference on Nextgen Electronic Technologies: Silicon to Software (ICNETS2), Chennai, pp. 22–25 (2017)
Yao, S., et al.: Deep learning for the internet of things. Computer 51(5), 32–41 (2018)
Tang, J., Sun, D., Liu, S., Gaudiot, J.: Enabling deep learning on IoT devices. Computer 50(10), 92–96 (2017)
Mahdavinejad, M.S., Rezvan, M., Barekatain, M., Adibi, P., Barnaghi, P., Sheth, A.P.: Machine learning for internet of things data analysis: a survey. Digital Commun. Netw. 4(3), 161–175 (2018)
Mendki, P.: Docker container based analytics at IoT edge video analytics usecase. In: 2018 3rd International Conference On Internet of Things: Smart Innovation and Usages (IoT-SIU), Bhimtal, pp. 1-4 (2018)
Acknowledgement
This research was partially supported by Priority Program for the Training of Human Resources - CAPDA/SUFRAMA/MDIC, under the terms of Federal Law n\(^{\circ }\) 8.387/1991.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 IFIP International Federation for Information Processing
About this paper
Cite this paper
Júnior, M.J.S., Oliveira, H.F., Barreto, R.S. (2023). IoT Assistant for People with Visual Impairment in Edge Computing. In: Wehrmeister, M.A., Kreutz, M., Götz, M., Henkler, S., Pimentel, A.D., Rettberg, A. (eds) Analysis, Estimations, and Applications of Embedded Systems. IESS 2019. IFIP Advances in Information and Communication Technology, vol 576. Springer, Cham. https://doi.org/10.1007/978-3-031-26500-6_12
Download citation
DOI: https://doi.org/10.1007/978-3-031-26500-6_12
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-26499-3
Online ISBN: 978-3-031-26500-6
eBook Packages: Computer ScienceComputer Science (R0)