skip to main content
10.1145/3369114.3369139acmotherconferencesArticle/Chapter ViewAbstractPublication PagesicaaiConference Proceedingsconference-collections
research-article

Smart Assistant for Blind and Visually Impaired People

Published: 21 January 2020 Publication History

Abstract

Blind or visually impaired people feel miserable and helpless when people help them in their daily simple jobs. Many of them are afraid of going out unless it's necessary. Blind people usually memorize the location of objects so they can find them without struggling, but what if the location of any object has been changed for any reason? Or what if they want to go to an outside place? How they will recognize objects? Colors are also another challenge for them. Smart Assistant for blind people is a portable device. This device will make blind and visually impaired people's lives much easier, as it will help them in recognizing objects. Another aim is to identify texts on objects. An additional feature for the device is to make the device capable of recognizing different colors. This device is easy to use, and it can be used by users of different ages. There are two main parts for our project: software part and hardware part. Hardware part will contain camera, Ultrasonic sensor, Bluetooth headset, Raspberry Pi and power bank. While the software part will be OpenCV as the framework, that uses Python as the programming language. We also use a deep learning technique. This technique is a type of machine learning methods that uses neural network architectures to extract features from an image in order to recognize the object exists in the captured image.

References

[1]
What is Computer Vision? - Definition from Techopedia. 2018. Techopedia.com. https://www.techopedia.com/definition/32309/computervision/.
[2]
2019. Talal Bonny, Tamer Rabie, Mohamed Baziad, and Walid Balid. SHORT: Segmented Histogram Technique for Robust Real-Time Object Recognition. Journal of Multimedia Tools and Applications
[3]
2018. Talal Bonny, Tamer Rabie, and A H Abdul Hafez. Multiple Histogram-based Face Recognition with High Speed FPGA Implementation. Journal of Multimedia Tools and Applications.
[4]
2018. https://www.mathworks.com/solutions/deep-learning/object-recognition.html/.
[5]
2018. Available: https://www.mathworks.com/help/supportpkg/android/examples/color-detection.html/.
[6]
2018. https://developers.google.com/vision/android/text-overview/.
[7]
Limits of data hungry Deep Learning! -- Story by Data. 2019. Storybydata.com. http://storybydata.com/datacated-weekly/limits-of-data-hungry-deep-learning/.
[8]
Systems, M. 2018. AMAL Glasses | MIH Systems. Amalglass.com. http://amalglass.com/about/.
[9]
pyttsx3. 2019. PyPI. https://pypi.org/project/pyttsx3/.
[10]
eSpeak: Speech Synthesizer. 2019. Espeak.sourceforge.net. http://espeak.sourceforge.net/.
[11]
Hollemans, M. 2018. MobileNet version 2. Machinethink.net. http://machinethink.net/blog/mobilenet-v2/.
[12]
2019. https://towardsdatascience.com/understanding-ssd-multibox-real-time-object-detection-in-deep-learning-495ef744fab.
[13]
Login: Anaconda Cloud. 2019. Anaconda.org. https://anaconda.org/ijstokes/pytesseract.
[14]
2019.https://docs.opencv.org/3.4/d4/d73/tutorial_py_contours_begin

Cited By

View all
  • (2025)Edge AI-powered marine pollution classification with customized CNN modelNeural Computing and Applications10.1007/s00521-024-10959-937:9(6449-6463)Online publication date: 14-Jan-2025
  • (2024)Primary Methods and Algorithms in Artificial-Intelligence-Based Dental Image Analysis: A Systematic ReviewAlgorithms10.3390/a1712056717:12(567)Online publication date: 11-Dec-2024
  • (2024)An eye tracking system for controlling home devicesReal-time Processing of Image, Depth, and Video Information 202410.1117/12.3028926(29)Online publication date: 20-Jun-2024
  • Show More Cited By

Index Terms

  1. Smart Assistant for Blind and Visually Impaired People

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    ICAAI '19: Proceedings of the 3rd International Conference on Advances in Artificial Intelligence
    October 2019
    253 pages
    ISBN:9781450372534
    DOI:10.1145/3369114
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    In-Cooperation

    • Northumbria University: University of Northumbria at Newcastle

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 21 January 2020

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Bone Conduction Headset
    2. Deep Neural Networks
    3. HSV
    4. Microprocessor
    5. OCR

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    ICAAI 2019

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)34
    • Downloads (Last 6 weeks)6
    Reflects downloads up to 05 Mar 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2025)Edge AI-powered marine pollution classification with customized CNN modelNeural Computing and Applications10.1007/s00521-024-10959-937:9(6449-6463)Online publication date: 14-Jan-2025
    • (2024)Primary Methods and Algorithms in Artificial-Intelligence-Based Dental Image Analysis: A Systematic ReviewAlgorithms10.3390/a1712056717:12(567)Online publication date: 11-Dec-2024
    • (2024)An eye tracking system for controlling home devicesReal-time Processing of Image, Depth, and Video Information 202410.1117/12.3028926(29)Online publication date: 20-Jun-2024
    • (2024)NeuroChaosCrypt: Revolutionizing Chaotic-Based Cryptosystem With Artificial Neural Networks—A Comparison With Traditional CryptosystemsIEEE Access10.1109/ACCESS.2024.339552712(62030-62046)Online publication date: 2024
    • (2024)Role of Artificial Intelligence in Minimizing Carbon Footprint: A Systematic Review of Recent InsightsBiorefinery and Industry 4.0: Empowering Sustainability10.1007/978-3-031-51601-6_14(365-386)Online publication date: 2-Apr-2024
    • (2023)Vision Transformer Customized for Environment Detection and Collision Prediction to Assist the Visually ImpairedJournal of Imaging10.3390/jimaging90801619:8(161)Online publication date: 15-Aug-2023
    • (2023)AI-Based Sign Language Interpreter (GestPret)Proceedings of the 2023 7th International Conference on Advances in Artificial Intelligence10.1145/3633598.3633612(79-85)Online publication date: 13-Oct-2023
    • (2023)Visually Impaired People Positioning Assistance System Using Artificial IntelligenceIEEE Sensors Journal10.1109/JSEN.2023.324412823:7(7758-7765)Online publication date: 1-Apr-2023
    • (2023)Survey on Various Techniques based on Voice Assistance for Blind2023 International Conference on Intelligent Data Communication Technologies and Internet of Things (IDCIoT)10.1109/IDCIoT56793.2023.10053499(600-605)Online publication date: 5-Jan-2023
    • (2023)Audio Assistance for Visually Impaired Teachers using Image Processing2023 International Conference on Innovative Data Communication Technologies and Application (ICIDCA)10.1109/ICIDCA56705.2023.10100263(1060-1064)Online publication date: 14-Mar-2023
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media