Skip to main content
SpringerLink
Log in

A Self Assistive Device for Deaf & Blind People Using IOT

Kathu-Kann Thaan Thunai Eyanthiram

  • Patient Facing Systems
  • Published:
Journal of Medical Systems Aims and scope Submit manuscript

Abstract

This paper presents Google speech API based aid for deaf and blind people. The live streaming speech on the microphone is sent to Google API server which converts the speech signal into text and displaying onto a LCD screen and amplifies the speech via speaker. The aid will use Request procedure protocol to send the encoded Mp3 audio to Google API server where the speech signal is converted into suitable text and sent back to the Raspberry pi using repeated request protocol. This aid is designed to address issue with mild deafness and blind person. This will enable the deaf and blind persons to work effectively at home, office and any public places with ease. The aid works at low latency at good internet connectivity.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Yao Chen, Yangjie Wei, Nan Guan, Yi Wang (2014) An Intelligent Hearing Aid System Based on Real-Time Signal Processing. Proceedings of the 2014 IEEE International Conference on Cyber-Physical Systems, Networks, and Applications, pp 55–58.

  2. Lotfi Bendaoui, Si Mahmoud Karabernou, Lounis Kessal, (2014) “FPGA-Implementation of a Bio-Inspired Medical Hearing Aid Based DWT-OLA”, International Conference on Audio, Language and Image Processing, pp 1–5.

  3. Mathews, J., Low-delay signal processing for digital hearing aids. IEEE transactions on audio, speech, and language processing 19(4):699–710, 2010.

    Google Scholar 

  4. an, S. k., Park, S.-I., jun, s. b., and lee, c. h., Design for simplifies cochlear implant system. IEEE Transactions on Biomedical Engineering 54(6):973–982, 2007.

    Article  Google Scholar 

  5. Kilo P. B Chaudari, Ashwini, Malkar Sanam, (2015) “Image Processing Based Language Converter for Deaf and Dumb People”, A Conference on Wireless Communication and Android Apps, PP 25–30.

  6. oziokio, O., and hersh, m., Development of a portable two-way communication and information device for deaf blind people. studies in health technology and informatics 217:518–525, 2015.

    Google Scholar 

  7. Pathi, M. R., and Sivakumar, A. A. M., Use of braille database for design and implementation of braille hand glove for deaf blind people. International journal of innovative technology & creative engineering 1(6):7–12, 2011.

    Google Scholar 

  8. Mrim alfiai, srini sampan, (2017) “Social and communication apps for the deaf and hearing impaired”, International Conference on Computer and Applications, pp 1–5.

  9. Girija Shankar Dash, Omprakash Singh, Swetalima, (2016) “wiBeD2: A communication aid for deaf-dump people”, International Conference on Information Communication and Embedded Systems, pp 1–5

  10. Subbulakshmi, N., and Manimegalai, R., MACGDI: Low power MAC based filter Bank using GDI logic for hearing aid applications. International Journal of Electronics and Electrical Engineering 5(3):235–238, 2017.

    Article  Google Scholar 

  11. Ben Shirley, James Thomas, Poulroche, (2012) “VoIP text: voice chat for deaf & hard of hearing people”, IEEE Second International Conference on Consumer Electronics, pp 1–7.

  12. Kumar, M. V. N. R. P., and Ashtosh Kumar, M., AVR Based Gesture Vocalizer Using Speech Synthesizer IC. International journal of research in advent technology 3(5):25–29, 2015.

    Google Scholar 

  13. Priya Darsini, R., Naga Lakshmi, C. V., and Madhulika, G., Digital filtering in hearing aid system. International Journal Of Advanced Research in Engineering & Management (IJAREM) 03(04):60–65, 2017.

    Google Scholar 

  14. Atiqua, N., and Hossain, S., Speech to text conversion in real-time. International Journal of Innovation and Scientific Research 17(2):271–277, 2015.

    Google Scholar 

  15. Matthias Mielke and Rainer Bruck, (2016)“AUDIS Wear: a Smart watch based Assistive Device for Ubiquitous Awareness of Environmental Sounds”, 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society , pp 10–15.

  16. Radu Arsinte, Eugen Lupul, Teodor Sumalan, (2017),“A Rapid Prototyping Model Concept for a DSP Based Hearing Aid”, E-Health and Bioengineering Conference , pp 20–27.

  17. Parul Saxena, Ashish Mehta, (2016) “Refinement of Input Speech by Suppressing the Unwanted Amplitudes for Blue Hearing System”, 2nd International Conference on Advances in Computing, Communication, & Automation, pp 21–29.

  18. Sethuraman, Abhinav Rajan and K.P. Sai Saran,(2015), “Beta Real Time Interface for Deaf and Global Entity (Bridge)”, International Conference on Smart Technologies and Management for Computing, Communication, Controls, Energy and Materials, pp 67–75.

  19. Maath S. Abdulghafoor , Azlina Ahmad, Jiung-Yao Huang,(2015), “Survey on the Use of Applications for Deaf and Hard Hearing Literacy”, International Conference on Computer, Communications, and Control Technology, pp 56–64.

  20. Hari Krishna Garg, Tang Bin, Zhang Liang, , Ram Singh, (2005) “ Wireless hearing aids system simulation”, IEEE Conference on Signals, Systems and Computers, pp 45–51.

  21. Sacristan and Victoria Rodella, Louiza Sellami, and Robert W. Newcomb, (2000), “A Digitally Implementable Ear-Type Lattice”, Proceedings of the 43rd IEEE Midwest Symposium on Circuits and Systems, pp 72-76.

  22. Rautl Vicen-Bueno, Roberto Gil-Pita, Manuel Utrilla-Manso, Lorena Alvarez-Perez,(2007) “A hearing aid simulator to test adaptive signal processing algorithms”, IEEE International Symposium on Intelligent Signal Processing pp 74–81.

  23. Prachi Khilari, Bhope V. P., (2015) “ A Review on speech to text conversion methods”, International Journal of Advanced Research in Computer Engineering & Technology Volume 4 (7), pp 3067–3072.

  24. Jose, D. V., Mustafa, A., and Sharan, A novel model for speech to text conversion. International Refereed Journal of Engineering and Science 3(1):39–41, 2014.

    Google Scholar 

  25. Kevin J. Lippert, Amanda M. Lippert, (2015), “Hearing Protection- The Electrical Hazard you Don't Hear About !”, Electrical Safety Workshop, pp 7–15.

Download references

Funding

The work is not part of any funding.

Author information

Authors and Affiliations

  1. Department of E.C.E, Vidya Jyothi Institute of Technology, Aziz Nagar, Chilukur Road, Hyderabad, 75, India

    Vasanth K

  2. Department of E.C.E, Vidya Jyothi Institute of Technology, Aziz Nagar, Chilukur Road, Hyderabad, 75, India

    Mounika Macharla

  3. Deprtment of Electronics and Communication Engineering, Sri Ramanujar Engineering College, Chennai, India

    Varatharajan R

Authors
  1. Vasanth K
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mounika Macharla
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Varatharajan R
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Vasanth K.

Ethics declarations

Conflict of Interest

No conflict exists: Vasanth Kishorebabu declares that he/she has no conflict of interest, Macharla Mounika declares she has no conflict of interest, Varatharajan declares that he has no conflict of interest. Ethical Approval: Articles do not contain studies with human participants or animals by any of the authors. The author has used augmented reality based hearing aid.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

This article is part of the Topical Collection on Patient Facing Systems

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Vasanth K, Macharla, M. & Varatharajan R A Self Assistive Device for Deaf & Blind People Using IOT. J Med Syst 43, 88 (2019). https://doi.org/10.1007/s10916-019-1201-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10916-019-1201-0

Keywords

Search

Navigation