Skip to main content
Springer Nature Link
Log in

Alert systems to hearing-impaired people: a systematic review

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In recent years there has been a growing concern about the inclusion of people with disabilities in society. Many research in assistive technologies have been carried out, but with a significant disparity between support for the visually impaired and the hearing-impaired, with research referring to visual impairment accounting for more than 90% of them. Furthermore, an analysis of surveys related to the topic shows the low scientific production of assistive technologies for the hearing-impaired, and to our best knowledge, there is no survey specifically dedicated to alert systems for them. Considering this imbalance in scientific production and bearing in mind the positive impact that alert systems can have on the life of a hearing-impaired person, we present a survey in the scientific literature on alert systems specifically designed for people with hearing impairment. The survey aims to contribute to the scientific community in presenting the current scenario of these systems and directing future research, and contributing to people who can directly benefit from technological advances. A search in the Science Direct, IEEE Xplore, and ACM Digital Library databases for alert systems to hearing-impaired people in which mobile devices are involved returned 795 papers, 20 of which met the criteria defined at research protocol of the systematic literature review. These papers are described here, with notes and reflections on their usefulness, potentials, involved technologies, and possible improvements. We describe our findings of assistive systems for the hearing impaired, pointing out a gap in research in this field, as well as the possibilities for future work based on the data analyzed in this systematic literature review.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2

Similar content being viewed by others

Data availability

Not applicable

Code availability

Not applicable.

References

  1. Abbas MK, Tong B, Abdulla R (2018) A hybrid alert system for deaf people using context-aware computing and image processing. 4th international conference on computer and information sciences (ICCOINS), pp 1–6. https://doi.org/10.1109/ICCOINS.2018.8510584

  2. Arunachalam R (2019) A strategic approach to recognize the speech of the children with hearing impairment: different sets of features and models. Multimed Tools Appl 78:20787–20808. https://doi.org/10.1007/s11042-019-7329-6

    Article  Google Scholar 

  3. Bahbouh NM, Alkhodre AB, Sen AAA, Namoun A, Albouq SS (2019) A cost effective IoT-based system for monitoring baby incidents by deaf parents. International conference on advances in the emerging computing technologies (AECT), pp 1–6. https://doi.org/10.1109/AECT47998.2020.9194179

  4. Bhat GS, Shankar N, Panahi IMS (2020) Design and integration of alert signal detector and separator for hearing aid applications. IEEE Access 8:106296–106309. https://doi.org/10.1109/ACCESS.2020.2999546

    Article  Google Scholar 

  5. Bourne RRA et al (2020) Global prevalence of blindness and distance and near vision impairment in 2020: progress towards the vision 2020 targets and what the future holds. In Invest Ophthalmol Vis Sci 61

  6. Bragg D, Huynh N, Ladner RE (2016) A personalizable mobile sound detector app design for deaf and hard-of-hearing users. 18th international ACM SIGACCESS conference on computers and accessibility, pp 3–13. https://doi.org/10.1145/2982142.2982171

  7. Chatterjee A, Aceves A, Dungca R, Flores H, Giddens K (2016) Classification of wearable computing: a survey of electronic assistive technology and future design. Second international conference on research in computational intelligence and communication networks (ICRCICN), pp 22–27. https://doi.org/10.1109/ICRCICN.2016.7813545

  8. Chen C, Kuo P, Chiang Y, Liang J, Liang K, Chang P (2019) Audio-based early warning system of sound events on the road for improving the safety of hearing-impaired people. IEEE 8th global conference on consumer electronics (GCCE), pp 933–936. https://doi.org/10.1109/GCCE46687.2019.9015516

  9. Dabran I, Elmakias O, Shmelkin R, Zusman Y (2018) An intelligent sound alam recognition system for smart cars and smart homes. IEEE/IFIP network operations and management symposium, pp 1–4. https://doi.org/10.1109/NOMS.2018.8406181

  10. Dhanjal AS, Singh W (2019) Tools and techniques of assistive technology for hearing-impaired people. International Conference on Machine Learning, Big Data, Cloud and Parallel Computing (COMITCon), pp 205–210. https://doi.org/10.1109/COMITCon.2019.8862454

  11. Findlater L, Chinh B, Jain D, Froehlich J, Kushalnagar R, Lin AC (2019) Deaf and hard-of-hearing individuals' preferences for wearable and mobile sound awareness technologies. Conference on Human Factors in Computing Systems pp 1–13. https://doi.org/10.1145/3290605.3300276

  12. Ito A et al (2008) Universal use of information delivery and display system using ad hoc network for deaf people in times of disaster. Third International Conference on Broadband Communications, Information Technology & Biomedical Applications, pp 486–491. https://doi.org/10.1109/BROADCOM.2008.57

  13. Jain D, Ngo H, Patel P, Goodman S, Findlater L, Froehlich J (2020b) Sound watch: exploring smartwatch-based deep learning approaches to support sound awareness for deaf and hard of hearing users. The 22nd international ACM SIGACCESS conference on computers and accessibility pp 1–13. https://doi.org/10.1145/3373625.3416991

  14. Jain D et al (2020a) Home sound: an iterative field deployment of an in-home sound awareness system for deaf or hard of hearing users. 2020 CHI conference on human factors in computing systems pp 1–12. https://doi.org/10.1145/3313831.3376758

  15. Kim GY, Shin S, Kim JY, Kim H (2018) Sound event detection and haptic vibration based home monitoring assistant system for the deaf and hard-of-hearing. Workshop on multimedia for accessible human computer Interface, pp 1–7. https://doi.org/10.1145/3264856.3264857

  16. Kitchenham B (2004) Procedures for performing systematic reviews. Joint technical report software engineering group. Department of Computer Science, Keele University, United Kingdom and empirical software engineering, National ICT Australia Ltd., Australia

  17. Kumari K, Goel P, Reddy SRN (2015) PiCam: IoT based wireless alert system for deaf and hard of hearing. International conference on advanced computing and communications (ADCOM) pp 39–44. https://doi.org/10.1109/ADCOM.2015.14

  18. Li S, Fan X, Zhang Y, Trappe W, Lindqvist J, Howard RE (2017) Auto++: detecting cars using embedded microphones in real-time. ACM Int Mobile Wearable Ubiquitous Technol 1(3):1–20. https://doi.org/10.1145/3130938

    Article  Google Scholar 

  19. Mărculescu C, Machedon A, Drăgulinescu AMC, Marcu I, Zamfirescu C (2020) LoRa and Bluetooth-based IoT alarm clock device for hearing-impaired people. IEEE 26th international symposium for design and Technology in Electronic Packaging (SIITME) pp 140–143. https://doi.org/10.1109/SIITME50350.2020.9292234

  20. Mielke M, Brueck R (2013) Smartphone application for automatic classification of environmental sound. 20th international conference mixed Design of Integrated Circuits and Systems - MIXDES, pp 512–515

  21. Mielke M, Brueck R (2015) Design and evaluation of a smartphone application for non-speech sound awareness for people with hearing loss. 37th annual international conference of the IEEE engineering in medicine and biology society (EMBC) pp 5008–5011. https://doi.org/10.1109/EMBC.2015.7319516

  22. Mohanraj I, Raakesh BR (2017) ICT interventions on aiding people with disabilties - a state of art survey. International conference on inventive communication and computational technologies (ICICCT) pp 189–194. https://doi.org/10.1109/ICICCT.2017.7975185

  23. Padhy S, Tiwari J, Rathore S, Kumar N (2019) Emergency signal classification for the hearing impaired using multi-channel convolutional neural network architecture. IEEE conference on information and communication technology, pp 1–6. https://doi.org/10.1109/CICT48419.2019.9066252

  24. Pradeep MK, Inchara KM, Lekhashree S, Likhith CN, Pavan U (2021) Real time assistive shoe for visually impaired people. 6th international conference for convergence in technology (I2CT) pp 1–5. https://doi.org/10.1109/I2CT51068.2021.9417928

  25. Rastgoo R, Kiani K, Escalera S (2021) Real-time isolated hand sign language recognition using deep networks and SVD. J Ambient Intell Humaniz Comput 13:591–611. https://doi.org/10.1007/s12652-021-02920-8

    Article  Google Scholar 

  26. Sen AAA, Aljohani AAS, Bahbouh NM, Alhaboob O (2021) Designing a smart bracelet based on Arduino for deaf parents to interact with their children 2021 international conference on computing for sustainable global development (INDIACom) pp 380–384. https://doi.org/10.1109/INDIACom51348.2021.00066

  27. Sicong L, Zimu Z, Junzhao D, Longfei S, Han J, Wang X (2017) UbiEar: bringing location-independent sound awareness to the hard-of-hearing people with smartphones. ACM Int Mobile Wearable Ubiquitous Technol 1(2):1–21. https://doi.org/10.1145/3090082

    Article  Google Scholar 

  28. Sneha T, Balasubramanian S et al (2021) Home security system for the hearing impaired. 5th international conference on computer, communication and signal processing (ICCCSP) pp 1–5. https://doi.org/10.1109/ICCCSP52374.2021.9465502

  29. Suriyachai P (2020) Incoming VoIP call alert system for the hearing-impaired. 5th international conference on information technology (InCIT) pp 222–227. https://doi.org/10.1109/InCIT50588.2020.9310946

  30. World Health Organization (2021) World report on hearing. World Health Organization, Geneva

    Google Scholar 

  31. Yaegashi JG, Nader M, Yaegashi SFR, Mação TE (2021) The inclusion of people with special educational needs: historical contextualization. Rev Bras Iniciação Científica 8:1–22

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Federal University of Pará, Belém, Brazil

    Cleyton Aparecido Dim, Rafael Martins Feitosa, Marcelle Pereira Mota & Jefferson Magalhães de Morais

Authors
  1. Cleyton Aparecido Dim
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Rafael Martins Feitosa
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Marcelle Pereira Mota
    View author publications

    You can also search for this author inPubMed Google Scholar

  4. Jefferson Magalhães de Morais
    View author publications

    You can also search for this author inPubMed Google Scholar

Contributions

All authors contributed to the study conception and design. Material preparation, data collection and analysis were performed by Cleyton Aparecido Dim, Rafael Martins Feitosa, Marcelle Pereira Mota and Jefferson Magalhães de Morais. The first version of the manuscript was written by Cleyton Aparecido Dim and was revised by Marcelle Pereira Mota and Jefferson Magalhães de Morais. All authors read approved the manuscript.

Corresponding author

Correspondence to Cleyton Aparecido Dim.

Ethics declarations

Conflict of interest

The authors have no conflicts of interest to declare that are relevant to the content of this article.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Dim, C.A., Feitosa, R.M., Mota, M.P. et al. Alert systems to hearing-impaired people: a systematic review. Multimed Tools Appl 81, 32351–32370 (2022). https://doi.org/10.1007/s11042-022-13045-1

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-022-13045-1

Keywords