Skip to main content
Log in

RETRACTED ARTICLE: Smart communication using tri-spectral sign recognition for hearing-impaired people

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

This article was retracted on 30 September 2022

This article has been updated

Abstract

In recent years, new technology developments have been proposed and implemented to support people with hearing impairment and speech loss. It is a severe disability to be unable to speak and communicate. This group of people needs a device to help them use a smartphone in the same way as the rest of the population. This idea has pushed technologists to create new tools to help hearing-impaired and speechless people interact more intelligently and effectively with hearing-impaired and visually impaired people. These tools essentially combine all available new ideas behind speech-to-sign conversion, image processing, gesture extraction and sign-to-speech conversion techniques. Speech-to-sign conversion is processed using template-based recognition with peak modulation. In comparison, many algorithms convert speech-to-sign language, and the template-based peak modulated speech recognition method is superior over other methods, because it considers all components/inputs of speech. Since the highest and lowest peaks are calculated, the accuracy of the method is also high. Converted signs are captured, gesture extraction is performed, and gestures are converted to speech using tri-spectral gesture extraction. The proposed model has a very high accuracy of 98.4% and 98.8% in converting speech to sign and sign to speech, respectively, which is a significant difference from the existing neural network methods. These modules (speech to sign to speech) together compose a Triple-S algorithm that can also be used in wireless communication where hard-of-hearing and speechless people may involve themselves in remote communication as any other people would. The proposed algorithm has been trained and tested with outstanding results with 98.6% accuracy in effective communication through AI, where speech and sign recognition are combined.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

Change history

References

  1. Oi Mean Foong, Tang Jung Low, Wai Wan La (2009) Voice to sign language translation system to malaysian deaf people. In: Proceedings of First International Visual Informatics Conference, Kaula Lumpur, Malyasia, pp. 868–876

  2. Arulananth TS, Balaji L, Baskar M et al (2020) PCA Based dimensional data reduction and segmentation for DICOM images. Neural Process Lett. https://doi.org/10.1007/s11063-020-10391-9

    Article  Google Scholar 

  3. Verma P, Shimi SL, Priyadarshini R (2015) Design of communication interpreter for deaf and dumb person. Int J Sci Res 4(1):2640–2643

    Google Scholar 

  4. Baskar M, Ramkumar J, Karthikeyan C et al (2021) Low rate DDoS mitigation using real-time multi threshold traffic monitoring system. J Ambient Intell Hum Comput. https://doi.org/10.1007/s12652-020-02744-y

    Article  Google Scholar 

  5. Abraham A, Rohini V (2018) Real time conversion of sign language to speech and prediction of gestures using artificial neural network. Proc Comput Sci 143:587–594

    Article  Google Scholar 

  6. Kanisha B, Balakrishnan G (2016) Speech recognition with advanced feature extraction methods using adaptive particle swarm optimization. Int J Intel Eng Syst 9(4):21–30

    Google Scholar 

  7. Mohammed AA, Lv J, Islam MDS (2019) A deep learning-based end to end composite system for hand detection and gesture recognition. Sensors (Basel) 19(23):5282

    Article  Google Scholar 

  8. Athira PK, Sruthi CJC, Lijiya A (2019) A signer independent sign language recognition with co–articulation elimination from live videos: an Indian scenario. J King Saud Univ Comput Inf Sci. https://doi.org/10.1016/j.jksuci.2019.05.002

    Article  Google Scholar 

  9. Baskar M, Gnanasekaran T, Saravanan S (2013) Adaptive IP traceback mechanism for detecting low rate DDoS attacks. In: 2013 IEEE International Conference on Emerging Trends in Computing, Communication and Nanotechnology (ICECCN), Tirunelveli, pp. 373-377. https://doi.org/10.1109/ICE-CCN.2013.6528526

  10. Baskar M, Renuka Devi R, Ramkumar J et al (2021) Region centric minutiae propagation measure orient forgery detection with finger print analysis in health care systems. Neural Process Lett. https://doi.org/10.1007/s11063-020-10407-4

    Article  Google Scholar 

  11. Jedwa SK (2015) Feature extraction for hand gesture recognition: a review. Int J Sci Eng Res 6(7):2072–2077

    Google Scholar 

  12. Manikandan K, Patidar A, Walia P, Roy AB (2018) Hand gesture detection and conversion to speech and text. Int J Pure Appl Math 120(6):1347–1352

    Google Scholar 

  13. Arulananth TS, Baskar M, Sankar SMU, Thiagarajan R, Dalton GA, Rajeshwari PR, Kumar AS, Suresh A (2021) Evaluation of low power consumption network on chip routing architecture. Microprocess Microsyst 82:103809

    Article  Google Scholar 

  14. Karthik PC, Sasikumar J, Baskar M et al (2021) Field equations for incompressible non-viscous fluids using artificial intelligence. J Supercomput. https://doi.org/10.1007/s11227-021-03917-y

    Article  Google Scholar 

  15. Kanisha B, Balakrishnan G (2016) Speech recognition based on feature extraction with the aid of multi support vector machine. J Comput Theor Nanosci 13(10):6616–6627

    Article  Google Scholar 

  16. Kirubanantham P, Sankar SMU, Amuthadevi C et al (2021) An intelligent web service group-based recommendation system for long-term composition. J Supercomput. https://doi.org/10.1007/s11227-021-03930-1

    Article  Google Scholar 

  17. Ramkumar J, Baskar M, Viswak M, Ashish MD (2020) Smart shopping with integrated secure system based on IoT. Intern J Adv Sci Technol 29(5):301–312

    Google Scholar 

  18. Thiagarajan R, Ganesan R, Anbarasu V et al (2021) Optimised with secure approach in detecting and isolation of malicious nodes in MANET. Wireless Pers Commun 119:21–35. https://doi.org/10.1007/s11277-021-08092-0

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to M. Baskar.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

This article has been retracted. Please see the retraction notice for more detail: https://doi.org/10.1007/s11227-022-04859-9

Rights and permissions

Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kanisha, B., Mahalakshmi, V., Baskar, M. et al. RETRACTED ARTICLE: Smart communication using tri-spectral sign recognition for hearing-impaired people. J Supercomput 78, 2651–2664 (2022). https://doi.org/10.1007/s11227-021-03968-1

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11227-021-03968-1

Keywords

Navigation