Abstract
In recent years, new technology developments have been proposed and implemented to support people with hearing impairment and speech loss. It is a severe disability to be unable to speak and communicate. This group of people needs a device to help them use a smartphone in the same way as the rest of the population. This idea has pushed technologists to create new tools to help hearing-impaired and speechless people interact more intelligently and effectively with hearing-impaired and visually impaired people. These tools essentially combine all available new ideas behind speech-to-sign conversion, image processing, gesture extraction and sign-to-speech conversion techniques. Speech-to-sign conversion is processed using template-based recognition with peak modulation. In comparison, many algorithms convert speech-to-sign language, and the template-based peak modulated speech recognition method is superior over other methods, because it considers all components/inputs of speech. Since the highest and lowest peaks are calculated, the accuracy of the method is also high. Converted signs are captured, gesture extraction is performed, and gestures are converted to speech using tri-spectral gesture extraction. The proposed model has a very high accuracy of 98.4% and 98.8% in converting speech to sign and sign to speech, respectively, which is a significant difference from the existing neural network methods. These modules (speech to sign to speech) together compose a Triple-S algorithm that can also be used in wireless communication where hard-of-hearing and speechless people may involve themselves in remote communication as any other people would. The proposed algorithm has been trained and tested with outstanding results with 98.6% accuracy in effective communication through AI, where speech and sign recognition are combined.










Similar content being viewed by others
Explore related subjects
Discover the latest articles and news from researchers in related subjects, suggested using machine learning.Change history
30 September 2022
This article has been retracted. Please see the Retraction Notice for more detail: https://doi.org/10.1007/s11227-022-04859-9
References
Oi Mean Foong, Tang Jung Low, Wai Wan La (2009) Voice to sign language translation system to malaysian deaf people. In: Proceedings of First International Visual Informatics Conference, Kaula Lumpur, Malyasia, pp. 868–876
Arulananth TS, Balaji L, Baskar M et al (2020) PCA Based dimensional data reduction and segmentation for DICOM images. Neural Process Lett. https://doi.org/10.1007/s11063-020-10391-9
Verma P, Shimi SL, Priyadarshini R (2015) Design of communication interpreter for deaf and dumb person. Int J Sci Res 4(1):2640–2643
Baskar M, Ramkumar J, Karthikeyan C et al (2021) Low rate DDoS mitigation using real-time multi threshold traffic monitoring system. J Ambient Intell Hum Comput. https://doi.org/10.1007/s12652-020-02744-y
Abraham A, Rohini V (2018) Real time conversion of sign language to speech and prediction of gestures using artificial neural network. Proc Comput Sci 143:587–594
Kanisha B, Balakrishnan G (2016) Speech recognition with advanced feature extraction methods using adaptive particle swarm optimization. Int J Intel Eng Syst 9(4):21–30
Mohammed AA, Lv J, Islam MDS (2019) A deep learning-based end to end composite system for hand detection and gesture recognition. Sensors (Basel) 19(23):5282
Athira PK, Sruthi CJC, Lijiya A (2019) A signer independent sign language recognition with co–articulation elimination from live videos: an Indian scenario. J King Saud Univ Comput Inf Sci. https://doi.org/10.1016/j.jksuci.2019.05.002
Baskar M, Gnanasekaran T, Saravanan S (2013) Adaptive IP traceback mechanism for detecting low rate DDoS attacks. In: 2013 IEEE International Conference on Emerging Trends in Computing, Communication and Nanotechnology (ICECCN), Tirunelveli, pp. 373-377. https://doi.org/10.1109/ICE-CCN.2013.6528526
Baskar M, Renuka Devi R, Ramkumar J et al (2021) Region centric minutiae propagation measure orient forgery detection with finger print analysis in health care systems. Neural Process Lett. https://doi.org/10.1007/s11063-020-10407-4
Jedwa SK (2015) Feature extraction for hand gesture recognition: a review. Int J Sci Eng Res 6(7):2072–2077
Manikandan K, Patidar A, Walia P, Roy AB (2018) Hand gesture detection and conversion to speech and text. Int J Pure Appl Math 120(6):1347–1352
Arulananth TS, Baskar M, Sankar SMU, Thiagarajan R, Dalton GA, Rajeshwari PR, Kumar AS, Suresh A (2021) Evaluation of low power consumption network on chip routing architecture. Microprocess Microsyst 82:103809
Karthik PC, Sasikumar J, Baskar M et al (2021) Field equations for incompressible non-viscous fluids using artificial intelligence. J Supercomput. https://doi.org/10.1007/s11227-021-03917-y
Kanisha B, Balakrishnan G (2016) Speech recognition based on feature extraction with the aid of multi support vector machine. J Comput Theor Nanosci 13(10):6616–6627
Kirubanantham P, Sankar SMU, Amuthadevi C et al (2021) An intelligent web service group-based recommendation system for long-term composition. J Supercomput. https://doi.org/10.1007/s11227-021-03930-1
Ramkumar J, Baskar M, Viswak M, Ashish MD (2020) Smart shopping with integrated secure system based on IoT. Intern J Adv Sci Technol 29(5):301–312
Thiagarajan R, Ganesan R, Anbarasu V et al (2021) Optimised with secure approach in detecting and isolation of malicious nodes in MANET. Wireless Pers Commun 119:21–35. https://doi.org/10.1007/s11277-021-08092-0
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
This article has been retracted. Please see the retraction notice for more detail: https://doi.org/10.1007/s11227-022-04859-9
Rights and permissions
Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Kanisha, B., Mahalakshmi, V., Baskar, M. et al. RETRACTED ARTICLE: Smart communication using tri-spectral sign recognition for hearing-impaired people. J Supercomput 78, 2651–2664 (2022). https://doi.org/10.1007/s11227-021-03968-1
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11227-021-03968-1