Abstract
Sign Language (SL) is a potential tool for communication in the hearing and speech-impaired community. As individual words cannot be communicated accurately using the SL gestures, fingerspelling is adopted to spell out names of people and places. Due to rich vocabulary and diversity in Indic scripts, and the abugida nature of Indic scripts that distinguish them from a prominent world script like the Roman script, it is cumbersome to use American Sign Language (ASL) convention for fingerspelling in Indian languages. Moreover, due to the existence of 10 major scripts in India, it is a futile task to develop a separate fingerspelling convention for each individual Indic script based on the geometry of the characters. In this paper, we propose a novel and unified fingerspelling system known as Mudrabharati for Indic scripts. The gestures of Mudrabharati are constructed based on the phonetics of Indian scripts and not the geometry of the glyphs that compose the individual characters. Unlike ASL that utilizes just one hand, Mudrabharati uses both the hands - one for consonants and the other for vowels; swarayukta aksharas (Consonant-Vowel combinations) are gestured by using both the hands. An Artificial Intelligence (AI) based recognition system for Mudrabharati that returns the character in Devanagari and Tamil scripts is developed.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Berke, J.: Who uses sign language? Deaf and other non-verbal users of sign language (2018). https://www.verywellhealth.com/sign-language-nonverbal-users-1046848
Carmel, S.: International hand alphabet charts. National Association of the Deaf (United States) (1982)
Daniels, P.T., Bright, W.: The World’s Writing Systems. Oxford University Press, Oxford and New York (1996)
Hammarström, H., Forkel, R., Haspelmath, M.: German Sign Language. Glottolog 3.0. Max Planck Institute for the Science of Human History, Jena (2017)
Ishida, R.: An introduction to Indic scripts. In: Proceedings of the 22nd International Unicode Conference (2002)
Kohonen, T.: Self-organized formation of topologically correct feature maps. Biol. Cybern. 43(1), 59–69 (1982)
Kyle, J., Woll, B.: Sign Language: The Study of Deaf People and Their Language. Press Syndicate of the University of Cambridge, Cambridge (1985)
Lewis, M.P., Simons, G.F., Fennig, C.D.: Deaf Sign Language. Ethnologue: Languages of the World (2013)
Mininstry of Statistics: Disabled Persons in India: A statistical profile. Ministry of Statistics and Programme Implementation (2016)
Mudrabharati: Mudrabharati calibration and results video. https://youtu.be/iGKguuqGw6o
Naik, M., Chakravarthy, V.S.: A comparative study of complexity of handwritten Bharati characters with that of major Indian scripts. In: 2017 International Joint Conference on Neural Networks, pp. 3050–3057 (2017)
Perlmutter, D.M.: The Language of the Deaf. New York Review of Books, New York (1991)
Rao, P.B.: Salient phonetic features of Indian languages in speech technology. Sadhana 36(5), 587–599 (2011)
Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 511–518 (2001)
Wei, S., Ramakrishna, V., Kanade, T., Sheikh, Y.: Convolutional Pose Machines. CoRR abs/1602.00134 (2016). http://arxiv.org/abs/1602.00134
Zeshan, U.: Sign Language of Indo-Pakistan: A Description of a Signed Language. John Benjamins Publishing Co., Philadelphia (2000)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Amal Jude Ashwin, F., Chakravarthy, V.S., Kopparapu, S.K. (2021). An AI-Based Detection System for Mudrabharati: A Novel Unified Fingerspelling System for Indic Scripts. In: EkÅ¡tein, K., Pártl, F., KonopÃk, M. (eds) Text, Speech, and Dialogue. TSD 2021. Lecture Notes in Computer Science(), vol 12848. Springer, Cham. https://doi.org/10.1007/978-3-030-83527-9_36
Download citation
DOI: https://doi.org/10.1007/978-3-030-83527-9_36
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-83526-2
Online ISBN: 978-3-030-83527-9
eBook Packages: Computer ScienceComputer Science (R0)