Abstract
This work proposes the combination of natural language processing techniques and the use of graphic development engines to create an avatar to display information translated into Mexican Sign Language (MSL). It describes the application of the guarantee analysis carried out on Mexican Sign Language in the implementation of a rules-based automatic translation system. Taking into account the graphic character of sign language, the generated translation is represented through the use of an avatar developed in a virtual environment Unity. The translation is based on a restricted vocabulary associated with the learning of history of Mexico for the fourth level of primary education. The grammatical structures most used in the history book were also analyzed and included in the rules system. The application was developed that, through a cloud server that will use Natural Language Processing (NLP) and Automatic Translation (AT), transforms the voice into MSL. The signs will be made by a digitally animated avatar on a mobile device .
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Braffort, A., et al.: KAZOO: a sign language generation platform based on production rules. Univ. Access Inf. Soc. 15(4), 541–550 (2016)
Bungeroth, J., Ney, H.: Statistical sign language translation. In: Workshop on Representation and Processing of Sign Languages, LREC, vol. 4 (2004)
Cervantes, J., et al.: Clasificación del lenguaje de señas mexicano con SVM generando datos artificiales. Revista vínculos 10(1), 328–341 (2013)
Domínguez, A.B.: Servicio de información sobre discapacidad. https://sid.usal.es/idocs/F8/ART11921/educacion_para_la_inclusion_de_alum_sordos.pdf. Accessed 2019
Efthimiou, E., et al.: From grammar-based MT to post-processed SL representations. Univ. Access Inf. Soc. 15(4), 499–511 (2016)
Ebling, S., Glauert, J.: Building a Swiss German sign language avatar with JASigning and evaluating it among the deaf community. Univ. Access Inf. Soc. 15(4), 577–587 (2016)
Filhol, M., Hadjadj, M.N., Testu, B.: A rule triggering system for automatic text-to-sign translation. Univ. Access Inf. Soc. 15(4), 487–498 (2016)
Hernández, M.T.C.: Diccionario Español-Lengua de señas Mexicana (DIELSEME), SEP, México
López-Ludeña, V., et al.: Translating bus information into sign language for deaf people. Eng. Appl. Artif. Intell. 32, 258–269 (2014)
Luqman, H., Mahmoud, S.A.: Automatic translation of Arabic text-to-Arabic sign language. Univ. Access Inf. Soc. 18(4), 939–951 (2019)
McDonald, J., et al.: An automated technique for real-time production of lifelike animations of American Sign Language. Univ. Access Inf. Soc. 15(4), 551–566 (2016)
Pichardo Lagunas, O., Partida Terrón, L., Martínez Seis, B.C., Alvelar Gallegos, A., Serrano Olea, R.: Sistema de traduccion directa del español a LSM con reglas marcadas, Ciudad de México: IPN (2016)
RAE, Real Academia Española, Real Academia Española. http://www.rae.es/. Accessed 2019
San-Segundo, R., et al.: Speech to sign language translation system for Spanish. Speech Communi. 50(11-12), 1009–1020 (2008)
Shaikh, F., et al.: Sign language translation system for railway station announcements. In: 2019 IEEE Bombay Section Signature Conference (IBSSC). IEEE (2019)
Smith, R.G., Nolan, B.: Emotional facial expressions in synthesised sign language avatars: a manual evaluation. Univ. Access Inf. Soc. 15(4), 567–576 (2016)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Barrera Melchor, F., Alcibar Palacios, J.C., Pichardo-Lagunas, O., Martinez-Seis, B. (2020). Speech to Mexican Sign Language for Learning with an Avatar. In: Martínez-Villaseñor, L., Herrera-Alcántara, O., Ponce, H., Castro-Espinoza, F.A. (eds) Advances in Computational Intelligence. MICAI 2020. Lecture Notes in Computer Science(), vol 12469. Springer, Cham. https://doi.org/10.1007/978-3-030-60887-3_16
Download citation
DOI: https://doi.org/10.1007/978-3-030-60887-3_16
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-60886-6
Online ISBN: 978-3-030-60887-3
eBook Packages: Computer ScienceComputer Science (R0)