Abstract
The development of vision systems capable to extracting discriminative features that enhance the generalization power of a classifier is still a very challenging problem. In this paper, is presented a methodology to improve the classification performance of Mexican Sign Language (MSL). The proposed method explores some frames in video sequences for each sign. 743 features were extracted from these frames, and a genetic algorithm is employed to select a subset of sensitive features by removing the irrelevant features. The genetic algorithm permits to obtain the most discriminative features. Support Vector Machines (SVM) are used to classify signs based on these features. The experiments show that the proposed method can be successfully used to recognize the MSL with accuracy results individually above 97 % on average. The proposed feature extraction methodology and the GA used to extract the most discriminative features is a promising method to facilitate the communication of deaf people.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Al-Roussan, M., Assaleh, K., Tala’a, A.: Video-based signer-independent Arabic sign language recognition using hidden Markov models. Appl. Soft Comput. 9(3), 990–999 (2009)
Assa, M., Grobel, K.: Video-based sign language recognition using Hidden Markov Models. In: Proceedings of Gesture Workshop, pp. 97–109 (1997)
Bauer, B., Hienz, H.: Relevant features for video-based continuous sign language recognition. In: Proceedings of FG 2000. IEEE Computer Society, Washington, D.C., pp. 440–450 (2000)
Cervantes, J., Lamont, F.G., Santiago, J.H., Cabrera, J.E., Trueba, A.: Clasificacion del lenguaje de señas mexicano con SVM generando datos artificiales. Vinculos 10(1), 328–341 (2013)
Cole, R., et al.: New tools for interactive speech and language training: using animated conversational agents in the classrooms of profoundly deaf children. In: Proceedings of ESCA/SOCRATES Workshop on Method and Tool Innovations for Speech Science Education, London, pp. 45–52 (1999)
Cole, R., Van Vuuren, S., Pellom, B., Hacioglu, K., Ma, J., Movellan, J., Schwartz, S., Wade-Stein, D., Ward, W., Yan, J.: Perceptive animated interfaces: first steps toward a new paradigm for human computer interaction. IEEE Trans. Multimedia Spec. Issue Human Comput. Interact. 91(9), 1391–1405 (2003)
Dreuw, P., Stein, D., Deselaers, T., Rybach, D., Zahedi, D., Bungeroth, J., Ney, H.: Spoken language processing techniques for sign language recognition and translation. Technol. Disabil. 20(2), 121–133 (2008)
García-Lamont, F., Cervantes, J., Ruiz, S., López-Chau, A.: Color characterization comparison for machine vision-based fruit recognition. In: Huang, D.-S, Bevilacqua, V., Premaratne, P. (eds.) ICIC 2015. LNCS, vol. 9225, pp. 258–270. Springer, Heidelberg (2015)
Fang, G.L., Gao, W., Zhao, D.B.: Large vocabulary sign language recognition based on fuzzy decision trees. IEEE Trans. Syst. Man Cybernet. 34(3), 305–314 (2004)
Kadous, M.W.: Machine recognition of Auslan signs using PowerGloves: towards large-lexicon recognition of sign language. In: Proceedings of Workshop Integration of Gestures in Language and Speech, pp. 165–174 (1996)
San-Segundo, R., Barra, R., Córdoba, R., D’Haro, L.F., Fernández, F., Ferreiros, J., Lucas, J.M., Macías-Guarasa, J., Montero, J.M., Pardo, J.M.: Speech to sign language translation system for Spanish. Speech Commun. 50, 1009–1020 (2008)
San-Segundo, R., Pardo, J.M., Ferreiros, J., Sama, V., Barra-Chicote, R., Lucas, J.M., Sánchez, D., García, A.: Spoken Spanish generation from sign language. Interact. Comput. 22(2), 123–139 (2010)
Tanibata, N., Shimada, N., Shirai, Y.: Extraction of hand features for recognition of sign language words. In: International Conference on Vision Interface, pp. 391–398 (2002)
Vamplew, P., Adams, A.: Recognition of sign language gestures using neural networks. Aust. J. Intell. Inf. Process. Syst. 5(2), 94–102 (1998)
Zahedi, M., Dreuw, P., Rybach, D., Deselaers, T., Ney, H.: Using geometric features to improve continuous appearance-based sign language recognition. In: British Machine Vision Conference (BMVC), vol. 3, Edinburgh, UK (2006)
Acknowledgments
The authors would like to acknowledge the support of the Mexican Counsel of Science and Technology and UAEM, Project UAE/3778/CYB.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Cervantes, J., García-Lamont, F., Rodríguez-Mazahua, L., Rendon, A.Y., Chau, A.L. (2016). Recognition of Mexican Sign Language from Frames in Video Sequences. In: Huang, DS., Jo, KH. (eds) Intelligent Computing Theories and Application. ICIC 2016. Lecture Notes in Computer Science(), vol 9772. Springer, Cham. https://doi.org/10.1007/978-3-319-42294-7_31
Download citation
DOI: https://doi.org/10.1007/978-3-319-42294-7_31
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-42293-0
Online ISBN: 978-3-319-42294-7
eBook Packages: Computer ScienceComputer Science (R0)