Abstract
In this document we describe a hand gesture classification system of the Colombian Sign Language for both dynamic and static signs, based on Computer Vision and Machine learning. The proposed processes sequence is divided in four stages: acquisition of RGB-D image, extraction of the blob closest to the sensor, detection and validation of the hand, and classification of the sign entered. The results obtained are for multi-class classifiers with a self-captured dataset of 3.600 samples. As a conclusion we found that the best choice for descriptor-classifier according to sign type are HOG-SVM for static signs with an accuracy of \(98\%\), and SVM classifier besides the trajectory-based descriptor with an accuracy of \(94\%\).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Plouffe, G., Cretu, A., Payeur, P.: Natural Human-Computer Interaction Using Static and Dynamic Hand Gestures. IEEE (2015). ISBN 978-1-4673-9175-7
Yeo, H., Lee, B., Lim, H.: Hand tracking and gesture recognition system for human-computer interaction using low-cost hardware. Multimedia Tools Appl. 74, 2687–2715 (2013). https://doi.org/10.1007/s11042-013-1501-1
Song, W., Le, A., Yun, S., Jung, S.: Hole filling for Kinect V2 depth images (2014)
Meng, H., Furao, S., Jinxi, Z.: Hidden Markov models based dynamic hand gesture recognition with incremental learning method (2014)
López, P., Antonio, Valveny, E., Vanrell, M.: Detección de objetos (2015)
Heikkilä, M., Pietikäinen, M., Schmid, C.: Description of interest regions with local binary patterns. Pattern Recogn. 42, 425–436 (2009)
Khamar, S., Ganesan, P., Kanlist, V., Sathish, B.S., Merlin, J.: Comparative study of skin color detection and segmentation in HSV and YCbCr color space. Procedia Comput. Sci. 57(12), 41–48 (2015)
Cooper, H., Holt, B., Bowden, R.: Sign language recognition. In: Moeslund, T., Hilton, A., Krüger, V., Sigal, L. (eds.) Visual Analysis of Humans, pp. 539–562. Springer, London (2011). https://doi.org/10.1007/978-0-85729-997-0_27
Dong, C., Leu, M.C., Yin, Z.: American sign language alphabet recognition using Microsoft Kinect. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 44–52 (2015)
Majid, M.B.A., Zain, J.B.M., Hermawan, A.: Recognition of Malaysian sign language using skeleton data with neural network. In: 2015 International Conference on Science in Information Technology (ICSITech), pp. 231–236. IEEE, October 2015
Kushwah, M.S., Sharma, M., Jain, K., Chopra, A.: Sign language interpretation using pseudo glove. In: Singh, R., Choudhury, S. (eds.) Proceeding of International Conference on Intelligent Communication, Control and Devices, pp. 9–18. Springer, Singapore (2017). https://doi.org/10.1007/978-981-10-1708-7_2
Oz, C., Leu, M.C.: Recognition of finger spelling of american sign language with artificial neural network using position/orientation sensors and data glove. In: Wang, J., Liao, X.-F., Yi, Z. (eds.) ISNN 2005. LNCS, vol. 3497, pp. 157–164. Springer, Heidelberg (2005). https://doi.org/10.1007/11427445_25
Oz, C., Leu, M.C.: Linguistic properties based on American sign language recognition with artificial neural networks using a sensory glove and motion tracker. In: Cabestany, J., Prieto, A., Sandoval, F. (eds.) IWANN 2005. LNCS, vol. 3512, pp. 1197–1205. Springer, Heidelberg (2005). https://doi.org/10.1007/11494669_147
Gurjal, P., Kunnur, K.: Real time hand gesture recognition using SIFT. Int. J. Electron. Electr. Eng. 2(3), 19–33 (2012)
Dardas, N.H., Georganas, N.D.: Real-time hand gesture detection and recognition using bag-of-features and support vector machine techniques. Instrum. Meas. 60, 3592–3607 (2011)
Chen, K., Guo, X., Wu, J.: Gesture recognition system based on wavelet moment. In: Applied Mechanics and Materials, vol. 401–403, pp. 1377–1380 (2013)
Pugeault, N., Bowden, R.: Spelling it out: real-time ASL fingerspelling recognition. In: IEEE Workshop on Consumer Depth Cameras for Computer Vision (2011)
Amin, M.A., Yan, H.: Sign language finger alphabet recognition from Gabor-PCA representation of hand gestures. In: Machine Learning and Cybernetics, vol. 4, pp. 2218–2223 (2007)
Chai, X., Li, G., Chen, X., Zhou, M., Wu, G., Li, H.: Visualcomm: a tool to support communication between deaf and hearing persons with the Kinect. In: Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility, p. 76. ACM, October 2013
Geng, L., Ma, X., Wang, H., Gu, J., Li, Y.: Chinese sign language recognition with 3D hand motion trajectories and depth images. In: Proceeding of the 11th World Congress on Intelligent Control and Automation, pp. 1457–1461. IEEE, June 2014
Ravi, S., Suman, M., Kishore, P.V.V., Kumar, K., Kumar, A.: Multi modal spatio temporal co-trained CNNs with single modal testing on RGB-D based sign language gesture recognition. J. Comput. Lang. 52, 88–102 (2019)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Triviño-López, I.C., Rodríguez-Garavito, C.H., Martinez-Caldas, J.S. (2020). Hand Gesture Recognition Using Computer Vision Applied to Colombian Sign Language. In: Moreno-Díaz, R., Pichler, F., Quesada-Arencibia, A. (eds) Computer Aided Systems Theory – EUROCAST 2019. EUROCAST 2019. Lecture Notes in Computer Science(), vol 12014. Springer, Cham. https://doi.org/10.1007/978-3-030-45096-0_26
Download citation
DOI: https://doi.org/10.1007/978-3-030-45096-0_26
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-45095-3
Online ISBN: 978-3-030-45096-0
eBook Packages: Computer ScienceComputer Science (R0)