Abstract
This paper introduces a video based system that recognizes gestures of Turkish Sign Language (TSL). Hidden Markov Models (HMMs) have been applied to design a sign language recognizer because of the fact that HMMs seem ideal technology for gesture recognition due to its ability of handling dynamic motion. It is seen that sampling only four key-frames is enough to detect the gesture. Concentrating only on the global features of the generated signs, the system achieves a word accuracy of 95.7%.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Grobel, K., Assan, M.: Isolated Sign Language Recognition using Hidden Markov Models. In: International Conference on Computational Cybernetics and Simulation, vol. 4, pp. 3081–3084. IEEE, Los Alamitos (1997)
Imagawa, K., Matsuo, H., Taniguchi, R., Arita, D., Lu, S., Ilgi, S.: Recognition of Local Features from Camera-based Sign Language Recognition System. In: Proceedings of the 15th International Conference on Pattern Recognition, vol. 4, pp. 849–853 (2000)
Hai, W., Sutherland, A.: Irish Sign Language Recognition Using PCA, Multi-scale Theory, and Discrete Hidden Markov Models. In: Proceedings of the Irish Machine Vision Conference, pp. 66–73 (2004)
Özyürek, A., İlkbaşaran, D., Arık, E.: Turkish Sign Language Gestures. Koç University (2005), http://turkisaretdili.ku.edu.tr
Hsu, R.L., Abdel-Mottaleb, M., Jain, A.K.: Face Detection in Color Images. IEEE Trans. on Pattern Analysis and Machine Intelligence 2(5), 696–706 (2002)
Starner, T., Pentland, A.: Real-Time American Sign Language Recognition from Video Using HMMs. Technical Report No 375. MIT Cambridge, Media Laboratory (1995)
Takahashi, T., Kishino, F.: Hand Gesture Coding Based on Experiments Using a Hand Gesture Interface Device. SIGCHI Bulletin 23(2), 67–73 (1991)
Liang, H., Ouhyoung, M.: A Sign Language Recognition System Using HMM and Context Sensitive Search. ACM VRST (1996)
Yoshino, K., Kawashima, T., Aoki, Y.: Recognition of Japanese Sign Language from Image Sequence Using Color Combination. In: Proceedings of the International Conference on Image Processing, vol. 3, pp. 511–514 (1996)
Gonzales, R.C., Woods, R.E.: Digital Image Processing. Addison-Wesley, Reading (1993)
Alpaydın, E.: Introduction to Machine Learning, pp. 305–326. The MIT Press, Cambridge (2004)
Young, S.: The Hidden Markov Model Toolkit Book Version 3.2.1. Cambridge University Eng. Dept. Speech Group and Entropic Research Lab. Inc., Washington DC (2002)
Yamato, J., Ohta, J., Ishii, K.: Recognition Human Action in Time-Sequential Images Using HMM. In: Proceedings of the Conference on Computer Vision and Pattern Recognition, pp. 379–385. IEEE, Los Alamitos (1992)
Turkish Sign Language Manual for Adults. Turkish Ministry of Education, Ankara (1995)
Erhardt-Ferron, A.: Theory and Applications of Digital Image Processing. University of Applied Sciences Offenburg (2000)
Russ, J.C.: The Image Processing Handbook, 3rd edn. CRC Press LLC, Boca Raton (1999)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Haberdar, H., Albayrak, S. (2005). Real Time Isolated Turkish Sign Language Recognition from Video Using Hidden Markov Models with Global Features. In: Yolum, p., Güngör, T., Gürgen, F., Özturan, C. (eds) Computer and Information Sciences - ISCIS 2005. ISCIS 2005. Lecture Notes in Computer Science, vol 3733. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11569596_70
Download citation
DOI: https://doi.org/10.1007/11569596_70
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-29414-6
Online ISBN: 978-3-540-32085-2
eBook Packages: Computer ScienceComputer Science (R0)