Summary
The paper is concerned with automatic vision-based recognition of hand gestures expressing isolated words of Polish Sign Language (PSL). The Hierarchical Temporal Memory (HTM) [3] is applied. This tool replicates the structural and algorithmic properties of the human neocortex. The gestures are spatio-temporal entities. Therefore we believe the HTM can be able to identify and use the gesture’s subunits (counterparts of phonemes) organized in spatio-temporal hierarchy. The paper discusses the preparation issues of the HTM and presents results of the recognition of 101 words used in everyday life at the doctors and in the post office.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Bauer, B., Kraiss, K.F.: Video-Based Sign Recognition Using Self-Organizing Subunits. In: Proc. Int. Conf. Pattern Recognition, vol. 2, pp. 434–437 (2002)
Bowden, D., Windridge, D., Kadir, T., Zisserman, A., Brady, M.: A Linguistic Feature Vector for the Visual Interpretation of Sign Language. In: Proc. 8th Eur. Conf. Comput. Vis., pp. 391–401. Springer, New York (2004)
Hawkins, J., Blakeslee, S.: On Intelligence. Times Books, New York (2004)
Kapuscinski, T., Wysocki, M.: Automatic Recognition of Signed Polish Expressions. Archives of Control Sciences 15(3) (LI), 251–259 (2006)
Kapuscinski, T., Wysocki, M.: Recognition of signed Polish words using visually-oriented subunits. In: Proc. of the 3rd Language and Technology Conference: Human Language Technologies as a Challenge for Computer Science and Linguistics, Poznan, pp. 202–206 (2007)
Kapuscinski, T., Wysocki, M.: Automatic Recognition of Signed Polish Expressions Using Visually Oriented Subunits. In: Rutkowski, R., Tadeusiewicz, R., Zadeh, L.A., Zurada, J. (eds.) Computational Intelligence: Methods and Applications, pp. 267–278. AOW EXIT, Warszawa (2008)
Numenta Platform for Intelligent Computing (NuPIC), Numenta Inc., http://www.numenta.com
Ong, S.C.W., Ranganath, S.: Automatic Sign Language Analysis: A Survey and the Future beyond Lexical Meaning. IEEE Trans. PAMI 27, 873–891 (2005)
Szczepankowski, B.: Sign language in school. WSiP, Warszawa (1988) (in Polish)
Vogler, C., Metaxas, D.: A Framework for Recognizing the Simultaneous Aspects of American Sign Language. Computer Vision and Image Understanding, 358–384 (2001)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Kapuscinski, T., Wysocki, M. (2009). Using Hierarchical Temporal Memory for Recognition of Signed Polish Words. In: Kurzynski, M., Wozniak, M. (eds) Computer Recognition Systems 3. Advances in Intelligent and Soft Computing, vol 57. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-93905-4_42
Download citation
DOI: https://doi.org/10.1007/978-3-540-93905-4_42
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-93904-7
Online ISBN: 978-3-540-93905-4
eBook Packages: EngineeringEngineering (R0)