Abstract
A divide-and-conquer approach is presented for signer- independent continuous Chinese Sign Language(CSL) recognition in this paper. The problem of continuous CSL recognition is divided into the subproblems of isolated CSL recognition. The simple recurrent network (SRN) and the hidden Markov models(HMM) are combined in this approach. The improved SRN is introduced for segmentation of continuous CSL. Outputs of SRN are regarded as the states of HMM, and the Lattice Viterbi algorithm is employed to search the best word sequence in the HMM framework. Experimental results show SRN/HMM approach has better performance than the standard HMM one.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Starner, T., Pentland A.: Visual Recognition of American Sign Language Using Hidden Markov Models. International Workshop on Automatic Face and Gesture Recognition, Zurich, Switzerland, 1995, pp. 189–194
Liang, R.H., Ouhyoung, M.: A Real-time Continuous Gesture Recognition System for Sign Language. In Proceeding of the Third International Conference on Automatic Face and Gesture Recognition, Nara, Japan, 1998, pp. 558–565
Vogler, C., Metaxas, D.: ASL Recognition Based on a Coupling between HMMs and 3D Motion Analysis. In Proceedings of the IEEE International Conference on Computer Vision, 1998, pp. 363–369
Vogler, C., Metaxas, D.: Toward Scalability in ASL Recognition: Breaking Down Signs into Phonemes. In Proceedings of Gesture Workshop, Gif-sur-Yvette, France, 1999, pp. 400–404
Gao, W., Ma, J.Y., et al.: HandTalker: A Multimodal Dialog System Using Sign Language and 3-D Virtual Human. Advances in Multimodal Interfaces-ICMI 2000, pp. 564–571
Elman, J.L.: Finding Structure in Time. Cognitive Science, 1990, Vol. 14, No. 2, pp. 179–211
Robinson, T.: An Application of Recurrent Nets to Phone Probability Estimation. IEEE Transactions on Neural Networks, 1994, Vol. 5, pp. 298–305
Kershaw, D.J., Hochberg, M., Robinson, A.J.: Context-Dependent Classes in a Hybrid Recurrent Network-HMM Speech Recognition System. Advances in Neural Information Processing Systems, 1996, Vol. 8, pp. 750–756
Senior, A., Robinson, A.J.: Forward-Backward Retraining of Recurrent Neural Networks. Advances in Neural Information Processing Systems, 1996, Vol. 8, pp. 743–749
Murakami, K., Taguchi, H.: Gesture Recognition using Recurrent Neural Networks. In CHI’91 Human Factors in Computing Systems, 1991, pp. 237–242
Rumelhart, D.E., Hinton, G. E., Williams, R. J.: Learning Internal Representations by Error Propagation. In Parallel Distributed Processing: Explorations in the Microstructure of Cognition, Vol. 1, 1986, pp. 318–362
Fang, G.L., Gao, W.: A SOFM/HMM System for Person-Independent Isolated Sign Language Recognition, INTERACT2001 Eight IFIP TC.13 Conference on Human-Computer Interaction, Tokyo, Japan, 2001, pp. 731–732
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Fang, G., Gao, W., Chen, X., Wang, C., Ma, J. (2002). Signer-Independent Continuous Sign Language Recognition Based on SRN/HMM. In: Wachsmuth, I., Sowa, T. (eds) Gesture and Sign Language in Human-Computer Interaction. GW 2001. Lecture Notes in Computer Science(), vol 2298. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-47873-6_8
Download citation
DOI: https://doi.org/10.1007/3-540-47873-6_8
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-43678-2
Online ISBN: 978-3-540-47873-7
eBook Packages: Springer Book Archive