Abstract
Signer-independent sign language recognition is an urgent problem for the practicability of sign language recognition system. Currently, there is still a huge gap between signer-independent sign language recognition and signer-dependent sign language recognition system owing to the variation of sample data and the insufficient of training samples. Discriminative training can well compensate the recognition shortages caused by insufficient training samples and the similarity of sign language models. This paper applied the HMM (hidden Markov model) training parameter model modified by DT (discriminative training) method to recognize signer-independent sign language. The modified HMM model reduced the effects of small training samples to signer-independent sign language recognition. Furthermore, this paper proposed a tangent vectors method of manifold (TV/HMM) concept to improve the statistical model of sign language recognition considering the learning and reasoning capability of manifold concept in sign language recognition field. The proposed model reduced the variation impact of sign language to signer-independent sign language recognition. Finally, a novel statistical training model (DT+TV/HMM) combining discriminative training and manifold methods was established to solve the data variation and small samples problems of sign language recognition system. Experiments show that the discrimination rate of the integrated DT+TV/HMM recognition system is 82.43% increasing by 15.07% compared with traditional MLE recognition system.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Charayaphan, C., Marble, A.: Image processing system for interpreting motion in American sign language. Journal of Biomedical Engineering 14(15), 419–425 (1992)
Fels, S.S., Hinton, G.E.: Glove-talk: a neural network interface between a data-glove and a speech synthesizer. IEEE Trans. Neural Networks 4(1), 2–8 (1993)
Kadous, M.W.: Machine recognition of Auslan signs using PowerGloves: towards large-lexicon recognition of sign language. In: Proceedings of the Workshop on the Integration of Gesture in Language and Speech, pp. 165–174. DE, Wilmington (1996)
Grobel, K., Assan, M.: Isolated sign language recognition using hidden markov models. In: Proceedings of the International Conference of System, Man and Cybernetics, Orlando, pp. 162–167. (1997)
Sagawa, H., Takeuchi, M., Ohki, M.: Description and recognition methods for sign language based on gesture components. In: Proceedings of the International Conference on Intelligent User Interfaces, Florida, USA, pp. 97–104 (1997)
Kim, J.S., Jang, W., Bien, Z.: Dynamic gesture recognition system for the Korean sign language (KSL). IEEE Trans. Systems, Man, and Cybernetics 26(2), 354–359 (1996)
Deng, J.W., Tsui, H.T.: A two-step approach based on PaHMM for the recognition of ASL. In: Proceedings of the Fifth Asian Conference on Computer Vision, Melbourne, Australia, pp. 126–131 (2002)
Shamaie, A., Sutherland, A.: Accurate recognition of large number of hand Gestures. In: Second Iranian Conference on Machine Vision and Image Processing, New York, USA, pp. 308–317 (2003)
Chen, F.S., Fu, C.M., Huang, C.L.: Hand gesture recognition using a real-time tracking method and hidden Markov models. Image and Vision Computing 21(8), 745–758 (2003)
Huang, C.L., Jeng, S.H.: A model-based hand gesture recognition system. Machine Vision and Application 12(5), 243–258 (2001)
Kobayashi, T., Haruyama, S.: Partly-Hidden Markov model and its application to gesture recognition. In: Taylor, F.J. (ed.) Proc. of the Int’l Conf. on Acoustics, Speech and Signal Processing, pp. 3081–3084. Academic Press, New York (1997)
Kadous, M.W.: Machine recognition of auslan signs using PowerGloves: Towards large-lexicon recognition of sign language. In: Messing, L. (ed.) Proc. of the Workshop Integration of Gestures in Language and Speech, pp. 165–174. IEEE Computer Society Press, Delaware (1996)
Assan, M., Grobel, K.: Video-Based sign language recognition using hidden Markov models. In: Wachsmuth, I., Fröhlich, M. (eds.) GW 1997. LNCS (LNAI), vol. 1371, pp. 97–109. Springer, Heidelberg (1998)
Vamplew, P., Adams, A.: Recognition of sign language gestures using neural networks. Australian Journal of Intelligent Information Processing Systems 5(2), 94–102 (1998)
Handouyahia, M., Ziou, D., Wang, S.: Sign Language recognition using moment-based size functions. In: Proc. of the Int’l Conf. on Vision Interface, pp. 210–216. CRC Press, Kerkyra (1999)
Su, M.C.: A fuzzy rule-based approach to spatio-temporal hand gesture recognition. IEEE Trans. on Systems, Man, and Cybernetics, Part C: Applications and Reviews 30(2), 276–281 (2000)
Kong, W.W., Ranganath, S.: 3-D Hand trajectory recognition for signing exact English. In: Proc. of the Int’l Conf. on Automatic Face and Gesture Recognition, pp. 535–540. ACM Press, Seoul (2004)
Gao, W., Fang, G.L., Zhao, D.B., Chen, Y.Q.: A Chinese sign language recognition system based on SOFM/SRN/HMM. Pattern Recognition 37(12), 2389–2402 (2004)
Ong, S., Ranganath, S.: Deciphering gestures with layered meanings and signer adaptation. In: Proc. of the Int’l Conf. Automatic Face and Gesture Recognition, pp. 559–564. ACM Press, Seoul (2004)
Bahl, L.R., Brown, P.F., de Souza, P.V., Mercer, R.L.: Maximum mutual information estimation of hidden markov model parameters for Speech recognition. In: Proc. 1986 Int. Conf. on Acoustics, Speech and Signal Processing, Tokyo, Japan, pp. 49–52 (April 1986)
Normandin, Y.: An improved MMIE training algorithm for speaker independent, small vocabulary, continuous speech recognition. In: Proc. ICASSP 1991, Toronto, pp. 537–540 (1991)
Seung, H.S., Lee, D.D.: The manifold ways of perception. Science 290(5500), 2268–2269 (2000)
Tenenbaum, J., Silva, D.D., Langford, J.: A global geometric framework for nonlinear dimensionality reduction. Science 290(5500), 2319–2323 (2000)
Roweis, S., Saul, L.: Nonlinear dimensionality reduction by locally linear embedding. Science 290(5500), 2323–2326 (2000)
Wang, S.-J.: Bionic(Topological) pattern recognition—a new model of pattern recognition theory and its application. ACTA Electronica Sinica 30(10), 1417–1420 (2002)
Michigan State University, http://www.cse.msu.edu/~lawhiu/manifold/
Zhang, J.-P., Wang, Y.: Manifold Learning, pp. 172–207. Tsinghua Press, Peking (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Ni, X. et al. (2013). Signer-Independent Sign Language Recognition Based on Manifold and Discriminative Training. In: Yang, Y., Ma, M., Liu, B. (eds) Information Computing and Applications. ICICA 2013. Communications in Computer and Information Science, vol 391. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-53932-9_26
Download citation
DOI: https://doi.org/10.1007/978-3-642-53932-9_26
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-53931-2
Online ISBN: 978-3-642-53932-9
eBook Packages: Computer ScienceComputer Science (R0)