Skip to main content
SpringerLink
Log in

Comparison of shape descriptors for hand posture recognition in video

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

Hand posture recognition remains a challenging task for in-line systems working directly in the video stream. In this work, we compare several shape descriptors, with the objective of finding a good compromise between accuracy of recognition and computation load for a real-time application. Experiments are run on two families of contour-based Fourier descriptors and two sets of region-based moments, all of them are invariant to translation, rotation and scale changes of hands. These methods are independent of the camera view point. Systematic tests are performed on the Triesch benchmark database and on our own large database, which includes more realistic conditions. Temporal filtering and a method for unknown posture detection are considered to improve posture recognition results in case of video stream processing.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Pavlovic V., Sharma R., Huang T.: Visual interpretation of hand gestures for Human-computer interaction: A review. IEEE Trans. Pattern Anal. Mach. Intell. 19(7), 677–692 (1997)

    Article  Google Scholar 

  2. Zhu Y., Xu G., Kriegman D.: A real-time approach to the spotting, representation, and recognition of hand gestures for Human-computer interaction. Comput. Vis. Image Underst. 85(3), 189–208 (2002)

    Article  MATH  Google Scholar 

  3. Kong, W., Ranganath, S.: 3D hand trajectory recognition for signing exact English. In: Proceedings of the IEEE International Conference on Automatic Face and Gesture Recognition, Seoul, Korea, May 17–19, pp. 535–540 (2004)

  4. Ong S., Ranganath S.: Automatic sign language analysis: A survey and the future beyond lexical meaning. IEEE Trans. Pattern Anal. Mach. Intell. 27(6), 873–891 (2005)

    Article  Google Scholar 

  5. Banarse, D.S., Duller, A.W.G.: Deformation invariant pattern classification for recognizing hand gestures. In: Proceedings of the IEEE International Conference on Neural Networks, vol. 3, pp. 1812–1817 (1996)

  6. Su, M.C., Jean, W.F., Chang, H.T.: A static hand gesture recognition system using a composite neural network. In: Proceedings of the 5th IEEE International Conference on Fuzzy Systems, New Orleans, USA, vol. 2, pp. 786–792 (1996)

  7. Wu, Y., Huang, T.S.: View-independent recognition of hand postures. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Hilton Head Island, SC, vol. 2, pp. 88–94, Jun 13–15 (2000)

  8. Lee, H.J., Chung, J.H.: Hand gesture recognition using orientation histogram. In: Proceedings of the IEEE Region 10 Conference (TENCON 2), vol. 2, pp. 1355–1358 (1999)

  9. Zhou, H., Lin, D.J., Huang, T.S.: Static hand gesture recognition based on local orientation histogram feature distribution model. In: Proceedings of the IEEE Workshop on Real-Time Vision for Human Computer Interactions in Conjunction with CVPR, Washington, DC, USA, pp. 161–164, Jun 27–Jul 02 (2004)

  10. Schlenzig, J., Hunter, E., Jain, R.: Vision based hand gesture interpretation using recursive estimation. In: Proceedings of the 28th Asilomar Conference on Signals, Systems and Computers, Pacific Grove, CA, vol. 2, pp. 1267–1271, Oct 31–Nov 2 (1994)

  11. Hunter, E., Schlenzig, J., Jain, R.: Posture estimation in reduced-model gesture input systems. In: Proceedings of the International Workshop on Automatic Face and Gesture Recognition, Zurich, Switzerland, pp. 290–295, Jun 26–18 (1995)

  12. Abu-Mostafa, Y.S., Psaltis, D.: Recognition aspect of moment invariants. IEEE Trans. Pattern Anal. Mach. Intell. PAMI-6, pp. 698–706 (1984)

    Google Scholar 

  13. Licsar A., Sziranyi T.: User-adaptive hand gesture recognition system with interactive training. Image Vis. Comput. 23(12), 1102–1114 (2005)

    Article  Google Scholar 

  14. Wah Ng C., Ranganath S.: Real-time gesture recognition system and application. Image Vis. Comput. 20(13–14), 993–1007 (2002)

    Article  Google Scholar 

  15. Chen F.S., Fu C.M., Huang C.L.: Hand gesture recognition using a real-time tracking method and hidden Markov models. Image Vis. Comput. 21(8), 745–758 (2003)

    Article  Google Scholar 

  16. Conseil, S., Bourennane, S., Martin, L.: Comparison of Fourier descriptors and Hu moments for hand posture recognition. In: Proceedings of the European Signal Processing Conference (EUSIPCO), Poznan, Poland, pp. 1960–1964, Sept 3–7 (2007)

  17. Hu M.K.: Visual pattern recognition by moment invariants. IEEE Trans. Inf. Theory 8, 179–187 (1962)

    MATH  Google Scholar 

  18. Triesch, J., Von der Malsburg, C.: Robust classification of hand postures against complex backgrounds. In: Proceedings of the IEEE International Conference on Automatic Face and Gesture Recognition, Killington, Vermont, USA, pp. 170–175, Oct 14–16 (1996)

  19. Freeman, W., Roth, M.: Orientation histogram for hand gesture recognition. In: IEEE 1st International Workshop on Automatic Face and Gesture Recognition, Zurich, Switzerland, pp. 296–301, Jun 26–18 (1995)

  20. Phung S., Bouzerdoum A., Chai D.: Skin segmentation using color pixel classification: Analysis and comparison. IEEE Trans. Pattern Anal. Mach. Intell. 27(1), 148–154 (2005)

    Article  Google Scholar 

  21. Ahmad T., Taylor C.J., Lanitis A., Cootes T.F.: Tracking and recognising hand gestures, using statistical shape models. Image Vis. Comput. 15(5), 345–352 (1997)

    Article  Google Scholar 

  22. Kolsch, M., Turk, M.: Robust hand detection. In: Proceeding of the IEEE International Conference on Automatic Face and Gesture Recognition, Seoul, Korea, pp. 614–619 (2004)

  23. Moghaddam B., Pentland A.: Probabilistic visual learning for object representation. IEEE Trans. Pattern Anal. Mach. Intell. 19(7), 696–710 (1997)

    Article  Google Scholar 

  24. Crimmins T.: A complete set of Fourier descriptors for two dimensional shape. IEEE Trans. Syst. Man Cyber. 6(121), 848–855 (1982)

    MathSciNet  Google Scholar 

  25. Persoon E., Fu K.: Shape discrimination using Fourier descriptors. IEEE Trans. Pattern Anal. Mach. Intell. 8(3), 388–397 (1986)

    Article  Google Scholar 

  26. Zhang, D., Lu, G.: A comparative study on shape retrieval using Fourier descriptors with different shape signatures. In: Proceedings of the International Conference on Intelligent Multimedia and Distance Education (2001)

  27. Poppe, R., Poel, M.: Comparison of silhouette shape descriptors for example-based human pose recovery. In: Proceedings of the IEEE International Conference on Automatic Face and Gesture Recognition, Southampton, United Kingdom, pp. 541–546, Apr 10–12 (2006)

  28. Harding, P., Ellis, T.: Recognizing hand gesture using Fourier descriptors. In: Proceedings of the IEEE International Conference on Pattern Recognition, Cambridge, United Kingdom, pp. 286–289, Aug 23–26 (2004)

  29. Just, A., Rodriguez, Y., Marcel, S.: Hand posture classification and recognition using the modified census transform. In: Proceedings of the IEEE Int. Conf. on Automatic Face and Gesture Recognition, Southampton, United Kingdom, Apr 10–12, pp. 351–356 (2006)

  30. Ghorbel F.: Stability of invariant Fourier descriptors and its inference in the shape classification. Proc. IEEE International Conference on Pattern Recognition, The Hague, The Netherlands, pp. 130–133, Aug 30–Sep 3 (1992)

  31. Mokhtarian F., Mackworth A.K.: A theory of multiscale, curvature based shape representation for planar curves. IEEE Trans. Pattern Anal. Mach. Intell. 14(8), 789–805 (1992)

    Article  Google Scholar 

  32. Van Otterloo, P.J.: A contour-Oriented Approach to Shape Analysis. Prentice Hall International (UK), Hertfordshire. ISBN 0-13-173840-2 (1991)

  33. Gu, L., Rose, K.: Perceptual harmonic cepstral coefficients for speech recognition in noisy environment. In: Proceedings of the IEEE ICASSP’2001, Salt Lake City, pp. 189–192, May 7–11 (2001)

  34. Kumar, S., Singh, C.: A study of Zernike moments and its use in Devanagari handwritten character recognition. In: Proceedings of the International Conference on Cognition and Recognition (ICCR’05), Mysore, India, pp. 514–520, Dec 22–23 (2005)

  35. Hwang S.K., Kim W.Y.: A novel approach to the fast computation of Zernike moments. Pattern Recognit. 39(11), 2065–2076 (2006)

    Article  MATH  Google Scholar 

  36. Otsu N.: A threshold selection method from gray level histograms. IEEE Trans. Syst. Man Cybern. 9, 62–66 (1979)

    Article  Google Scholar 

  37. Chang C.C., Chen J.J., Tai W.K., Han C.-C.: New approach for static gesture recognition. J. Inf. Sci. Eng. 22(5), 1047–1057 (2006)

    Google Scholar 

  38. Sheng Y., Shen L.: Orthogonal Fourier-Mellin moments for invariant pattern recognition. J. Opt. Soc. Am. A 11(6), 1748–1757 (1994)

    Article  Google Scholar 

  39. Chai D., Ngan K.: Face segmentation using skin-color map in videophone applications. IEEE Trans. Circuits Syst. Video Technol. 9, 551–564 (1999)

    Article  Google Scholar 

  40. Hsu, C.W., Chang, C.C., Lin, C.J.: A practical guide to support vector classification. Technical report, Department of Computer Science, National Taiwan University. http://www.csie.ntu.edu.tw/~cjlin/papers/guide/guide.pdf (2003)

  41. Chow C.K.: On optimum recognition error and reject tradeoff. IEEE Trans. Inf. Theory 16(1), 41–46 (1970)

    Article  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Institut Fresnel-CNRS UMR 6133, Ecole Centrale Marseille, Univ. Paul Cézanne, Dom. Univ. de Saint Jérôme, 13397, Marseille Cédex 20, France

    S. Bourennane & C. Fossati

Authors
  1. S. Bourennane
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. C. Fossati
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to S. Bourennane.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Bourennane, S., Fossati, C. Comparison of shape descriptors for hand posture recognition in video. SIViP 6, 147–157 (2012). https://doi.org/10.1007/s11760-010-0176-6

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-010-0176-6

Keywords

Search

Navigation