Skip to main content
SpringerLink
Log in
Book cover

Australasian Joint Conference on Artificial Intelligence

AI 2004: AI 2004: Advances in Artificial Intelligence pp 215–226Cite as

Moments and Wavelets for Classification of Human Gestures Represented by Spatio-Temporal Templates

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 3339))

Abstract

This paper reports a novel technique to classify short duration articulated object motion in video data. The motion is represented by a spatio-temporal template (STT), a view based approach, which collapses temporal component into a static grey scale image in a way that no explicit sequence matching or temporal analysis is needed, and characterizes the motion from a very high dimensional space to a low dimensional space. These templates are modified to be invariant to translation and scale. Two dimensional, 3 level dyadic wavelet transform applied on these templates results in one low pass subimage and nine highpass directional subimages. Histograms of STTs and of the wavelet coefficients at different scales are compared to establish significance of available information for classification. To further reduce the feature space, histograms of STTs are represented by orthogonal Legendre moments, and the wavelet subbands are modelled by generalized Gaussian density (GGD) parameters – shape factor and standard deviation. The preliminary experiments show that directional information in wavelet subbands improves the histogram-based technique, and that use of moments combined with GGD parameters improves the performance efficiency in addition to significantly reducing complexity of comparing directly the histograms.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   149.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Fels, S.S., Hinton, G.E.: Glove-talk: a neural network interface between a data-glove and a speech synthesiser. IEEE Transactions on Neural Networks 4, 2–8 (1993)

    Article  Google Scholar 

  2. Quam, D.L.: Gesture recognition with a Data-Glove. In: Proceedings of the IEEE Aero-space and Electronics Conference, January 1993, pp. 755–760 (1993)

    Google Scholar 

  3. Sturman, D.J., Zeltzer, D.: A survey of glove-based input. IEEE Computer Graphics and Applications 14(1), 30–39 (1994)

    Article  Google Scholar 

  4. Davis, J.W.: Representing and Recognizing Human Motion: From Motion templates to Movement Categories. In: International Conference on Intelligent Robots and Systems, Maui, Hawaii, (October 29 2001)

    Google Scholar 

  5. Baudel, T., Beaudouin-Lafon, M.: Charade:Remote control of objects using free hand gestures. Communications of the ACM 36(7), 28–35 (1993)

    Article  Google Scholar 

  6. Sharma, A., et al.: Wavelet Directional Histograms of the Spatio-Temporal Templates of Human Gestures. International Journal of Wavelets, Multiresolution and Information Proc-essing (IJWMIP) 2(3), 1–16 (2004)

    Google Scholar 

  7. Sharma, A., et al.: Wavelet Directional Histograms for Classification of Human Gestures Represented by Spatio-Temporal Templates. In: IEEE Computer Society:10th International Multi-Media Modelling Conference (MMM 2004), Brisbane, Australia, January, pp. 57–63 (2004)

    Google Scholar 

  8. Sharma, A., et al.: Classification of Human Actions using Temporal Templates, Histograms And Orthogonal Moments. In: 7th World Multiconference on Systemics, Cybernetics and In-formatics (SCI 2003), Orlando, USA, July 27-30 (2003)

    Google Scholar 

  9. Bobick, A.F., Davis, J.W.: The Recognition of Human Movement using Temporal Tem-plates. IEEE Transactions on Pattern Analysis and Machine Intelligence(PAMI) 23(3), 257–267 (2001)

    Article  Google Scholar 

  10. Black, M.J., Yakoob, Y.: Tracking and Recognizing Rigid and Non-Rigid Facial Motion Using Local Parametric Models of Image Motion. In: International Conference of Computer Vision, pp. 374–381 (1995)

    Google Scholar 

  11. Mandal, M.K., Panchanathan, S., Aboulnasr, T.: Illumination Invariant Image Indexing Using Moments and Wavelets. Journal of Electronic Imaging 7(2), 282–293 (1998)

    Article  Google Scholar 

  12. Masoud, O., Papanikolopoulos, N.: Human Activity Recognition. In: IEEE Con-ference on Advanced Video and Signal Based Surveillance, Miami, Florida, 21-22 July, pp. 157–162 (2003)

    Google Scholar 

  13. Johnsson, G.: Visual Perception of Biological Motion and a Model for Its Analysis. Percep-tion And Psychophysics 14(2), 201–211 (1973)

    Article  MathSciNet  Google Scholar 

  14. Johnsson, G.: Visual Motion Perception, pp. 76–88. Scientific American (June 1975)

    Google Scholar 

  15. Cedras, C., Shah, M.: Motion Based Recognition. Image and Vision Computing 13, 129–155 (1995)

    Article  Google Scholar 

  16. Essa, I., Pentland, A.: Facial Expression Recognition Using a Dynamic Model of Motion Energy. In: International Conference on Computer Vision, Cambridge, MA (June 1995)

    Google Scholar 

  17. Swain, M.J., Ballard, D.H.: Color Indexing. International Journal of Computer Vision 7(1), 11–32 (1991)

    Article  Google Scholar 

  18. Stricker, M., Orengo, M.: Similarity of Color Images. In: Proc. of SPIE:Storage and Re-trieval for Images and Video Databases III, San Jose, CA, vol. 2420, pp. 381–392 (February 1995)

    Google Scholar 

  19. Belkasim, S., Shridhar, M., Ahmadi, M.: Pattern Recognition with Moment Invariants: A Comparative Study and New Results. Pattern recognition 24(12), 1117–1138 (1991)

    Article  Google Scholar 

  20. Hu, M.-K.: Visual Pattern Recognition by Moment Invariants. IEEE Transaction on Infor-mation Theory 8(2), 179–187 (1962)

    Article  Google Scholar 

  21. Johnsson, G.: Visual Motion Perception, pp. 76–88. Scientific American (June 1975)

    Google Scholar 

  22. Mallat, S.: Wavelets for Vision. Proceedings of the IEEE 84(4), 604–614 (1996)

    Article  Google Scholar 

  23. Mallat, S.G.: A Theory for Multiresolution Signal Decomposition:The Wavelet Representation. IEEE - Pattern Analysis and Machine Intelligence 11(7), 674–693 (1989)

    Article  MATH  Google Scholar 

  24. Birney, K.A., Fischer, T.R.: On the Modelling of DCT and Subband Image Data for Compression. IEEE Transaction on Image Processing 4(2) (February 1995)

    Google Scholar 

  25. Sharifi, K., Leon-Garcia, A.: Estimation of Shape parameter for Generalized Gaussian Distribution in Subband decompositions of Video. IEEE - Transaction on Circuits and Systems for Video Technology 5(1) (1995)

    Google Scholar 

  26. Qjidaa, H., Radouane, L.: Robust Line Fitting in a Noisy Image by the Method of Moments. IEEE Trans. on PAMI 21(11), 1216–1223 (1999)

    Google Scholar 

  27. Kreyszig, E.: Advanced Engineering Mathematics, 8th edn. John Wiley Sons, Chichester (1999)

    Google Scholar 

  28. Sarlashkar, A.N.B., Malkani, M.J.: Feature Extraction Using Wavelet Transform for Neural Network Based Image Classification. In: Proceeding of the Thirtieth Southeastern Symposium in System Theory, Morgantown, WV, USA (1998)

    Google Scholar 

  29. Weiss, L.: Geometric Invariants and Object Recognition. International Journal of Computer Vision 10, 207–231 (1993)

    Article  Google Scholar 

  30. Shavit, E., Jepson, A.: Motion Understanding Using Phase Portraits. In: IJCAI: workshop: Looking at people (1995)

    Google Scholar 

  31. Polana, R., Nelson, R.: Low Level Recognition of Human Motion. In: IEEE Workshop on Motion of Non-Rigid and Articulated Motion, Austin, Texas, pp. 77–82 (1994)

    Google Scholar 

  32. Mandal, M.K., Aboulnasr, T., Panchanathan, S.: Image Indexing Using Moments and Wavelets. IEEE Transaction on Consumer Electronics 42(3), 557–565 (1996)

    Article  Google Scholar 

  33. Mukundan, R., Ramakrishnan, K.R.: Moment Functions In Image Analysis, Theory and Application, pp. 85–87. World Scientific Publishing Co, Singapore (1998)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of ECE, RMIT University, PO Box 2476V, Melbourne, 3001, Australia

    Arun Sharma & Dinesh K. Kumar

Authors
  1. Arun Sharma
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Dinesh K. Kumar
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Faculty of Information Technology, Monash University, VIC 3800, Australia

    Geoffrey I. Webb

  2. Science, Engineering and Technology Portfolio, Royal Melbourne Institute of Technology, VIC 3001, Melbourne, Australia

    Xinghuo Yu

Rights and permissions

Reprints and permissions

Copyright information

© 2004 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Sharma, A., Kumar, D.K. (2004). Moments and Wavelets for Classification of Human Gestures Represented by Spatio-Temporal Templates. In: Webb, G.I., Yu, X. (eds) AI 2004: Advances in Artificial Intelligence. AI 2004. Lecture Notes in Computer Science(), vol 3339. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-30549-1_20

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-30549-1_20

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-24059-4

  • Online ISBN: 978-3-540-30549-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation