Skip to main content

Towards Classification Based Human Activity Recognition in Video Sequences

  • Conference paper
  • First Online:

Abstract

Recognizing human activities is an important component of a context aware system. In this paper, we propose a classification based human activity recognition approach. This approach recognizes different human activities based on a local shape feature descriptor and pattern classifier. We have used a novel local shape feature descriptor which is integration of central moments and local binary patterns. Classifier used is flexible binary support vector machine. Experimental evaluations have been performed on standard Weizmann activity video dataset. Six different activities have been considered for evaluation of the proposed method. Two activities have been selected at a time with binary classifier. These are walk-run, bend-jump, and jack-skip pairs. Experimental results and comparisons with other methods, demonstrate that the proposed method performs well and it is capable of recognizing six different human activities in videos.

The original version of this chapter was revised: The copyright line was incorrect. This has been corrected. The Erratum to this chapter is available at DOI: 10.1007/978-3-319-05939-6_37

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Zhu, Y., Nayak, N.M., Roy-Chowdhury, A.K.: Context aware activity recognition and anomaly detection in video. IEEE J. Sel. Top. Signal Process. 7(1), 91–101 (2013)

    Article  Google Scholar 

  2. Chihani, B., Bertin, E., Jeanne, F., Crespi, N.: Context-aware systems: a case study. In: Cherifi, H., Zain, J.M., El-Qawasmeh, E. (eds.) DICTAP 2011, Part II. CCIS, vol. 167, pp. 718–732. Springer, Heidelberg (2011)

    Google Scholar 

  3. OPPORTUNITY Activity Challenge – http://www.opportunity-project.eu/node/58 (2013). Last accessed 27 July 2013

  4. NOKIA Mobile Data Challenge – http://research.nokia.com/page/12000 (2013). Last accessed 27 July 2013

  5. Khare, M., Srivastava, R.K., Khare, A.: Moving object segmentation in Daubechies complex wavelet domain. Accepted for publication in Signal Image and Video Processing. ISSN: 1863-1711. Springer (2013). doi:10.1007/s11760-013-0496-4

  6. Nigam, S., Deb, K., Khare, A.: Moment invariants based object recognition for different pose and appearances in real scenes. In: 2nd IEEE International Conference on Informatics, Electronics & Vision (ICIEV), pp. 1–5, Dhaka, Bangladesh, May 2013

    Google Scholar 

  7. Binh, N.T., Khare, A.: Object tracking of video sequences in curvelet domain. Int. J. Image Graph. 11(1), 1–20 (2011)

    Article  MathSciNet  Google Scholar 

  8. Aggarwal, J.K., Ryoo, M.S.: Human activity analysis: a review. ACM Comput. Surv. 43(3), article 16. http://cvrc.ece.utexas.edu/aggarwaljk/Publications/review_ryoo_hdr.pdf (2011)

  9. Alemdar, H., van Kasteren, T.L.M., Ersoy, C.: Activity recognition with hidden Markov models using active learning. In: 19th IEEE Conference on Signal Processing and Communications Applications (SIU), pp. 1161–1164, Antalya (2011)

    Google Scholar 

  10. Cao, H., Nguyen, M.N., Phua, C., Krishnaswamy, S., Xiao, L.L.: An integrated framework for human activity classification. In: ACM Conference on Ubiquitous Computing (UbiComp’12), pp. 331–340, New York (2012)

    Google Scholar 

  11. Gorelick, L., Blank, M., Shechtman, E., Irani, M., Basri, R.: Actions as space time shapes. IEEE Trans. Pattern Anal. Mach. Intell. 29(12), 2247–2253 (2007)

    Article  Google Scholar 

  12. Liu, C., Yuen, J., Torralba, A.: SIFT flow: dense correspondence across scenes and its applications. IEEE Trans. Pattern Anal. Mach. Intell. 33(5), 978–994 (2011)

    Article  Google Scholar 

  13. Scovanner, P., Ali, S., Shah, M.: A 3-dimensional sift descriptor and its application to action recognition. In: ACM 15th International Conference on Multimedia, pp. 357–360 (2007)

    Google Scholar 

  14. Zhao, Y., Belkasim, S.: Multiresolution Fourier descriptors for multiresolution shape analysis. IEEE Signal Process. Lett. 19(10), 692–695 (2012)

    Article  Google Scholar 

  15. Flusser, J., Suk, T., Zitova, B.: Moments and Moment Invariants in Pattern Recognition. Wiley, New York (2009)

    Book  MATH  Google Scholar 

  16. Hu, M.K.: Visual pattern recognition by moment invariants. IRE Trans. Inf. Theory 8(2), 179–187 (1962)

    Article  MATH  Google Scholar 

  17. Flusser, J., Suk, T.: Combined blur and affine moment invariants and their use in pattern recognition. Pattern Recogn. 36(12), 2895–2907 (2003)

    Article  MATH  Google Scholar 

  18. Chen, B.J., Shu, H.Z., Zhang, H., Chen, G., Toumoulin, C., Dillenseger, J.L., Luo, L.M.: Quaternion Zernike moments and their invariants for color image analysis and object recognition. Signal Process. 92(2), 308–318 (2012)

    Article  Google Scholar 

  19. Hosny, K.M.: Refined translation and scale Legendre moment invariants. Pattern Recogn. Lett. 31(7), 533–538 (2010)

    Article  Google Scholar 

  20. Dalal, N., Triggs, B.: Histogram of oriented gradients for human detection. In: IEEE International Conference on Computer Vision and Pattern Recognition, pp. 886–893, San Diego, CA, USA (2005)

    Google Scholar 

  21. Pang, Y., Yuan, Y., Li, X., Pan, J.: Efficient HOG human detection. Signal Process. 91(4), 773–781 (2011)

    Article  MATH  Google Scholar 

  22. Skibbe, H., Reisert, M., Schmidt, T., Brox, T.: Fast rotation invariant 3D feature computation utilizing efficient local neighborhood operators. IEEE Trans. Pattern Anal. Mach. Intell. 34(8), 1563–1575 (2012)

    Article  Google Scholar 

  23. Nigam, S., Khare, M., Srivastava, R.K., Khare, A.: An effective local feature descriptor for object detection in real scenes. In: IEEE Conference on Information and Communication Technologies (ICT 2013), pp. 244–248, Kanyakumari, India, April 2013

    Google Scholar 

  24. Pietikäinen, M., Hadid, A., Zhao, G., Ahonen, T.: Computer Vision using Local Binary Patterns. Computational Imaging and Vision, vol. 40. Springer, Heidelberg (2011)

    Google Scholar 

  25. Mu, Y., Yan, S., Liu, Y., Huang, T., Zhou, B.: Discriminative local binary patterns for human detection in personal album. In: IEEE International Conference on Computer Vision and Pattern Recognition, pp. 1–8, Anchorage, AK, (2008)

    Google Scholar 

  26. Nguyen, D.T., Ogunbona, P.O., Li, W.: A novel shape-based non-redundant local binary pattern descriptor for object detection. Pattern Recogn. 46(5), 1485–1500 (2013)

    Article  Google Scholar 

  27. Ko, B.C., Kim, D.Y., Jung, J.H., Nam, J.Y.: Three-level cascade of random forests for rapid human detection. Opt. Eng. 52(2), 027204 (2013)

    Article  Google Scholar 

  28. Shen, J., Yang, W., Sun, C.: Real-time human detection based on gentle MILBoost with variable granularity HOG-CSLBP. Neural Comput. Appl. (2012). doi:10.1007/s00521-012-1153-5

    Article  Google Scholar 

Download references

Acknowledgment

This work was supported by the University Grants Commission, New Delhi, India under Grant No. F.No.36-246/2008(SR) and Council of Scientific and Industrial Research, Human Resource Development Group, India via grant no. 09/001/(0362)/2012/EMR-I.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Nguyen Thanh Binh .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 ICST Institute for Computer Science, Social Informatics and Telecommunications Engineering

About this paper

Cite this paper

Binh, N.T., Nigam, S., Khare, A. (2014). Towards Classification Based Human Activity Recognition in Video Sequences. In: Vinh, P., Alagar, V., Vassev, E., Khare, A. (eds) Context-Aware Systems and Applications. ICCASA 2013. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 128. Springer, Cham. https://doi.org/10.1007/978-3-319-05939-6_21

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-05939-6_21

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-05938-9

  • Online ISBN: 978-3-319-05939-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics