Skip to main content

Advertisement

SpringerLink
Log in

Automated human behavior analysis from surveillance videos: a survey

  • Published:
Artificial Intelligence Review Aims and scope Submit manuscript

Abstract

With increasing crime rates in today’s world, there is a corresponding awareness for the necessity of detecting abnormal activity. Automation of abnormal Human behavior analysis can play a significant role in security by decreasing the time taken to thwart unwanted events and picking them up during the suspicion stage itself. With advances in technology, surveillance systems can become more automated than manual. Human Behavior Analysis although crucial, is highly challenging. Tracking and recognizing objects and human motion from surveillance videos, followed by automatic summarization of its content has become a hot topic of research. Many researchers have contributed to the field of automated video surveillance through detection, classification and tracking algorithms. Earlier research work is insufficient for comprehensive analysis of human behavior. With the introduction of semantics, the context of a surveillance domain may be established. Such semantics may extend surveillance systems to perform event-based behavior analysis relevant to the domain. This paper presents a survey on research on human behavior analysis with a scope of analyzing the capabilities of the state-of-art methodologies with special focus on semantically enhanced analysis.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • BenAbdelkadert C, Cutler R, Davist L (2002) Person identification using automatic height and stride estimation. In: Proceedings of 16th international conference on pattern recognition, pp 377–380

  • Bremond F, Thonnat M, Zuniga M (2005) Video understanding framework for automatic behavior recognition. Behav Res Methods 38(3): 416–426

    Article  Google Scholar 

  • Brown JA, Capson DW (2011) A framework for 3D model-based visual tracking using a GPU-accelerated particle filter. IEEE Trans Vis Comput Graph 80(1): 60–80

    Google Scholar 

  • Brox T, Rosenhahn B, Gall J, Cremers D (2010) Combined region and motion-based 3D tracking of rigid and articulated objects. IEEE Trans Pattern Anal Mach Intell 32(3): 402–415

    Article  Google Scholar 

  • Chang M-C, Krahnstoever N, Lim S, Yu T (2010) Group level activity recognition in crowded environments across multiple cameras. In: Seventh IEEE international conference on advanced video and signal based surveillance, pp 56–63

  • Chen M (2010) Long term activity analysis in surveillance video archives

  • Chen Y-K, Lin Y-T, Kung SY (1996) A feature tracking algorithm using neighborhood relaxation with multi-candidate pre-screening. In: IEEE international conference on image processing, pp 513–516

  • Denman S, Fookes C, Sridharan S(2009) Improved simultaneous computation of motion detection and optical flow for object tracking. In: Digital image computing: techniques and applications, pp 175–182

  • Feris R, Petterson J, Siddiquie B, Brown L, Pankanti S (2011) Large-scale vehicle detection in challenging Urban surveillance environments. In: IEEE workshop on applications of computer vision, pp 527–533

  • Foroughi H, Yazdi HS, Pourreza H, Javidi M (2008) An eigenspace-based approach for human fall detection using integrated time motion image and multi-class support vector machine. In: IEEE 4th international conference on intelligent computer communication and processing, pp 83–90

  • Gandhi T, Trivedi MM (2006) Panoramic appearance map (PAM) for multi-camera based person re-identification. In: Proceedings of the IEEE international conference on video and signal based surveillance, p 78

  • Huang K, Tao D, Yuan Y, Li X, Tan T (2011) Biologically inspired features for scene classification in video surveillance. IEEE Trans Syst Man Cybern B Cybern 41(1): 307–313

    Article  Google Scholar 

  • Huang S-C (2011) An advanced motion detection algorithm with video quality analysis for video surveillance systems. IEEE Trans Circuits Syst Video Technol 21(1): 1–14

    Article  Google Scholar 

  • Javed O, Shafique K, Shah M (2002) A hierarchical approach to robust background subtraction using color and gradient information. In: IEEE proceedings of workshop on motion and video computing

  • Kim T, Lee S, Paik J (2011) Combined shape and feature-based video analysis and its application to non-rigid object tracking. Inst Eng Technol Image Process 5(1): 87–100

    Article  Google Scholar 

  • Kiryati N, Riklin TR, Ivanchenko Y, Rochel S (2008) Real-time abnormal motion detection in surveillance video. In: IEEE 19th international conference on pattern recognition, pp 1–4

  • Ko T (2008) A survey on behaviour analysis in video surveillance applications. In: 37th IEEE applied imagery pattern recognition workshop ’08, pp 1–8

  • Lao W, Han J, deWith PHN (2010) Flexible human behavior analysis framework for video surveillance applications. Int J Digit Multimed Broadcast, Article ID 920121, 1–9

    Google Scholar 

  • Lee BH, Choi I, Jeon GJ (2006) Motion-based moving object tracking using an active contour. In: International conference on acoustics, speech, and signal processing, pp 649–652

  • Leykin A, Tuceryan M (2007) Detecting shopper groups in video sequences. In: IEEE conference on advanced video and signal based surveillance, pp 417–422

  • Li W, Zhang Z, Liu Z (2010) Action recognition based on a bag of 3D points. In: IEEE computer society conference on computer vision and pattern recognition workshops, pp 9–14

  • Lin W, Sun M-T, Poovendran R, Zhang Z (2010) Group event detection with a varying number of group members for video surveillance. IEEE Trans Circuits Syst Video Technol 20(8): 1057–1067

    Article  Google Scholar 

  • Liang Y-M, Shih S-W, Shih AC-C, Mark Liao H-Y, Lin C-C (2009) Unsupervised analysis of human behavior based on manifold learning. In: IEEE international symposium on circuits and systems, pp 2605–2608

  • Liao S-K, Liu B-Y (2010) An edge-based approach to improve optical flow algorithm. In: Third international conference on advanced computer theory and engineering, vol 6, pp 45–61

  • Mahadevan V, Vasconcelos N (2009) Segmentation of motion objects from surveillance video sequences using temporal differencing combined with multiple correlation. In: Advanced video and signal-based surveillance, pp 472–477

  • McIvor AM (1999) Background subtraction techniques. Reveal Ltd, New Zealand

    Google Scholar 

  • Ogale NA (2006) A survey of techniques for human detection from video

  • Park J-S, Yoon J-H, Kim C (2005) STable 2D feature tracking for long video sequences. Int J Signal Process Image Process Pattern Recogn 1(1): 39–46

    Google Scholar 

  • Park S, Aggarwal JK (2004) Semantic-level understanding of human actions and interactions using event hierarchy. In: IEEE computer society conference on computer vision and pattern recognition workshops

  • Peursum P, Bui HH, Venkatesh S, West G (2005) Robust recognition and segmentation of human actions using HMMs with missing observations. Eur Assoc Signal Process J Appl Signal Process 2005: 2110–2126

    Article  Google Scholar 

  • Rahimt HA, Sheikh UU, Ahmad RB, Zaint ASM, Ariffin WNFW (2010) Vehicle speed detection using frame differencing for smart surveillance system. In: International conference on information science, signal processing and their applications, pp 630–633

  • Roach M, Mason JS, Pawlewski M (2001) Motion-based classification of cartoons. In: Proceedings of 2001 international symposium on intelligent multimedia, video and speech processing, pp 146–149

  • Robertson security submission (2006) Automatic human behaviour recognition and explanation for CCTV video surveillance

  • Rougier C, Meunier J, St-Arnaud A, Rousseau J (2011) Robust video surveillance for fall detection based on human shape deformation. IEEE Trans Circuits Syst Video Technol 21(5): 611–622

    Article  Google Scholar 

  • Seki M, Fujiwara H, Sumi K (2000) A robust background subtraction method for changing background. In: Fifth IEEE workshop on applications of computer vision 2000, pp 207–213

  • Shafie AA, Hafiz F, Ali MH (2009) Motion detection techniques using optical flow. In: World Academy of Science, Engineering and Technology, vol 56

  • Tabb K, Davey N, Adams R, George S (2004) Detecting, tracking & classifying human movement using active contour models and neural networks. In: Innovations in intelligent systems, Physica (Springer) Verlag, pp 343–360

  • Techmer A (2001) Contour-based motion estimation and object tracking for real-time applications. IEEE, Infineon Technologies AG, Corporate Research

  • Xiaofeng L, Tao Z, Zaiwen L (2010) A novel method on moving-objects detection based on background subtraction and three frames differencing. In: International conference on measuring technology and mechatronics automation, pp 252–256

  • Yoshimitsu Y, Naito T, Fujimura K, Kamijo S (2010) Behavior understanding at railway station by association of locational semantics and postures. In: IEEE international conference on systems man and cybernetics, pp 3033–3038

  • Yunus RM (2009) Development of algorithm for human non-human object classification. Scholarly paper, University of Teknikal

Download references

Author information

Authors and Affiliations

  1. Department of Information Science and Technology, College of Engineering, Anna University, Chennai, India

    D. Gowsikhaa, S. Abirami & R. Baskaran

Authors
  1. D. Gowsikhaa
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. S. Abirami
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. R. Baskaran
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to S. Abirami.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Gowsikhaa, D., Abirami, S. & Baskaran, R. Automated human behavior analysis from surveillance videos: a survey. Artif Intell Rev 42, 747–765 (2014). https://doi.org/10.1007/s10462-012-9341-3

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10462-012-9341-3

Keywords

Search

Navigation