Skip to main content
SpringerLink
Log in

A study on various methods used for video summarization and moving object detection for video surveillance applications

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

With the advancement in digital video technology, video surveillance has been playing its vital role for ensuring safety and security. The surveillance systems are deployed in wide range of applications to invigilate stuffs and to analyse the activities in the environment. From the single or multi surveillance camera, a huge amount of data is generated, stored and processed for security purpose. Due to time constraints, it is a very tedious process for an analyst to go through the full content. This limitation has been overcome by the use of video summarization. The video summarization is intended to afford comprehensible analysis of video by removing duplications and extracting key frames from the video. To make an easily interpreted outline, the various available video summarization methods will try to shot the summary of the main occurrences, scenes, or objects in a frame. Depending on the applications, it is required to summarize the happenings in the scene and detect the objects (static/dynamic) which is recorded in the video. Hence this paper provides the various methods used for video summarization and a comparative study of different techniques. It also presents different object detection, object classification and object tracking algorithms available in the literature.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

References

  1. Adeel M, Weichen Z, Antoni BC (2014) Joint motion segmentation and background estimation in dynamic scenes. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 368–375

  2. Adesh H, Dattatray B, Vibha W (2015) Moving object detection using background subtraction shadow removal and post processing. Int J Comput Appl Int Confer Comput Technol 1–5

  3. Ajmal M, Muhammad HA, Muhammad S, Yasir A, Faiz AS (2012) Video summarization: techniques and classification. In: Springer-Verlag Berlin Heidelberg, ICCVG, pp. 1–13

  4. Baohan X, Wang X, Yu-Gang J (2016) Fast summarization of user-generated videos using semantic, emotional and quality clues. Proceedings of the IEEE Multimedia 1–8

  5. Barga D, Dalton Meitei T (2014) A survey on moving object tracking in video. Int J Inf Theory (IJIT) 3(3):31–46

    Google Scholar 

  6. Chandrika K (2005) Background subtraction for detection of moving object. KOGSIAKS Universitaet Karlsruhe, UCRLWEB214348 1–3

  7. Chenggang Y, Yongdong Z, Jizheng X, Feng D, Liang L, Qionghai D, Feng W (2014) A highly parallel framework for HEVC coding unit partitioning tree decision on many-core processors. IEEE Signal Process Lett 21:573–576

    Article  Google Scholar 

  8. Chenggang Y, Yongdong Z, Jizheng X, Feng D, Jun Z, Qionghai D, Feng W (2014) Efficient parallel framework for HEVC motion estimation on many-Core processors. Circuits Syst Video Technol IEEE Trans 24:2077–2089

    Article  Google Scholar 

  9. Chenggang Y, Hongtao X, Dongbao Y, Jian Y, Yongdong Z, Qionghai D (2017) Supervised hash coding with deep neural network for environment perception of intelligent vehicles. IEEE Trans Intell Transp Syst 99:1–12

    Google Scholar 

  10. Chenggang Y, Hongtao X, Shun L, Jian Y, Yongdong Z, Qionghai D (2017) Effective uyghur language text detection in complex background images for traffic prompt identification. IEEE Trans Intell Transp Syst 99:1–10

    Google Scholar 

  11. Chinh D, Hayder R (2014) RPCA-KFE: key frame extraction for video using robust principal component analysis. IEEE Trans Image Process 11982:1–12

    Google Scholar 

  12. Chung YC, Lu TC, Yeh MT, Huang YX, Wu CY (2015) Applying the video summarization algorithm to surveillance systems. J Image Graph 3(1):20–24

    Google Scholar 

  13. Congcong L, Yi-Ta W, Shiaw-Shian Y, Tsuhan C (2009) Motion-focusing key frame extraction and video summarization for lane surveillance system. IEEE:4329–4332

  14. Correia PL, Pereira F (2003) Objective evaluation of video segmentation quality. IEEE Trans Image Process 12(2):186–200

    Article  Google Scholar 

  15. Deepak Kumar P, Sukadev M (2007) Detection of moving objects using fuzzy color difference histogram based background subtraction. Journal of Latex Class Files 6(1):1–8

    Google Scholar 

  16. Divyani P, Galiyawala HJ (2015) A review on moving object detection and tracking. Int J Comput Appl (2250–1797) 5(3):168–175

    Google Scholar 

  17. El Khattabi Z, Tabii Y, Benkaddour A (2015) Video summarization: techniques and application. Int J Comput Electr Autom Control Inf Eng World Acad Sci Eng Technol 9(4):928–933

    Google Scholar 

  18. Fang-Lue Z, Xian W, Hao-Tian Z, Jue W, Shi-Min H (2016) Robust background identification for dynamic video editing. ACM Trans Graph 35(6):197.1–197.12

    Google Scholar 

  19. Gopal T, Kalpana S, Ghose MK (2014) Moving object detection and segmentation using frame differencing and summing technique. Int J Comput Appl(0975–8887) 102(7):20–25

    Google Scholar 

  20. Hua H, Hong L, Zhang L (2014) VideoWeb: space-time aware Presentationof a Videoclip collection. IEEE J Emerg Sel Top Circuits Syst 4(1):142–152

    Article  Google Scholar 

  21. Imrankhan P, Chetan C (2015) A survey on moving object detection and tracking methods. Int J Comput Sci Inf Technol 6(6):5212–5215

    Google Scholar 

  22. Jeba Veera SJ, Nancy Emymal S (2013) A critical survey of moving object detection techniques and related proposed research. Int J Comput Appl Eng Sci 3:37–40

    Google Scholar 

  23. Kansagara R, Thakore D, Joshi M (2014) A study on video summarization techniques. Int J Innov Res Comput Commun Eng 2:2962–2969

    Google Scholar 

  24. Karasulu B (2010) Review and evaluation of well-known methods for moving object detection and tracking in videos. J Aeronautics Space Technol 4(4):11–22

    Google Scholar 

  25. Kinjal AJ, Darshak GT (2012) A survey on moving object detection and tracking in video surveillance system. Int J Soft Comput Eng (IJSCE) 2(3):44–48

    Google Scholar 

  26. Klaus S, Marco AH, Jochen H (2015) Video interaction tools: a survey of recent work. ACM Comput Surv 48(1):4.1–4.34

    Google Scholar 

  27. Kulchandani JS, Dangarwala KJ (2015) Moving object detection: review of recent research trends. IEEE 22:747–757

    Google Scholar 

  28. Lin-Xie T, Tao M, Xian-Sheng H (2009) Near-lossless video summarization. In: ACM, pp. 351–360

  29. Mahesh CP, Narkhede NS, Saurabh SA (2014) Detection of moving object based on background subtraction. Int J Emerg Trends Technol Comput Sci (IJETTCS) 3(3):215–218

    Google Scholar 

  30. Mei H, Ayesh BM, Daniel FD (2004) Automatic performance evaluation for video summarization. In: MDA904–02-C-0406

  31. Neha G, Neelam B, Shipra A (2016) Motion detection, tracking and classification for automated video surveillanc. In: IEEE International Conference on Power Electronics. Intelligent Control and Energy Systems (ICPEICES), pp. 1–5

  32. Paolo N, Giuseppe B, Francesco T (2015) Attentive monitoring of multiple video streams driven by a Bayesian foraging strategy. IEEE Trans Image Process 24(11):3266–3281

    Article  MathSciNet  Google Scholar 

  33. Paygude SS, Vibha V, Manisha C (2013) Vehicle detection and tracking using the opticalflow and background subtraction. Elsevier, pp. 741–747

  34. Perazzi F, Pont-Tuset J, McWilliams B, Van Gool L, Gross M, Sorkine-Hornung A (2016) A benchmark dataset and evaluation methodology for video object segmentation. In: Computer Vision and Pattern Recognition (CVPR), IEEE, pp. 724–732

  35. Peter O, Jitendra M, Thomas B (2013) Segmentation of moving objects by long term video analysis. IEEE Trans Patt Anal Mach Intell 1–14

  36. Pritee G, Yashpal S, Manoj G (2014) Moving object detection using frame difference, background subtraction and sobs for video surveillance application. In: 3rd International Conference on System Modeling & Advancement in Research Trends (SMART), pp. 151–156

  37. Rodriguez-Canosa GR, Stephen T, del Jaime C, Antonio B, MacDonald B (2012) A real-time method to detect and track moving objects (DATMO) from unmanned aerial vehicles (UAVs) using a single camera. Remote Sensing, pp. 1090–1111

  38. Roshani KD, Dipali YS (2016) Moving object detection with static and dynamic camera for automated videoanalysis. J Inf Knowl Res Comput Eng:769–775

  39. Sandra EF, da Antonio L Jr, de Arnaldo AA, Matthieu C (2008) VSUMM: An Approach for Automatic Video Summarization and Quantitative Evaluation. In: Computer Graphics and Image Processing, ISSN 1530–1834

  40. Sanjay KK, Kunal BR, Ananda SC (2015) Multi-view video summarization using bipartite matching constrained optimum-path Forest clustering. IEEE Trans Multimedia 17(8):1166–1173

    Article  Google Scholar 

  41. Sepehr A, Mahdavi-Nasab H (2013) Optical flow based moving object detection and tracking for traffic surveillance. Int J Electr Comput Energ Electron Commun Eng 7(9):1252–1256

    Google Scholar 

  42. Shaikh SH, et al (2014) Moving object detection using background subtraction. SpringerBriefs in Computer Science 5–14

  43. Shi L, Irwin K, Michael RL (2004) Video summarization by video structure analysis and graph optimization. IEEE Int Conf Multi Expo (ICME) 1959-1962

  44. Shilpa, Prathap HL, Sunitha MR (2016) A survey on moving object detection and tracking techniques. Int J Eng Comput Sci ISSN: 2319–7242 5(4):16263–16269

    Google Scholar 

  45. Shu Z, Yingying Z, Roy-Chowdhury AK (2016) Context-aware surveillance video summarization. IEEE Trans Image Process 25(11):5469–5478

    Article  MathSciNet  Google Scholar 

  46. Shun-Hsing O, Chia-Han L, Srinivasa Somayazulu V, Yen-Kuang C, Shao-Yi C (2015) On-line multi-view video summarization for wireless video sensor network. IEEE J Sel Top Sign Proces 9(1):165–179

    Article  Google Scholar 

  47. Srinivas Rao C, Darwin P (2012) Frame difference and Kalman filter techniques for detection of moving vehicles in video surveillance. Int J Eng Res Appl 2(6):1168–1170

    Google Scholar 

  48. Suganya Devi K, Malmurugan N (2014) OFGM-SMED: an effiecient and robust foreground object detection in compressed video sequences. Eng Apll Artif Intell 28:210–217

    Article  Google Scholar 

  49. Suganya Devi K, Srinivasan P (2015) A survey on compressed video segementation. Aust J Basic Appl Sci 9(21):115–119

    Google Scholar 

  50. Tinumol S, Jiby JP (2015) A survey on video summarization techniques. Int J Comput Appl (0975–8887) 132(13):31–33

    Google Scholar 

  51. Xu LQ (2007) Issues in video analytics and surveillance systems: research / prototyping vs. applications / user requirements (panel discussion). IEEE 23:10–14

    Google Scholar 

  52. Yasmin SK, Soudamini P (2015) Video summarization: survey on event detection and summarization in soccer videos. (IJACSA) Int J Adv Comput Sci Appl 6(11):256–259

    Google Scholar 

  53. Ying Z, Roger Z (2015) Efficient summarization from multiple georeferenced user-generated videos. IEEE 2:1–30

    Google Scholar 

  54. Yong-Jin L, Cuixia M, Guozhen Z, Xiaolan F, Hongan W, Guozhong D, Lexing X (2015) An interactive spiraltape video summarization. IEEE 7:1–14

    Google Scholar 

  55. Yuanyuan W, Xiaohai H, Truong QN, Fellow (2015) Moving objects detection with freely moving camera via background motion subtraction. IEEE:1–13

  56. Zhang L, Qian-Kun X, Lei-Zheng N, Hua H (2013) VideoGraph: a non-linear video representation for efficient Exploration. In: Springer-Verlag, Berlin Heidelberg

  57. Zhang K, Wei-Lun C, Fei S, Kristen G (2016) Video summarization with long short-term memory. In: European Conference on Computer Vision (ECCV), pp. 1–17

Download references

Author information

Authors and Affiliations

  1. Department of CSE, University College of Engineering, Panruti, India

    A. Senthil Murugan, K. Suganya Devi & A. Sivaranjani

  2. Department of Physics, University College of Engineering, Panruti, India

    P. Srinivasan

Authors
  1. A. Senthil Murugan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. K. Suganya Devi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. A. Sivaranjani
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. P. Srinivasan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to K. Suganya Devi.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Senthil Murugan, A., Suganya Devi, K., Sivaranjani, A. et al. A study on various methods used for video summarization and moving object detection for video surveillance applications. Multimed Tools Appl 77, 23273–23290 (2018). https://doi.org/10.1007/s11042-018-5671-8

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-018-5671-8

Keywords

Search

Navigation