Skip to main content
Springer Nature Link
Log in

An anomaly-introduced learning method for abnormal event detection

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Abnormal event detection aims at identifying anomalies under specific scene and it is widely utilized in health monitoring, public security and pedestrian surveillance. The main challenges are spatiotemporally localizing abnormal and limiting the time cost. Besides, most existing methods only use normal event in training video sequences. We propose an anomaly-introduced learning (AL) method to detect abnormal events. A graph-based multi-instance learning (MIL) model is formed with both normal and abnormal video data. A set of potentially abnormal instances and a coarse classifier are generated by the MIL model. These instances are adopted for an improved dictionary learning, which we call anchor dictionary learning (ADL). The sparse reconstruction cost (SRC) is selected to measure the abnormality. Compared with other methods, we (i) make use of abnormal information and (ii) prune testing instances with a coarse filter and reduce time cost of computing SRC. Experiments demonstrate the effect of our proposed AL method by competitive performance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  1. Adam A, Rivlin E, Shimshoni I, Reinitz D (2008) Robust real-time unusual event detection using multiple fixed-location monitors. IEEE Trans Pattern Anal Mach Intell 30(3):555–560

    Article  Google Scholar 

  2. Ali S, Shah M (2010) Human action recognition in videos using kinematic features and multiple instance learning. IEEE Trans Pattern Anal Mach Intell 32(2):288–303

    Article  Google Scholar 

  3. Babenko B, Yang M, Belongie SJ (2009) Visual tracking with online multiple instance learning. In: 2009 IEEE computer society conference on computer vision and pattern recognition (CVPR 2009), 20–25 June 2009, Miami, Florida, USA, pp 983–990

  4. Boiman O, Irani M (2007) Detecting irregularities in images and in video. Int J Comput Vis 74(1):17–31

    Article  Google Scholar 

  5. Chen X, Zhang C, Chen S, Rubin SH (2009) A human-centered multiple instance learning framework for semantic video retrieval. IEEE Trans Systems, Man, and Cybernetics Part C 39(2):228– 233

    Article  Google Scholar 

  6. Cinbis RG, Verbeek JJ, Schmid C (2017) Weakly supervised object localization with multi-fold multiple instance learning. IEEE Trans Pattern Anal Mach Intell 39 (1):189–203

    Article  Google Scholar 

  7. Cong Y, Yuan J, Liu J (2011) Sparse reconstruction cost for abnormal event detection. In: The 24th IEEE conference on computer vision and pattern recognition, CVPR 2011, Colorado Springs, CO, USA, 20–25 June 2011, pp 3449–3456

  8. Cong Y, Yuan J, Liu J (2013) Abnormal event detection in crowded scenes using sparse representation. Pattern Recogn 46(7):1851–1864

    Article  Google Scholar 

  9. Efron B, Hastie T, Johnstone I, Tibshirani R (2004) Least angle regression. Ann Stat 32(2):407–499

    Article  MathSciNet  Google Scholar 

  10. Feng Y, Yuan Y, Lu X (2016) Deep representation for abnormal event detection in crowded scenes. In: Proceedings of the 2016 ACM conference on multimedia conference, MM 2016, Amsterdam, The Netherlands, October 15–19, 2016, pp 591–595

  11. Huo J, Gao Y, Yang W, Yin H (2012) Abnormal event detection via multiinstance dictionary learning. In: Intelligent data engineering and automated learning IDEAL 2012 - 13th international conference, Natal, Brazil, August 29–31, 2012. Proceedings, pp 76–83

  12. Li W, Mahadevan V, Vasconcelos N (2014) Anomaly detection and localization in crowded scenes. IEEE Trans Pattern Anal Mach Intell 36(1):18–32

    Article  Google Scholar 

  13. Lin H, Deng JD, Woodford BJ, Shahi A (2016) Online weighted clustering for real-time abnormal event detection in video surveillance. In: Proceedings of the 2016 ACM conference on multimedia conference, MM 2016, Amsterdam, The Netherlands, October 15–19, 2016, pp 536–540

  14. Lu C, Shi J, Jia J (2013) Abnormal event detection at 150 FPS in MATLAB. In: IEEE international conference on computer vision, ICCV 2013, Sydney, Australia, December 1–8, 2013, pp 2720– 2727

  15. Mahadevan V, Li W, Bhalodia V, Vasconcelos N (2010) Anomaly detection in crowded scenes. In: The twenty-third IEEE conference on computer vision and pattern recognition, CVPR 2010, San Francisco, CA, USA, 13–18 June 2010, pp 1975–1981

  16. Pan Z, Lei J, Zhang Y, Sun X, Kwong S (2016) Fast motion estimation based on content property for low-complexity h.265/HEVC encoder. IEEE Trans Broadcasting 62(3):675–684

    Article  Google Scholar 

  17. Pei J, Jiang D, Zhang A (2005) On mining cross-graph quasi-cliques. In: Proceedings of the eleventh ACM SIGKDD international conference on knowledge discovery and data mining, Chicago, Illinois, USA, August 21–24, 2005, pp 228–238

  18. Ren H, Liu W, Olsen SI, Escalera S, Moeslund TB (2015) Unsupervised behavior-specific dictionary learning for abnormal event detection. In: Proceedings of the british machine vision conference 2015, BMVC 2015, Swansea, UK, September 7–10, 2015, pp 28.1–28.13

  19. Roshtkhari MJ, Levine MD (2013) Online dominant and anomalous behavior detection in videos. In: 2013 IEEE Conference on computer vision and pattern recognition, Portland, OR, USA, June 23–28, 2013, pp 2611–2618

  20. Tillmann AM (2015) On the computational intractability of exact and approximate dictionary learning. IEEE Signal Process Lett 22(1):45–49

    Article  Google Scholar 

  21. Wang P, Liu L, Shen C, Huang Z, van den Hengel A, Shen HT (2016) What’s wrong with that object? identifying images of unusual objects by modelling the detection score distribution. In: 2016 IEEE Conference on computer vision and pattern recognition, CVPR 2016, Las Vegas, NV, USA, June 27–30, 2016, pp 1573–1581

  22. Wen H, Ge S, Chen S, Wang H, Sun L (2015) Abnormal event detection via adaptive cascade dictionary learning. In: 2015 IEEE International conference on image processing, ICIP 2015, Quebec City, QC, Canada, September 27–30, 2015, pp 847–851

  23. Xu D, Ricci E, Yan Y, Song J, Sebe N (2015) Learning deep representations of appearance and motion for anomalous event detection. In: Proceedings of the british machine vision conference 2015, BMVC 2015, Swansea, UK, September 7–10, 2015, pp 8.1–8.12

  24. Yang J, Yan R, Hauptmann AG (2005) Multiple instance learning for labeling faces in broadcasting news video. In: Proceedings of the 13th ACM international conference on multimedia, Singapore, November 6–11, 2005, pp 31–40

  25. Zhao B, Li F, Xing EP (2011) Online detection of unusual events in videos via dynamic sparse coding. In: The 24th IEEE conference on computer vision and pattern recognition, CVPR 2011, Colorado Springs, CO, USA, 20–25 June 2011, pp 3313–3320

  26. Zhu X, Liu J, Wang J, Li C, Lu H (2014) Sparse representation for robust abnormality detection in crowded scenes. Pattern Recogn 47(5):1791–1799

    Article  Google Scholar 

Download references

Acknowledgements

This work is supported by the National Natural Science Foundation of China (grants No. 61672133 and No. 61632007), and the Fundamental Research Funds for the Central Universities (grants No. ZYGX2015J058 and No. ZYGX2014Z007).

Author information

Authors and Affiliations

  1. Center for Future Media, School of Computer Science and Engineering, University of Electronic Science and Technology of China, Chengdu, China

    Chengkun He, Jie Shao & Jiayu Sun

Authors
  1. Chengkun He
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jie Shao
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jiayu Sun
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jie Shao.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

He, C., Shao, J. & Sun, J. An anomaly-introduced learning method for abnormal event detection. Multimed Tools Appl 77, 29573–29588 (2018). https://doi.org/10.1007/s11042-017-5255-z

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-017-5255-z

Keywords