Skip to main content
Log in

Anomaly detection in surveillance videos: a thematic taxonomy of deep models, review and performance analysis

  • Published:
Artificial Intelligence Review Aims and scope Submit manuscript

Abstract

The task of anomaly detection has recently gained much attention in the field of visual surveillance. Video surveillance data is often available in large quantities, but manual annotation of activities in video segments is tedious. Anomaly detection plays a crucial role in various indoor and outdoor surveillance applications. Video anomaly detection is highly challenging and provides a lot of scope and demand for improving detection performance in real-time scenarios. Recently, deep learning-based approaches are promising to detect single-scene video anomalies in real-time. This work starts by highlighting the over-view of deep learning-based video anomaly detection. A thematic taxonomy that includes four major categories and several sub-categories is presented. State-of-the-art deep learning approaches under these categories are reviewed. In addition, few recent one class model based deep learning approaches are evaluated and analyzed in terms of performance. Out of the approaches presented, Generative Adversarial Network (GAN) and Adversarial Autoencoder-based approaches provide a better detection rate. A few important directions are outlined for further research in the field of video surveillance applications.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  • Accattoli S, Sernani P, Falcionelli N, Mekuria DN, Dragoni AF (2020) Violence detection in videos by combining 3D convolutional neural networks and support vector machines. Appl Artif Intell 34(4):329–344

    Article  Google Scholar 

  • Andrews JT, Morton EJ, Griffin LD (2016) Detecting anomalous data using auto-encoders. Int J Mach Learn Comput 6(1):21

    Google Scholar 

  • Bahdanau D, Cho K, Bengio Y (2014) Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:1409.0473

  • Blunsden S, Fisher R (2010) The BEHAVE video dataset: ground truthed video for multi-person behavior classification. Ann BMVA 4(1–12):4

    Google Scholar 

  • Borges PVK, Conci N, Cavallaro A (2013) Video-based human behavior understanding: a survey. IEEE Trans Circuit Syst Video Technol 23(11):1993–2008

    Article  Google Scholar 

  • Bromley J, Guyon I, LeCun Y, Säckinger E, Shah R (1994) Signature verification using a “siamese” time delay neural network. In: Advances in neural information processing systems, pp 737–744

  • Buch N, Velastin SA, Orwell J (2011) A review of computer vision techniques for the analysis of urban traffic. IEEE Trans Intell Transp Syst 12(3):920–939

    Article  Google Scholar 

  • Cai Y, Liu J, Guo Y, Hu S, Lang S (2021a) Video anomaly detection with multi-scale feature and temporal information fusion. Neurocomputing 423:264–273

    Article  Google Scholar 

  • Cai R, Zhang H, Liu W, Gao S, Hao Z (2021b) Appearance-motion memory consistency network for video anomaly detection. In: Proceedings of the AAAI conference on artificial intelligence, vol 35, pp 938–946

  • Carneiro SA, da Silva GP, Guimaraes SJF, Pedrini H (2019) Fight detection in video sequences based on multi-stream convolutional neural networks. In: 2019 32nd SIBGRAPI conference on graphics, patterns and images (SIBGRAPI). IEEE, pp 8–15

  • Chalapathy R, Menon AK, Chawla S (2018) Anomaly detection using one-class neural networks. arXiv preprint arXiv:1802.06360

  • Chandrakala S, Shalmiya P, Srinivas V, Deepak K (2021) Object centric and memory guided network based normality modeling for video anomaly detection. SIViP. https://doi.org/10.1007/s11760-022-02161-y

    Article  Google Scholar 

  • Chang CC, Lin CJ (2011) LIBSVM: a library for support vector machines. ACM Trans Intell Syst Technol 2(3):27

    Article  Google Scholar 

  • Chen LC, Yang Y, Wang J, Xu W, Yuille AL (2016) Attention to scale: scale-aware semantic image segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3640–3649

  • Cheng M, Cai K, Li M (2019) RWF-2000: an open large scale video database for violence detection. arXiv preprint arXiv:1911.05913

  • Chong YS, Tay YH (2017) Abnormal event detection in videos using spatiotemporal autoencoder. In: International symposium on neural networks. Springer, pp 189–196

  • Chriki A, Touati H, Snoussi H, Kamoun F (2020) Deep learning and handcrafted features for one-class anomaly detection in UAV video. Multimed Tools Appl 1–22

  • D’Avino D, Cozzolino D, Poggi G, Verdoliva L (2017) Autoencoder with recurrent neural networks for video forgery detection. Electron Imaging 2017(7):92–99

    Article  Google Scholar 

  • Deepak K, Chandrakala S, Mohan CK (2020a) Residual spatiotemporal autoencoder for unsupervised video anomaly detection. Signal Image Video Process 1–8

  • Deepak K, Srivathsan G, Roshan S, Chandrakala S (2020b) Deep multi-view representation learning for video anomaly detection using spatiotemporal autoencoders. Circuits Syst Signal Process 1–17

  • Del Giorno A, Bagnell JA, Hebert M (2016) A discriminative framework for anomaly detection in large videos. In: European conference on computer vision. Springer, pp 334–349

  • Ding C, Fan S, Zhu M, Feng W, Jia B (2014) Violence detection in video by using 3D convolutional neural networks. In: International symposium on visual computing. Springer, pp 551–558

  • Dong Z, Qin J, Wang Y (2016) Multi-stream deep networks for person to person violence detection in videos. In: Chinese conference on pattern recognition. Springer, pp 517–531

  • Dong F, Zhang Y, Nie X (2020) Dual discriminator generative adversarial network for video anomaly detection. IEEE Access

  • Doshi K, Yilmaz Y (2020) Continual learning for anomaly detection in surveillance videos. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition workshops, pp 254–255

  • Doshi K, Yilmaz Y (2022) Rethinking video anomaly detection—a continual learning approach. In: Proceedings of the IEEE/CVF winter conference on applications of computer vision, pp 3961–3970

  • Fan Y, Wen G, Li D, Qiu S, Levine MD, Xiao F (2020) Video anomaly detection and localization via Gaussian mixture fully convolutional variational autoencoder. Comput Vis Image Underst 102920

  • Farhadi A, Redmon J (2018) Yolov3: an incremental improvement. Comput Vis Pattern Recognit

  • Feng Y, Yuan Y, Lu X (2017) Learning deep event models for crowd anomaly detection. Neurocomputing 219:548–556

    Article  Google Scholar 

  • Fisher RB (2004) The PETS04 surveillance ground-truth data sets. In: Proc. 6th IEEE international workshop on performance evaluation of tracking and surveillance, pp 1–5

  • Fritzke B (1995) A growing neural gas network learns topologies. In: Advances in neural information processing systems, pp 625–632

  • Ganokratanaa T, Aramvith S, Sebe N (2022) Video anomaly detection using deep residual-spatiotemporal translation network. Pattern Recogn Lett 155:143–150

    Article  Google Scholar 

  • Girshick R (2015) Fast r-CNN. In: Proceedings of the IEEE international conference on computer vision, pp 1440–1448

  • Gong Y, Lazebnik S, Gordo A, Perronnin F (2012) Iterative quantization: a procrustean approach to learning binary codes for large-scale image retrieval. IEEE Trans Pattern Anal Mach Intell 35(12):2916–2929

    Article  Google Scholar 

  • Gong D, Liu L, Le V, Saha B, Mansour MR, Venkatesh S et al (2019) Memorizing normality to detect anomaly: memory-augmented deep autoencoder for unsupervised anomaly detection. In: Proceedings of the IEEE international conference on computer vision, pp 1705–1714

  • Guo H, Wu X, Li N, Fu R, Liang G, Feng W (2013) Anomaly detection and localization in crowded scenes using short-term trajectories. In: 2013 IEEE international conference on robotics and biomimetics (ROBIO). IEEE, pp 245–249

  • Hamdi S, Bouindour S, Loukil K, Snoussi H, Abid M (2019) Hybrid deep learning and HOF for Anomaly Detection. In: 2019 6th international conference on control, decision and information technologies (CoDIT). IEEE, pp 575–580

  • Hanson A, Pnvr K, Krishnagopal S, Davis L (2018) Bidirectional convolutional LSTM for the detection of violence in videos. In: Proceedings of the European conference on computer vision (ECCV)

  • Hasan M, Choi J, Neumann J, Roy-Chowdhury AK, Davis LS (2016) Learning temporal regularity in video sequences. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 733–742

  • Hinami R, Mei T, Satoh S (2017) Joint detection and recounting of abnormal events by learning deep generic knowledge. In: Proceedings of the IEEE international conference on computer vision, pp 3619–3627

  • Hu J, Zhu E, Wang S, Liu X, Guo X, Yin J (2019) An efficient and robust unsupervised anomaly detection method using ensemble random projection in surveillance videos. Sensors 19(19):4145

    Article  Google Scholar 

  • Huang G, Liu Z, Van Der Maaten L, Weinberger KQ (2017) Densely connected convolutional networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 4700–4708

  • Ionescu RT, Khan FS, Georgescu MI, Shao L (2019a) Object-centric auto-encoders and dummy anomalies for abnormal event detection in video. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 7842–7851

  • Ionescu RT, Smeureanu S, Popescu M, Alexe B (2019b) Detecting abnormal events in video using Narrowed Normality Clusters. In: 2019 IEEE winter conference on applications of computer vision (WACV). IEEE, pp 1951–1960

  • Kamoona AM, Gosta AK, Bab-Hadiashar A, Hoseinnezhad R (2020) Multiple instance-based video anomaly detection using deep temporal encoding-decoding. arXiv preprint arXiv:2007.01548

  • Kim JY, Cho SB (2019) Unsupervised novelty detection in video with adversarial autoencoder based on non-euclidean space. In: 2019 15th international conference on signal-image technology & internet-based systems (SITIS). IEEE, pp 22–27

  • Kingma DP, Welling M (2014) Stochastic gradient VB and the variational auto-encoder. In: Second international conference on learning representations, ICLR. vol 19

  • Kiran BR, Thomas DM, Parakkal R (2018) An overview of deep learning based methods for unsupervised and semi-supervised anomaly detection in videos. J Imaging 4(2):36

    Article  Google Scholar 

  • Krishna R, Zhu Y, Groth O, Johnson J, Hata K, Kravitz J et al (2017) Visual genome: connecting language and vision using crowdsourced dense image annotations. Int J Comput Vis 123(1):32–73

    Article  MathSciNet  Google Scholar 

  • Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. In: Advances in neural information processing systems, pp 1097–1105

  • Kumar DP, Amgoth T, Annavarapu CSR (2019) Machine learning algorithms for wireless sensor networks: a survey. Inf Fusion 49:1–25

    Article  Google Scholar 

  • Li N, Chang F (2019) Video anomaly detection and localization via multivariate gaussian fully convolution adversarial autoencoder. Neurocomputing 369:92–105

    Article  Google Scholar 

  • Li J, Jiang X, Sun T, Xu K (2019) Efficient violence detection using 3d convolutional neural networks. In: 2019 16th IEEE international conference on advanced video and signal based surveillance (AVSS). IEEE, pp 1–8

  • Li N, Chang F, Liu C (2020) Spatial-temporal cascade autoencoder for video anomaly detection in crowded scenes. IEEE Trans Multimed 23:203–215

    Article  Google Scholar 

  • Lin TY, Maire M, Belongie S, Hays J, Perona P, Ramanan D et al (2014) Microsoft coco: common objects in context. In: European conference on computer vision. Springer, pp 740–755

  • Liu W, Luo W, Lian D, Gao S (2018) Future frame prediction for anomaly detection—a new baseline. In: 2018 IEEE conference on computer vision and pattern recognition (CVPR)

  • Liu W, Luo W, Li Z, Zhao P, Gao S, et al (2019) Margin learning embedded prediction for video anomaly detection with a few anomalies. In: IJCAI, pp 3023–3030

  • Li H, Wang J, Han J, Zhang J, Yang Y, Zhao Y (2020) A novel multi-stream method for violent interaction detection using deep learning. Meas Control 0020294020902788

  • Lu C, Shi J, Jia J (2013) Abnormal event detection at 150 fps in matlab. In: Proceedings of the IEEE international conference on computer vision, pp 2720–2727

  • Lu Y, Kumar KM, Shahabeddin Nabavi S, Wang Y (2019) Future frame prediction using convolutional VRNN for anomaly detection. In: 2019 16th IEEE international conference on advanced video and signal based surveillance (AVSS). IEEE, pp 1–8

  • Lu Y, Yu F, Reddy MKK, Wang Y (2020) Few-shot scene-adaptive anomaly detection. In: European conference on computer vision. Springer, pp 125–141

  • Luo W, Liu W, Gao S (2017) A revisit of sparse coding based anomaly detection in stacked RNN framework. In: Proceedings of the IEEE international conference on computer vision, pp 341–349

  • Mabrouk AB, Zagrouba E (2018) Abnormal behavior recognition for intelligent video surveillance systems: a review. Expert Syst Appl 91:480–491

    Article  Google Scholar 

  • Mahadevan V, Li W, Bhalodia V, Vasconcelos N (2010) Anomaly detection in crowded scenes. In: 2010 IEEE computer society conference on computer vision and pattern recognition. IEEE, pp 1975–1981

  • Makhzani A, Frey BJ (2015) Winner-take-all autoencoders. In: Advances in neural information processing systems, pp 2791–2799

  • Mehran R, Oyama A, Shah M (2009) Abnormal crowd behavior detection using social force model. In: 2009 IEEE conference on computer vision and pattern recognition. IEEE, pp 935–942

  • Mu G, Cao H, Jin Q (2016) Violent scene detection using convolutional neural networks and deep audio features. In: Chinese conference on pattern recognition. Springer, pp 451–463

  • Munawar A, Vinayavekhin P, De Magistris G (2017) Spatio-temporal anomaly detection for industrial robots through prediction in unsupervised feature space. In: 2017 IEEE winter conference on applications of computer vision (WACV). IEEE, pp 1017–1025

  • Nayak R, Pati UC, Das SK (2021) A comprehensive review on deep learning-based methods for video anomaly detection. Image Vis Comput 106:104078

    Article  Google Scholar 

  • Nguyen TN, Meunier J (2019) Anomaly detection in video sequence with appearance-motion correspondence. In: Proceedings of the IEEE international conference on computer vision, pp 1273–1283

  • Nievas EB, Suarez OD, García GB, Sukthankar R (2011) Violence detection in video using computer vision techniques. In: International conference on computer analysis of images and patterns. Springer, pp 332–339

  • Park H, Noh J, Ham B (2020) Learning memory-guided normality for anomaly detection. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 14372–14381

  • Patil N, Biswas PK (2016) A survey of video datasets for anomaly detection in automated surveillance. In: 2016 sixth international symposium on embedded computing and system design (ISED). IEEE, pp 43–48

  • Pawar K, Attar V (2019) Deep learning approaches for video-based anomalous activity detection. World Wide Web 22(2):571–601

    Article  Google Scholar 

  • Petrocchi S, Giorgi G, Cimino MG (2021) A real-time deep learning approach for real-world video anomaly detection. In: The 16th international conference on availability, reliability and security, pp 1–9

  • Popoola OP, Wang K (2012) Video-based abnormal human behavior recognition—a review. IEEE Trans Syst Man Cybern Part C 42(6):865–878

    Article  Google Scholar 

  • Pouyanfar S, Chen SC (2017) Automatic video event detection for imbalance data using enhanced ensemble deep learning. Int J Semant Comput 11(01):85–109

    Article  Google Scholar 

  • Radanliev P, De Roure D, Nicolescu R, Huth M, Santos O (2021) Artificial intelligence and the internet of things in industry 4.0. CCF Trans Pervas Comput Interact 3(3):329–338

    Article  Google Scholar 

  • Ramachandra B, Jones M (2020) Street scene: a new dataset and evaluation protocol for video anomaly detection. In: The IEEE winter conference on applications of computer vision, pp 2569–2578

  • Ramachandra B, Jones M, Vatsavai R (2020a) Learning a distance function with a Siamese network to localize anomalies in videos. In: The IEEE winter conference on applications of computer vision, pp 2598–2607

  • Ramachandra B, Jones M, Vatsavai RR (2020b) A survey of single-scene video anomaly detection. IEEE Trans Pattern Anal Mach Intell

  • Ramzan M, Abid A, Khan HU, Awan SM, Ismail A, Ahmed M et al (2019) A review on state-of-the-art violence detection techniques. IEEE Access 7:107560–107575

    Article  Google Scholar 

  • Ravanbakhsh M, Nabi M, Sangineto E, Marcenaro L, Regazzoni C, Sebe N (2017) Abnormal event detection in videos using generative adversarial nets. In: 2017 IEEE international conference on image processing (ICIP). IEEE, pp 1577–1581

  • Ravanbakhsh M, Nabi M, Mousavi H, Sangineto E, Sebe N (2018) Plug-and-play CNN for crowd motion analysis: an application in abnormal event detection. In: 2018 IEEE winter conference on applications of computer vision (WACV). IEEE, pp 1689–1698

  • Rei M, Crichton G, Pyysalo S (2016) Attending to characters in neural sequence labeling models. In: Proceedings of COLING 2016, the 26th international conference on computational linguistics: Technical Papers. Osaka, Japan: The COLING 2016 Organizing Committee, pp 309–318. https://www.aclweb.org/anthology/C16-1030

  • Rezaee K, Rezakhani SM, Khosravi MR, Moghimi MK (2021) A survey on deep learning-based real-time crowd anomaly detection for secure distributed video surveillance. Personal Ubiquitous Comput 1–17

  • Rezaei F, Yazdi M (2021) A new semantic and statistical distance-based anomaly detection in crowd video surveillance. Wirel Commun Mob Comput

  • Roshtkhari MJ, Levine MD (2013) An on-line, real-time learning method for detecting anomalies in videos using spatio-temporal compositions. Comput Vis Image Underst 117(10):1436–1452

    Article  Google Scholar 

  • Sabokrou M, Fathy M, Hoseini M, Klette R (2015) Real-time anomaly detection and localization in crowded scenes. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pp 56–62

  • Sabokrou M, Fayyaz M, Fathy M, Klette R (2017) Deep-cascade: cascading 3d deep neural networks for fast anomaly detection and localization in crowded scenes. IEEE Trans Image Process 26(4):1992–2004

    Article  MathSciNet  MATH  Google Scholar 

  • Sabokrou M, Fayyaz M, Fathy M, Moayed Z, Klette R (2018a) Deep-anomaly: fully convolutional neural network for fast anomaly detection in crowded scenes. Comput Vis Image Underst 172:88–97

    Article  MATH  Google Scholar 

  • Sabokrou M, Khalooei M, Fathy M, Adeli E (2018b) Adversarially learned one-class classifier for novelty detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3379–3388

  • Sabzalian B, Marvi H, Ahmadyfard A (2019) Deep and sparse features for anomaly detection and localization in video. In: 2019 4th international conference on pattern recognition and image analysis (IPRIA). IEEE, pp 173–178

  • Santhosh KK, Dogra DP, Roy PP (2020) Anomaly detection in road traffic using visual surveillance: a survey. ACM Comput Surv 53(6):1–26. https://doi.org/10.1145/3417989

    Article  Google Scholar 

  • Schölkopf B, Williamson RC, Smola AJ, Shawe-Taylor J, Platt JC (2000) Support vector method for novelty detection. In: Advances in neural information processing systems, pp 582–588

  • Simonyan K, Zisserman A (2014) Two-stream convolutional networks for action recognition in videos. In: Advances in neural information processing systems, pp 568–576

  • Singh K, Rajora S, Vishwakarma DK, Tripathi G, Kumar S, Walia GS (2020) Crowd anomaly detection using aggregation of ensembles of fine-tuned ConvNets. Neurocomputing 371:188–198

    Article  Google Scholar 

  • Slavic G, Campo D, Baydoun M, Marin P, Martin D, Marcenaro L et al (2020) Anomaly detection in video data based on probabilistic latent space models. arXiv preprint arXiv:2003.07623

  • Smeureanu S, Ionescu RT, Popescu M, Alexe B (2017) Deep appearance features for abnormal behavior detection in video. In: International conference on image analysis and processing. Springer, pp 779–789

  • Sodemann AA, Ross MP, Borghetti BJ (2012) A review of anomaly detection in automated surveillance. IEEE Trans Syst Man Cybern Part C 42(6):1257–1272

    Article  Google Scholar 

  • Sreenu G, Durai MS (2019) Intelligent video surveillance: a review through deep learning techniques for crowd analysis. J Big Data 6(1):48

    Article  Google Scholar 

  • Srivastava N, Mansimov E, Salakhudinov R (2015) Unsupervised learning of video representations using LSTMS. In: International conference on machine learning, pp 843–852

  • Sudhakaran S, Lanz O (2017) Learning to detect violent videos using convolutional long short-term memory. In: 2017 14th IEEE international conference on advanced video and signal based surveillance (AVSS). IEEE, pp 1–6

  • Sultani W, Chen C, Shah M (2018) Real-world anomaly detection in surveillance videos. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 6479–6488

  • Sun Q, Liu H, Harada T (2017) Online growing neural gas for anomaly detection in changing surveillance scenes. Pattern Recogn 64:187–201

    Article  Google Scholar 

  • Szymanowicz S, Charles J, Cipolla R (2021) X-MAN: explaining multiple sources of anomalies in video. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 3224–3232

  • Tran HT, Hogg D (2017) Anomaly detection using a convolutional winner-take-all autoencoder. In: Proceedings of the British machine vision conference. British Machine Vision Association

  • Tran D, Bourdev L, Fergus R, Torresani L, Paluri M (2015) Learning spatiotemporal features with 3d convolutional networks. In: Proceedings of the IEEE international conference on computer vision, pp 4489–4497

  • Tudor Ionescu R, Smeureanu S, Alexe B, Popescu M (2017) Unmasking the abnormal events in video. In: Proceedings of the IEEE international conference on computer vision, pp 2895–2903

  • Ullah FUM, Ullah A, Muhammad K, Haq IU, Baik SW (2019) Violence detection using spatiotemporal features with 3D convolutional neural network. Sensors 19(11):2472

    Article  Google Scholar 

  • Ullah W, Ullah A, Hussain T, Khan ZA, Baik SW (2021) An efficient anomaly recognition framework using an attention residual LSTM in surveillance videos. Sensors 21(8):2811

    Article  Google Scholar 

  • Update C. Network Camera Firmware Version: V5. 6.2 Release Note (External). Intellect;4:10–3

  • Vincent P, Larochelle H, Bengio Y, Manzagol PA (2008) Extracting and composing robust features with denoising autoencoders. In: Proceedings of the 25th international conference on Machine learning, pp 1096–1103

  • Vu H, Phung D, Nguyen TD, Trevors A, Venkatesh S (2017) Energy-based models for video anomaly detection. arXiv preprint arXiv:1708.05211

  • Vu H, Nguyen TD, Le T, Luo W, Phung D (2019) Robust anomaly detection in videos using multilevel representations. In: Proceedings of the AAAI conference on artificial intelligence, vol 33, pp 5216–5223

  • Wang Z, Bovik AC, Sheikh HR, Simoncelli EP (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13(4):600–612

    Article  Google Scholar 

  • Wang F, Jiang M, Qian C, Yang S, Li C, Zhang H et al (2017) Residual attention network for image classification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3156–3164

  • Wang S, Zeng Y, Liu Q, Zhu C, Zhu E, Yin J (2018) Detecting abnormality without knowing normality: a two-stage approach for unsupervised video abnormal event detection. In: Proceedings of the 26th ACM international conference on multimedia, pp 636–644

  • Wang Z, Zou Y, Zhang Z (2020) Cluster attention contrast for video anomaly detection. In: Proceedings of the 28th ACM international conference on multimedia, pp 2463–2471

  • Wang X, Che Z, Jiang B, Xiao N, Yang K, Tang J et al (2021) Robust unsupervised video anomaly detection by multipath frame prediction. IEEE Trans Neural Netw Learn Syst

  • Wu C, Shao S, Tunc C, Hariri S (2020) Video anomaly detection using pre-trained deep convolutional neural nets and context mining. arXiv preprint arXiv:2010.02406

  • Xiao T, Zhang C, Zha H (2015) Learning to detect anomalies in surveillance video. IEEE Signal Process Lett 22(9):1477–1481

    Article  Google Scholar 

  • Xingjian S, Chen Z, Wang H, Yeung DY, Wong WK, Woo WC (2015) Convolutional LSTM network: a machine learning approach for precipitation nowcasting. In: Advances in neural information processing systems, pp 802–810

  • Xu D, Yan Y, Ricci E, Sebe N (2017) Detecting anomalous events in videos by learning deep representations of appearance and motion. Comput Vis Image Underst 156:117–127

    Article  Google Scholar 

  • Xu M, Yu X, Chen D, Wu C, Jiang Y (2019) An efficient anomaly detection system for crowded scenes using variational autoencoders. Appl Sci 9(16):3337

    Article  Google Scholar 

  • Yan S, Smith JS, Lu W, Zhang B (2018a) Abnormal event detection from videos using a two-stream recurrent variational autoencoder. IEEE Trans Cognitive Dev Syst 12(1):30–42

    Article  Google Scholar 

  • Yan M, Jiang X, Yuan J (2018b) 3D convolutional generative adversarial networks for detecting temporal irregularities in videos. In: 2018 24th international conference on pattern recognition (ICPR). IEEE, pp 2522–2527

  • Yang Y, Fu Z, Naqvi SM (2019)Enhanced adversarial learning based video anomaly detection with object confidence and position. In: 2019 13th international conference on signal processing and communication systems (ICSPCS). IEEE, pp 1–5

  • Zaigham Zaheer M, Mahmood A, Haris Khan M, Segu M, Yu F, Lee SI (2022) Generative cooperative learning for unsupervised video anomaly detection. arXiv e-prints. arXiv–2203

  • Zhang C, Patras P, Haddadi H (2019) Deep learning in mobile and wireless networking: a survey. IEEE Commun Surv Tutor 21(3):2224–2287

    Article  Google Scholar 

  • Zhang Y, Nie X, He R, Chen M, Yin Y (2020) Normality learning in multispace for video anomaly detection. IEEE Trans Circuits Syst Video Technol

  • Zhao Y, Deng B, Shen C, Liu Y, Lu H, Hua XS (2017) Spatio-temporal AutoEncoder for video anomaly detection. In: ACM multimedia

  • Zhong JX, Li N, Kong W, Liu S, Li TH, Li G (2019) Graph convolutional label noise cleaner: Train a plug-and-play action classifier for anomaly detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1237–1246

  • Zhou S, Shen W, Zeng D, Fang M, Wei Y, Zhang Z (2016) Spatial-temporal convolutional neural networks for anomaly detection and localization in crowded scenes. Signal Process 47:358–368

    Google Scholar 

  • Zhou P, Ding Q, Luo H, Hou X (2017) Violent interaction detection in video based on deep learning. J Phys 844:012044

    Google Scholar 

  • Zhou JT, Zhang L, Fang Z, Du J, Peng X, Yang X (2019a) Attention-driven loss for anomaly detection in video surveillance. IEEE Trans Circuits Syst Video Technol

  • Zhou JT, Du J, Zhu H, Peng X, Liu Y, Goh RSM (2019b) Anomalynet: an anomaly detection network for video surveillance. IEEE Trans Inf Forensics Secur 14(10):2537–2550

    Article  Google Scholar 

  • Zhu Y, Newsam S (2019) Motion-aware feature for improved video anomaly detection. arXiv preprint arXiv:1907.10211

Download references

Acknowledgements

This work is supported by Grant No.DST/CSRI/2017/131(G) under Cognitive Science Research Initiative (CSRI), Department of Science and Technology, Government of India.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to S. Chandrakala.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chandrakala, S., Deepak, K. & Revathy, G. Anomaly detection in surveillance videos: a thematic taxonomy of deep models, review and performance analysis. Artif Intell Rev 56, 3319–3368 (2023). https://doi.org/10.1007/s10462-022-10258-6

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10462-022-10258-6

Keywords

Navigation