Abstract
Recently, surveillance systems have been widely used to analyze video recordings captured by surveillance cameras and to detect abnormal or irregular events in real-world scenes. In this study, we present a novel system that detects abnormal events. Unlike conventional methods, we consider abnormal event detection as variation matching problems. In approaching this problem, we transform from a single video to multiple ones by imposing variations on the video. Using a fully connected cross-entropy Monte Carlo method, we match multiple videos in a fully connected manner and detect abnormal events in all the videos concurrently. The experimental results show that our method can accurately detect abnormal events in multiple videos. Our proposed method can be used to automatically recognize abnormal events included in multi-view CCTV videos, which are available at airport terminals and underground stations.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Alvarez, A.M., Yamada, M., Kimura, A., Iwata, T.: Clustering-based anomaly detection in multi-view data. In: CIKM (2013)
Bobick, A.F., Davis, J.W.: The recognition of human movement using temporal templates. IEEE Trans. Pattern Anal. Mach. Intell. 23(3), 257–267 (2001)
Boiman, O., Irani, M.: Detecting irregularities in images and in video. IJCV 74(1), 17–31 (2007)
Collins, R., Lipton, A., Kanade, T.: Introduction to the special section on video surveillance. IEEE Trans. Pattern Anal. Mach. Intell. 22(8), 745–746 (2000)
Feng, Y., Yuan, Y., Lu, X.: Deep representation for abnormal event detection in crowded scenes. In: MM (2016)
Gao, J., Fan, W., Turaga, D., Parthasarathy, S., Han, J.: A spectral framework for detecting inconsistency across multi-source object relationships. In: ICDM (2011)
Ghanem, N., DeMenthon, D., Doermann, D., Davis, L.: Representation and recognition of events in surveillance video using petri nets. In: CVPRW (2004)
Guo, J., Zhu, W.: Partial multi-view outlier detection based on collective learning. In: AAAI (2018)
Haines, T., Xiang, T.: Delta-dual hierarchical dirichlet processes: a pragmatic abnormal behavior detector. In: ICCV (2011)
Hasan, M., Choi, J., Neumann, J., Roy-Chowdhury, A.K., Davis, L.S.: Learning temporal regularity in video sequences. In: CVPR (2016)
Hull, J.J.: A database for handwritten text recognition research. IEEE Trans. Pattern Anal. Mach. Intell. 16(5), 550–554 (1994)
Isard, M., Blake, A.: Icondensation: unifying low-level and high-level tracking in a stochastic framework. In: ECCV (1998)
Khan, Z., Balch, T., Dellaert, F.: MCMC-based particle filtering for tracking a variable number of interacting targets. IEEE Trans. Pattern Anal. Mach. Intell. 27(11), 1805–1918 (2005)
Kim, J., Grauman, K.: Observe locally, infer globally: a space-time MRF for detecting abnormal activities with incremental updates. In: CVPR (2009)
Kwon, J., Lee, K.M.: Simultaneous video synchronization and rare event detection via cross-entropy Monte Carlo optimization. In: ICCVW (2009)
Kwon, J., Lee, K.M.: Tracking by sampling trackers. In: ICCV (2011)
LeCun, Y., Bottou, L., Bengio, Y., Haaffner, P.: Gradient-based learning applied to document recognition. Proc. IEEE 86(11), 2278–2324 (1998)
Li, S., Shao, M., Fu, Y.: Multi-view low-rank analysis for outlier detection. In: SDM (2015)
Nilsback, M.E., Zisserman, A.: A visual vocabulary for flower classification. In: CVPR (2006)
Rubinstein, R.Y., Kroese, D.P.: The Cross-Entropy Method: A Unified Approach to Combinatorial Optimization, Monte Carlo Simulation, and Machine Learning. Springer, Berlin (2004)
Sabokrou, M., Fayyaz, M., Fathy, M., Klette, R.: Deep-cascade: cascading 3d deep neural networks for fast anomaly detection and localization in crowded scenes. IEEE Trans. Image Process. 26(4), 1992–2004 (2017)
Sultani, W., Chen, C., Shah, M.: Real-world anomaly detection in surveillance videos. arXiv:1801.04264 (2018)
Weinland, D., Boyer, E., Ronfard, R.: Action recognition from arbitrary views using 3d exemplars. In: ICCV (2007)
Xiang, T., Gong, S.: Video behavior profiling for anomaly detection. IEEE Trans. Pattern Anal. Mach. Intell. 30(5), 893–908 (2008)
Xu, D., Yan, Y., Ricci, E., Sebe, N.: Detecting anomalous events in videos by learning deep representations of appearance and motion. CVIU 156, 117–127 (2017)
Yan, C., Gong, B., Wei, Y., Gao, Y.: Deep multi-view enhancement hashing for image retrieval. IEEE Trans. Pattern Anal. Mach. Intell. (2020). https://doi.org/10.1109/TPAMI.2020.2975798
Yan, C., Li, Z., Zhang, Y., Liu, Y., Ji, X.: Depth image denoising using nuclear norm and learning graph model. ACM Trans. Multimed. Comput. Commun. 16(4), 1–7 (2020)
Yan, C., Shao, B., Zhao, H., Ning, R., Zhang, Y., Xu, F.: 3D room layout estimation from a single RGB image. IEEE Trans. Multimed. 22(11), 3014–3024 (2020)
Zhao, H., Fu, Y.: Dual-regularized multi-view outlier detection. In: IJCAI (2015)
Acknowledgements
This work was partly supported by the National Research Foundation of Korea (NRF) grant funded by the Korea government (NRF-2020R1C1C1004907) and partly supported by the Chung-Ang University Graduate Research Scholarship Grants in 2018.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Cho, S., Kwon, J. Abnormal event detection by variation matching. Machine Vision and Applications 32, 80 (2021). https://doi.org/10.1007/s00138-021-01205-6
Received:
Revised:
Accepted:
Published:
DOI: https://doi.org/10.1007/s00138-021-01205-6