Abstract
In this paper, a new method using level set is proposed for abnormal event detection and localization in video surveillance. From an input video, five image descriptors, namely the color moments, the edge histogram descriptors, the color and edge directivity descriptors, the color layout descriptors, and the scalable color descriptors, are extracted for robust detection. We employ the local binary fitting model as the statistical learning model to update by the input videos in real time. We performed experiments on the publicly available UCSD anomaly detection dataset and showed that our method has good performance for detecting and localizing abnormality compared to the state-of-the-art methods.
Similar content being viewed by others
References
Popoola, O.P., Wang, K.: Video-based abnormal human behavior recognition a review. IEEE Trans. Syst. Man Cybern. C 42(6), 865–878 (2012)
Li, T., Chang, H., Wang, M., Ni, B., Hong, R., Yan, S.: Crowded scene analysis: a survey. IEEE Trans. Circuits Syst. Video Technol. 25(3), 367–386 (2015)
Aggarwal, J.K., Ryoo, M.S.: Human activity analysis: a review. ACM Comput. Surv. 43(3), 16 (2011)
Liu, H., Chen, S., Kubota, N.: Intelligent video systems and analytics: a survey. IEEE Trans. Ind. Inf. 9(3), 1222–1233 (2013)
Chaquet, J.M., Carmona, E.J., Antonio Fernández-Caballero, A.: A survey of video datasets for human action and activity recognition. Comput. Vis. Image Underst. 117, 633–659 (2013)
Lim, C.H., Vats, E., Chan, C.S.: Fuzzy human motion analysis: a review. Pattern Recognit. 48(5), 1773–1796 (2015)
Ye, L., Nie, L., Liu, L., Rosenblum, D.S.: From action to activity. Neurocomputing 181(C), 108–115 (2016)
Kok, V.J., Lim, M.K., Chan, C.S.: Crowd behavior analysis: a review where physics meets biology. Neurocomputing 177, 342–362 (2016)
Kim, K., Lee, D., Essa, I.: Gaussian process regression flow for analysis of motion trajectories. In: Proceedings of IEEE International Conference on Computer Vision, pp. 1164–1171 (2011)
Lin, L., Lu, Y., Pan, Y., Chen, X.: Integrating graph partitioning and matching for trajectory analysis in video surveillance. IEEE Trans. Image Process. 21(12), 4844–4857 (2012)
Lee, S.C., Nevatia, R.: Hierarchical abnormal event detection by real time and semi-real time multi-tasking video surveillance system. Mach. Vis. Appl. 25(1), 133–143 (2014)
Patino, L., Ferryman, J.: Multiresolution semantic activity characterisation and abnormality discovery in videos. Appl. Soft Comput. 25, 485–495 (2014)
Yuan, Y., Fang, J., Wang, Q.: Online anomaly detection in crowd scenes via structure analysis. IEEE Trans. Cybern. 45(3), 562–575 (2015)
Bastani, V., Marcenaro, L., Regazzoni, C.S.: Online nonparametric Bayesian activity mining and analysis from surveillance video. IEEE Trans. Image Process. 25(5), 2089–2102 (2016)
Sharif, M.H., Djeraba, C.: An entropy approach for abnormal activities detection in video streams. Pattern Recognit. 45(7), 2543–2561 (2012)
Zhao, B., Fei-Fei, L., Xing, E.: Online detection of unusual events in videos via dynamic sparse coding. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 3313–3320 (2011)
Wang, T., Snoussi, H.: Detection of abnormal visual events via global optical flow orientation histogram. IEEE Trans. Inf. Forensics Secur. 9(6), 988–998 (2014)
Xiong, G., Cheng, J., Wu, X., Chen, Y., Ou, Y., Xu, Y.: An energy model approach to people counting for abnormal crowd behavior detection. Neurocomputing 83(4), 121–135 (2012)
Ren, W., Li, G., Chen, J., Liang, H.: Abnormal crowd behavior detection using behavior entropy model. In: Proceedings of International Conference on Wavelet Analysis and Pattern Recognition, pp. 212–221 (2012)
Mehran, R., Oyama, A., Shah, M.: Abnormal crowd behavior detection using social force model. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 935–942 (2009)
Zhang, Y., Qin, L., Ji, R., Yao, H., Huang, Q.: Social attribute-aware force model: exploiting richness of interaction for abnormal crowd detection. IEEE Trans. Circuits Syst. Video Technol. 25(7), 1231–1245 (2015)
Mukherjee, S., Goswami, D., Chatterjee, S., Lagrangian, A.: Approach to modeling and analysis of a crowd dynamics. IEEE Trans. Syst. Man Cybern. Syst. 45(6), 865–876 (2015)
Cui, X., Liu, Q., Gao, M., Metaxas, D.N.: Abnormal detection using interaction energy potentials. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 3161–3167 (2011)
Cong, Y., Yuan, J., Liu, J.: Abnormal event detection in crowded scenes using sparse representation. Pattern Recognit. 46(7), 1851–1864 (2013)
Zhu, X., Liu, J., Wang, J., Li, C., Lu, H., Lu, H.: Sparse representation for robust abnormality detection in crowded scenes. Pattern Recognit. 47, 1791–1799 (2014)
Li, W., Mahadevan, V., Vasconcelos, N.: Anomaly detection and localization in crowded scenes. IEEE Trans. Pattern Anal. Mach. Intell. 36(1), 18–32 (2014)
Junejo, I.N.: Using dynamic Bayesian network for scene modeling and anomaly detection. Signal Image Video Process. 4(1), 1–10 (2010)
Revathi, A.R., Kumar, D.: An efficient system for anomaly detection using deep learning classifier. Signal Image Video Process. 11(2), 291–299 (2017)
Li, C., Xu, C.: Level set evolution without re-initialization: a new variational formulation. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 430–436 (2005)
Yan, C., Zhang, Y., Jizheng, X., Dai, F., Li, L., Dai, Q., Feng, W.: A highly parallel framework for HEVC coding unit partitioning tree decision on many-core processors. IEEE Signal Process. Lett. 21(5), 573–576 (2014)
Yan, C., Zhang, Y., Jizheng, X., Dai, F., Zhang, J., Li, L., Dai, Q., Feng, W.: Efficient parallel framework for HEVC motion estimation on many-core processors. IEEE Trans. Circuits Syst. Video Technol. 24(12), 2077–2089 (2014)
Yan, C., Zhang, Y., Dai, F., Zhang, J., Li, L., Dai, Q.: Efficient parallel HEVC intra prediction on many-core processor. Electron. Lett. 50(11), 805–806 (2014)
Yan, C., Zhang, Y., Dai, F., Li, L.: Highly parallel framework for HEVC motion estimation on many-core platform. Proc. Data Compress. Conf. 6(3), 63–72 (2013)
Do, M.N., Vetterli, M.: The contourlet transform: an efficient directional multiresolution image representation. IEEE Trans. Image Process. 14(12), 2091–2106 (2005)
Jegou, H., Schmid, C., Douze, M., Perez, P.: Aggregating local descriptors into a compact image representation. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 3304–3311 (2010)
Naiyan, W., Yeung, D.-Y.: Learning a deep compact image representation for visual tracking. In: Proceedings of Advances in Neural Information Processing Systems, pp. 809–817 (2013)
Haoxiang, W., Wang, J.: An effective image representation method using kernel classification. In: IEEE 26th International Conference on Tools with Artificial Intelligence, pp. 853–858 (2014)
Chen, Y., Bao, H., He, X.: Nonnegative local coordinate factorization for image representation. IEEE Trans. Image Process. 22(3), 969–979 (2013)
Hyvärinen, A., Oja, E.: Independent component analysis: algorithms and application. Neural Netw. 13(4–5), 411–430 (2000)
Paragios, N.K., Deriche, R.: A PDE-based level-set approach for detection and tracking of moving objects. In: Proceedings of IEEE International Conference on Computer Vision, pp. 1139–1145 (1998)
Mansouri, A.-R.: Region tracking via level set PDEs without motion computation. IEEE Trans. Pattern Anal. Mach. Intell. 24(7), 947–961 (2002)
Nikos, P., Deriche, R.: Geodesic active contours and level sets for the detection and tracking of moving objects. IEEE Trans. Pattern Anal. Mach. Intell. 22(3), 266–280 (2000)
Tsai, H.-H., Chang, B.-M., Lo, P.-S., Peng, J.-Y.: On the design of a color image retrieval method based on combined color descriptors and features. In: IEEE International Conference on Computer Communication and the Internet, pp. 392–395 (2016)
Varior, R.R., Wang, G., Lu, J.: Learning invariant color features for person reidentification. IEEE Trans. Image Process. 25(7), 3395–3410 (2016)
Muhammad, F., Salam, S.A., Fazli, W., Asadullah, S.: A robust technique of brain MRI classification using color features and K-nearest neighbors algorithm. Int. J. Signal Process. Image Process. Pattern Recognit. 9(10), 11–20 (2016)
Trujillo, A.S., Contreras, V.: Color features as an approach for the automated screening of Salmonella strain. J. Electron. Imaging 25(6), 061411–061411 (2016)
Chaudhary, N.: A combined approach to SBIR using edge histogram descriptor with contourlet transform. IMS Manthan (J. Innov.) 11(1), 203–219 (2016)
Liangpeng, X., Li, Y., Fan, C., Jin, H., Shi, X.: Incorporating gradient magnitude in computation of edge oriented histogram descriptor. Electron. Imaging 2, 1–7 (2016)
UCSD Anomaly Detection Dataset. http://www.svcl.ucsd.edu/projects/anomaly/dataset.htm
Mahadevan, V., Li, V., Bhalodia, V.: Anomaly detection in crowded scenes. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1975-1981 (2010)
Lee, D.-G., Suk, H.-I., Park, S.-K., Lee, S.-W.: Motion influence map for unusual human activity detection and localization in crowded scenes. IEEE Trans. Circuits Syst. Video Technol. 25(10), 1612–1623 (2015)
Acknowledgements
This work was supported by the National Natural Science Foundation of China (Grant No. 31201133).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Kangwei, L., Jianhua, W. & Zhongzhi, H. Abnormal event detection and localization using level set based on hybrid features. SIViP 12, 255–261 (2018). https://doi.org/10.1007/s11760-017-1153-0
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11760-017-1153-0