Abstract
Currently, the automation of activity recognition of a group of people in closed and open environments is a major problem, especially in video surveillance. It is becoming increasingly important to have computer vision architectures that allow automatic recognition of group activities to make decisions. This paper proposes a computer vision architecture capable of learning and recognizing abnormal group activities using the movements of the group in the scene. It is based on the Activity Description Vector, a descriptor capable of representing the trajectory information of a sequence of images as a collection of local movements that occur in specific regions of the scene. The proposal is based on the evolution of different versions of this descriptor towards the generation of images that will be input of a two-stream classifier capable of robustly classifying abnormal group activities. Moreover, it includes context information to provide extra information to classify the activities including it as the third stream of the classifier resulting in a robust architecture for one class classification problems. The architecture has been evaluated and compared with other approaches using Ped 1 and Ped 2 datasets, obtaining a high performance in abnormal group activity recognition.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Abati, D., Porrello, A., Calderara, S., Cucchiara, R.: Latent space autoregression for novelty detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 481–490 (2019)
Azorin-Lopez, J., Saval-Calvo, M., Fuster-Guillo, A., Garcia-Rodriguez, J., Cazorla, M., Signes-Pont, M.T.: Group activity description and recognition based on trajectory analysis and neural networks. In: 2016 (IJCNN), pp. 1585–1592, July 2016
Azorín-López, J., Saval-Calvo, M., Fuster-Guilló, A., García-Rodríguez, J.: Human behaviour recognition based on trajectory analysis using neural networks. In: The 2013 (IJCNN), pp. 1–7. IEEE (2013)
Azorin-Lopez, J., Saval-Calvo, M., Fuster-Guillo, A., Garcia-Rodriguez, J., Orts-Escolano, S.: Self-organizing activity description map to represent and classify human behaviour. In: 2015 (IJCNN), pp. 1–7. IEEE (2015)
Azorin-López, J., Saval-Calvo, M., Fuster-Guilló, A., Oliver-Albert, A.: A predictive model for recognizing human behaviour based on trajectory representation. In: 2014 (IJCNN), pp. 1494–1501. IEEE (2014)
Borja, L.F., Azorin-Lopez, J., Saval-Calvo, M.: A compilation of methods and datasets for group and crowd action recognition. Int. J. Comput. Vis. Image Process. (IJCVIP) 7(3), 40–53 (2017)
Bour, P., Cribelier, E., Argyriou, V.: Crowd behavior analysis from fixed and moving cameras. In: Alameda-Pineda, X., Ricci, E., Sebe, N. (eds.) Multimodal Behavior Analysis in the Wild, Computer Vision and Pattern Recognition, pp. 289–322. Academic Press, Cambridge (2019)
Chaaraoui, A.A., Climent-Pérez, P., Flórez-Revuelta, F.: A review on vision techniques applied to human behaviour analysis for ambient-assisted living. Expert Syst. Appl. 39(12), 10873–10888 (2012)
Chalapathy, R., Chawla, S.: Deep learning for anomaly detection: A survey (2019). arXiv preprint arXiv:1901.03407
Chalapathy, R., Menon, A.K., Chawla, S.: Anomaly detection using one-class neural networks (2018)
Gowsikhaa, D., Abirami, S., Baskaran, R.: Automated human behavior analysis from surveillance videos: a survey. AI Rev. 42(4), 747–765 (2014)
Ke, Q., Liu, J., An, S., Bennamoun, M., Sohel, F., Boussaid, F.: Computer vision for human–machine interaction. In: Leo, M., Farinella, G.M. (eds.) Computer Vision for Assistive Healthcare, Computer Vision and Pattern Recognition, pp. 127–145. Academic Press, Cambridge (2018)
Li, X., Li, W., Liu, B., Nenghai, Y.: Object and patch based anomaly detection and localization in crowded scenes. Multimedia Tools Appl. 78(15), 21375–21390 (2019)
Mahadevan, V., Li, W., Bhalodia, V., Vasconcelos, N.: Anomaly detection in crowded scenes. In: 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 1975–1981. IEEE (2010)
Moya, M.M., Koch, M.W., Hostetler, L.D.: One-class classifier networks for target recognition applications. In: NASA STI/Recon Technical Report N, 93 (1993)
Nigam, S., Singh, R., Misra, A.K.: A review of computational approaches for human behavior detection. Archieves Comput. Methods Eng. 26(4), 831–863 (2019)
Perera, P., Patel, V.M.: Learning deep features for one-class classification. IEEE Trans. Image Process. 28(11), 5450–5463 (2019)
Ravanbakhsh, M., Nabi, M., Sangineto, E., Marcenaro, L., Regazzoni, C., Sebe, N.: Abnormal event detection in videos using generative adversarial nets. In: 2017 IEEE International Conference on Image Processing (ICIP), pp. 1577–1581. IEEE (2017)
Ravanbakhsh, M., Sangineto, E., Nabi, M., Sebe, N.: Training adversarial discriminators for cross-channel abnormal event detection in crowds. In: 2019 IEEE (WACV), pp. 1896–1904. IEEE (2019)
Ruff, L., Vandermeulen, R., Goernitz, N., Deecke, L., Siddiqui, S.A., Binder, A., Müller, E., Kloft, M.: Deep one-class classification. In: International conference on (ML), pp. 4393–4402 (2018)
Sabokrou, M., Fathy, M., Moayed, Z., Klette, R.: Fast and accurate detection and localization of abnormal behavior in crowded scenes. Mach. Vis. Appl. 28(8), 965–985 (2017)
Sabokrou, M., Khalooei, M., Fathy, M., Adeli, E.: Adversarially learned one-class classifier for novelty detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3379–3388 (2018)
Sun, J., Shao, J., He, C.: Abnormal event detection for video surveillance using deep one-class learning. Multimedia Tools Appl. 78(3), 3633–3647 (2019)
Sylvester, J.J.: A question in the geometry of situation. Q. J. Pure Appl. Math. 1(1), 79–80 (1857)
Vu, H., Nguyen, T.D., Le, T., Luo, W., Phung, D.: Robust anomaly detection in videos using multilevel representations. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 33, pp. 5216–5223 (2019)
Xu, D., Ricci, E., Yan, Y., Song, J., Sebe, N.: Learning deep representations of appearance and motion for anomalousevent detection (2015). arXiv preprint arXiv:1510.01553
Dan, X., Yan, Y., Ricci, E., Sebe, N.: Detecting anomalous events in videos by learning deep representations of appearance and motion. Comput. Vis. Image Underst. 156, 117–127 (2017)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Borja-Borja, L.F., Azorín-López, J., Saval-Calvo, M. (2021). A Deep Learning Architecture for Recognizing Abnormal Activities of Groups Using Context and Motion Information. In: Herrero, Á., Cambra, C., Urda, D., Sedano, J., Quintián, H., Corchado, E. (eds) 15th International Conference on Soft Computing Models in Industrial and Environmental Applications (SOCO 2020). SOCO 2020. Advances in Intelligent Systems and Computing, vol 1268. Springer, Cham. https://doi.org/10.1007/978-3-030-57802-2_73
Download citation
DOI: https://doi.org/10.1007/978-3-030-57802-2_73
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-57801-5
Online ISBN: 978-3-030-57802-2
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)