Abstract
One essential component of security systems at public locations, such as airports, bus stops, train stations, marketplaces, etc., is the video surveillance. More powerful and efficient automated technical developments are needed for video surveillance. When an unattended object is left in the public places it will be considered as suspicious object as the terrorist assaults have escalated globally in recent years. The people in public areas must be protected from this attack by using safety precautions. Complex surveillance recordings make it difficult to identify abandoned or removed objects due to a number of factors, such as occlusion, abrupt changes in lighting, and so on. A novel approach is proposed in this article for the identification and classification of a static object in a public place. The main aim of this work is the automatic detection of abandoned objects. This method consists of two steps: static item detection using background subtraction and motion estimation; and (ii) abandoned luggage recognition using convolutional neural networks. (CNN). By applying the background subtraction method using fuzzy integral, the suggested method extracts foreground items. Afterwards the static object is detected using hierarchical Finite state machine (FSM). And finally, the object is classified using the CNN algorithm Yolo V5. In terms of accuracy, precision, and recall, the performance of the suggested algorithm is compared with that of traditional approaches.
Similar content being viewed by others
Data availability
All the data is collected from the simulation reports of the software and tools used by the authors. Authors are working on implementing the same using real world data with appropriate permissions.
References
Ammar S, Bouwmans T, Zaghden N, Neji M (2019) Moving objects segmentation based on deepsphere in video surveillance. In International Symposium on Visual Computing, pp. 307–319. Springer, Cham
Aradhya, HV Ravish (2019) Object detection and tracking using deep learning and artificial intelligence for video surveillance applications. Int J Adv Comput Sci Appl 10(12)
Chen K, Franko K, Sang R (2021) Structured model pruning of convolutional networks on tensor processing units
Din M, Bashir A, Basit A, Lakho S (2020) Abandoned object detection using frame differencing and background subtraction. Int J Adv Comput Sci Appl 11(7)
Dwivedi N, Singh DK, Kushwaha DS (2020) An approach for unattended object detection through contour formation using background subtraction. Procedia Computer Science 171:1979–1988
Elhoseny M (2020) Multi-object detection and tracking (MODT) machine learning model for real-time video surveillance systems. Circuits, Syst Signal Process 39(2):611–630
Jha S, Seo C, Yang E, Joshi GP (2021) Real time object detection and trackingsystem for video surveillance system. Multimed Tools Appl 80(3):3981–3996
Kalli SNR, Suresh T, Prasanth A, Muthumanickam T, Mohanram K (2021) An effective motion object detection using adaptive background modeling mechanism in video surveillance system. J Intell Fuzzy Syst Preprint: 1–13
Kiruthiga G, Yuvaraj N (2021) Improved object detection in video surveillance using deep convolutional neural network learning
Lwin SP, Tun MT (2022) Deep convonlutional neural network for abandoned object detection
Mahalingam T, Subramoniam M (2020) A robust single and multiple moving object detection, tracking and classification. Appl Comput Inform
Narwal P, Mishra R (2019) Real time system for unattended Baggag e detection. Proceedings of the International Research Journal of Engineering an d Technology (IRJET) 6(11)
Omrani E, Mousazadeh H, Omid M, Masouleh MT, Jafarbiglu H, Salmani-Zakaria Y, Makhsoos A, Monhaseri F, Kiapei A (2020) Dynamic and static object detection and tracking in an autonomous surface vehicle. Ships and Offshore Structures 15(7):711–721
Ortego D, SanMiguel JC, Martinez JM (2015) Long-term stationary object detection based on Spatio-temporal change detection. IEEE Signal Process Lett 22(12):2368–2372
Palivela LH, Ramachandran S (2018) An enhanced image hashing to detect unattended objects utilizing binary SVM classification. J Computat Theoret Nanosci 15(1):121–132
Park H, Park S, Joo Y (2019) Robust detection of abandoned object for smart video surveillance in illumination changes. Sensors 19(23):5114
Park H, Park S, Joo Y (2020) Detection of abandoned and stolen objects based on dual background model and mask R-CNN. IEEE Access 8:80010–80019
Preetha KG (2021) A fuzzy rule-based abandoned object detection using image fusion for intelligent video surveillance systems. Turkish J Comput Math Educ (TURCOMAT) 12(3):3694–3702
Sajjanar S, Mankani SK, Dongrekar PR, Kumar NS, HV Ravish Aradhya (2016) Implementation of real time moving object detection and tracking on FPGA for video surveillance applications. In 2016 IEEE Distributed Computing, VLSI, Electrical Circuits and Robotics (DISCOVER), pp. 289–295
Samaila YA, Rabiu H, Mustapha I (2020) Real-time detection of abandoned object using centroid difference method. Arid Zone J Eng Technol Environ 16(1):48–57
Sathesh A, Hamdan YB (2021) Speedy detection module for abandoned belongings in airport using improved image processing technique. J Trends Comput Sci Smart Technol 3(4):251
Servin M, Samara K, Al Rahman EA, Kouki S, Bouchahma M (2019) Static and moving object detection and segmentation in videos. In 2019 Sixth HCT Information Technology Trends (ITT), pp. 197–201. IEEE
Shyam D, Kot A, Athalye C (2018) Abandoned object detection using pixel-based finite state machine and single shot multibox detector. In 2018 IEEE International Conference on Multimedia and Expo (ICME), pp. 1–6
Smeureanu S, Ionescu RT (2018) Real-time deep learning method for abandoned luggage detection in video. In 2018 26th European Signal Processing Conference (EUSIPCO), pp. 1775-1779. IEEE
Xu J (2021) A deep learning approach to building an intelligent video surveillance system. Multimed Tools Appl 80(4):5495–5515
Yadav P, Jahagirdar A (2016) Static object detection in image sequences. LAP LAMBERT Academic Publishing, New York
Yang S, Tan J, Chen B (2022) Robust spike-based continual meta-learning improved by restricted minimum error entropy criterion. Entropy 24(4):455
Yang S, Gao T, Wang J, Deng B, Azghadi MR, Lei T, Linares-Barranco B (2022) SAM: a unified self-adaptive multicompartmental spiking neuron model for learning with working memory. Front Neurosci 16
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that we have no conflict of interest.
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Teja, Y.D. Static object detection for video surveillance. Multimed Tools Appl 82, 21627–21639 (2023). https://doi.org/10.1007/s11042-023-14696-4
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-023-14696-4