Skip to main content
Log in

Static object detection for video surveillance

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

One essential component of security systems at public locations, such as airports, bus stops, train stations, marketplaces, etc., is the video surveillance. More powerful and efficient automated technical developments are needed for video surveillance. When an unattended object is left in the public places it will be considered as suspicious object as the terrorist assaults have escalated globally in recent years. The people in public areas must be protected from this attack by using safety precautions. Complex surveillance recordings make it difficult to identify abandoned or removed objects due to a number of factors, such as occlusion, abrupt changes in lighting, and so on. A novel approach is proposed in this article for the identification and classification of a static object in a public place. The main aim of this work is the automatic detection of abandoned objects. This method consists of two steps: static item detection using background subtraction and motion estimation; and (ii) abandoned luggage recognition using convolutional neural networks. (CNN). By applying the background subtraction method using fuzzy integral, the suggested method extracts foreground items. Afterwards the static object is detected using hierarchical Finite state machine (FSM). And finally, the object is classified using the CNN algorithm Yolo V5. In terms of accuracy, precision, and recall, the performance of the suggested algorithm is compared with that of traditional approaches.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

Data availability

All the data is collected from the simulation reports of the software and tools used by the authors. Authors are working on implementing the same using real world data with appropriate permissions.

References

  1. Ammar S, Bouwmans T, Zaghden N, Neji M (2019) Moving objects segmentation based on deepsphere in video surveillance. In International Symposium on Visual Computing, pp. 307–319. Springer, Cham

  2. Aradhya, HV Ravish (2019) Object detection and tracking using deep learning and artificial intelligence for video surveillance applications. Int J Adv Comput Sci Appl 10(12)

  3. Chen K, Franko K, Sang R (2021) Structured model pruning of convolutional networks on tensor processing units

  4. Din M, Bashir A, Basit A, Lakho S (2020) Abandoned object detection using frame differencing and background subtraction. Int J Adv Comput Sci Appl 11(7)

  5. Dwivedi N, Singh DK, Kushwaha DS (2020) An approach for unattended object detection through contour formation using background subtraction. Procedia Computer Science 171:1979–1988

    Article  Google Scholar 

  6. Elhoseny M (2020) Multi-object detection and tracking (MODT) machine learning model for real-time video surveillance systems. Circuits, Syst Signal Process 39(2):611–630

    Article  Google Scholar 

  7. Jha S, Seo C, Yang E, Joshi GP (2021) Real time object detection and trackingsystem for video surveillance system. Multimed Tools Appl 80(3):3981–3996

    Article  Google Scholar 

  8. Kalli SNR, Suresh T, Prasanth A, Muthumanickam T, Mohanram K (2021) An effective motion object detection using adaptive background modeling mechanism in video surveillance system. J Intell Fuzzy Syst Preprint: 1–13

  9. Kiruthiga G, Yuvaraj N (2021) Improved object detection in video surveillance using deep convolutional neural network learning

    Google Scholar 

  10. Lwin SP, Tun MT (2022) Deep convonlutional neural network for abandoned object detection

  11. Mahalingam T, Subramoniam M (2020) A robust single and multiple moving object detection, tracking and classification. Appl Comput Inform

  12. Narwal P, Mishra R (2019) Real time system for unattended Baggag e detection. Proceedings of the International Research Journal of Engineering an d Technology (IRJET) 6(11)

  13. Omrani E, Mousazadeh H, Omid M, Masouleh MT, Jafarbiglu H, Salmani-Zakaria Y, Makhsoos A, Monhaseri F, Kiapei A (2020) Dynamic and static object detection and tracking in an autonomous surface vehicle. Ships and Offshore Structures 15(7):711–721

    Article  Google Scholar 

  14. Ortego D, SanMiguel JC, Martinez JM (2015) Long-term stationary object detection based on Spatio-temporal change detection. IEEE Signal Process Lett 22(12):2368–2372

    Article  Google Scholar 

  15. Palivela LH, Ramachandran S (2018) An enhanced image hashing to detect unattended objects utilizing binary SVM classification. J Computat Theoret Nanosci 15(1):121–132

    Article  Google Scholar 

  16. Park H, Park S, Joo Y (2019) Robust detection of abandoned object for smart video surveillance in illumination changes. Sensors 19(23):5114

    Article  Google Scholar 

  17. Park H, Park S, Joo Y (2020) Detection of abandoned and stolen objects based on dual background model and mask R-CNN. IEEE Access 8:80010–80019

    Article  Google Scholar 

  18. Preetha KG (2021) A fuzzy rule-based abandoned object detection using image fusion for intelligent video surveillance systems. Turkish J Comput Math Educ (TURCOMAT) 12(3):3694–3702

    Article  Google Scholar 

  19. Sajjanar S, Mankani SK, Dongrekar PR, Kumar NS, HV Ravish Aradhya (2016) Implementation of real time moving object detection and tracking on FPGA for video surveillance applications. In 2016 IEEE Distributed Computing, VLSI, Electrical Circuits and Robotics (DISCOVER), pp. 289–295

  20. Samaila YA, Rabiu H, Mustapha I (2020) Real-time detection of abandoned object using centroid difference method. Arid Zone J Eng Technol Environ 16(1):48–57

    Google Scholar 

  21. Sathesh A, Hamdan YB (2021) Speedy detection module for abandoned belongings in airport using improved image processing technique. J Trends Comput Sci Smart Technol 3(4):251

    Article  Google Scholar 

  22. Servin M, Samara K, Al Rahman EA, Kouki S, Bouchahma M (2019) Static and moving object detection and segmentation in videos. In 2019 Sixth HCT Information Technology Trends (ITT), pp. 197–201. IEEE

  23. Shyam D, Kot A, Athalye C (2018) Abandoned object detection using pixel-based finite state machine and single shot multibox detector. In 2018 IEEE International Conference on Multimedia and Expo (ICME), pp. 1–6

  24. Smeureanu S, Ionescu RT (2018) Real-time deep learning method for abandoned luggage detection in video. In 2018 26th European Signal Processing Conference (EUSIPCO), pp. 1775-1779. IEEE

  25. Xu J (2021) A deep learning approach to building an intelligent video surveillance system. Multimed Tools Appl 80(4):5495–5515

    Article  Google Scholar 

  26. Yadav P, Jahagirdar A (2016) Static object detection in image sequences. LAP LAMBERT Academic Publishing, New York

    Google Scholar 

  27. Yang S, Tan J, Chen B (2022) Robust spike-based continual meta-learning improved by restricted minimum error entropy criterion. Entropy 24(4):455

    Article  MathSciNet  Google Scholar 

  28. Yang S, Gao T, Wang J, Deng B, Azghadi MR, Lei T, Linares-Barranco B (2022) SAM: a unified self-adaptive multicompartmental spiking neuron model for learning with working memory. Front Neurosci 16

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Y. D Teja.

Ethics declarations

Conflict of interest

The authors declare that we have no conflict of interest.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Teja, Y.D. Static object detection for video surveillance. Multimed Tools Appl 82, 21627–21639 (2023). https://doi.org/10.1007/s11042-023-14696-4

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-023-14696-4

Keywords

Navigation