Skip to main content
SpringerLink
Log in

Moving object detection in video sequence images based on an improved visual background extraction algorithm

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Visual background extraction is a method for detecting moving objects in video sequence images. In the traditional visual background extraction algorithm, ghost phenomena and dynamic background interference exist in the detection results. In order to speed up ghost removal and suppress the interference of dynamic background, an improved visual background extraction algorithm is proposed. In this method, secondary judgment is added to eliminate ghost pixel interference in the process of spatial transmission of pixels, and the flicker degree of pixels is analyzed to suppress the interference of dynamic background pixels. In order to improve the detection effect, the edge of moving object is obtained by edge detection method, then filled and fused with the detected object. Finally, the detection of moving object is optimized by means of median filtering and mathematical morphology. The simulation results show that the improved algorithm accelerate ghost removal, effectively suppresses the noise interference caused by dynamic background, and improves the accuracy of moving object detection.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

References

  1. Aranda LA, Reviriego P, Maestro JA (2017) Error detection technique for a median filter. IEEE Trans Nucl Sci 64:2219–2226

    Google Scholar 

  2. Barnich O, Van Droogenbroeck M (2009) ViBE: A powerful random technique to estimate the background in video sequences. 2009 IEEE International Conference on Acoustics, Speech and Signal Processing. IEEE, pp 945–948

  3. Barnich O, Van Droogenbroeck M (2011) ViBe: a universal background subtraction algorithm for video sequences. IEEE Transactions on Image Processing 20:1709–1724

    Article  MathSciNet  Google Scholar 

  4. Cao J, Pang Y, Li X (2016) Pedestrian detection inspired by appearance Constancy and Shape symmetry. IEEE Trans Image Process 25:5538–5551

    Article  MathSciNet  Google Scholar 

  5. Cao X, Yang L, Guo X (2017) Total variation regularized RPCA for irregularly moving object detection under dynamic background. IEEE Transactions on Cybernetics 46:1014–1027

    Article  Google Scholar 

  6. Chenglong C, Jiangqun N, Jiwu H (2013) Blind detection of median filtering in digital images: a difference domain based approach. IEEE Trans Image Process 22:4699–4710

    Article  MathSciNet  Google Scholar 

  7. Choi J, Maurer M (2016) Local volumetric hybrid-map-based simultaneous localization and mapping with moving object tracking. IEEE Trans Intell Transp Syst 17:2440–2455

    Article  Google Scholar 

  8. Devanne M, Berretti S, Pala P, Wannous H, Daoudi M, Bimbo AD (2017) Motion segment decomposition of RGB-D sequences for human behavior understanding. Pattern Recogn 61:222–233

    Article  Google Scholar 

  9. Gao L, Li X, Song J, Shen H (2019) Hierarchical LSTMs with Adaptive attention for visual captioning. IEEE Trans Pattern Anal Mach Intell vol PP, pp 1–1

  10. Gennarelli G, Vivone G, Braca P, Soldovieri F, Amin MG (2016) Comparative analysis of two approaches for multipath ghost suppression in radar imaging. IEEE Geoscience & Remote Sensing Letters 13:1226–1230

    Article  Google Scholar 

  11. Han G, Wang J, Cai X (2014) Improved visual background extractor using an adaptive distance threshold. Journal of Electronic Imaging 23:1–12

    Google Scholar 

  12. Hu W, Yang Y, Zhang W, Yuan X (2016) Moving object detection using tensor-based low-rank and saliently fused-sparse decomposition. IEEE Trans Image Process 26:724–737

    Article  MathSciNet  Google Scholar 

  13. Huang SC, Do BH (2013) Radial basis function based neural network for motion detection in dynamic scenes. IEEE Transactions on Cybernetics 44:114–125

    Article  Google Scholar 

  14. Jie H, Xu L, Xin H, Hong J, Meng W (2017) Abnormal driving detection based on normalized driving behavior. IEEE Trans Veh Technol 66:6645–6652

    Article  Google Scholar 

  15. Ju J, Xing J (2019) Moving object detection based on smoothing three frame difference method fused with RPCA. Multimed Tools Appl 78:29937–29951

    Article  Google Scholar 

  16. Kaushal M, Khehra BS (2017) BBBCO and fuzzy entropy based modified background subtraction algorithm for object detection in videos. Appl Intell 47:1–14

    Article  Google Scholar 

  17. Khadidos A, Sanchez V, Li CT (2017) Weighted level set evolution based on local edge features for medical image segmentation. IEEE Trans Image Process 26:1979–1991

    Article  MathSciNet  Google Scholar 

  18. Koniar D, Hargas L, Loncova Z, Simonova A, Duchon F, Beno P (2017) Visual system-based object tracking using image segmentation for biomedical applications. Electr Eng 99:1349–1366

    Article  Google Scholar 

  19. Lu X, Xu C, Wang L, Teng L (2018) Improved background subtraction method for detecting moving objects based on GMM. IEEJ Trans Electr Electron Eng 13:1540–1550

    Article  Google Scholar 

  20. Lv PY, Sun SL, Lin CQ, Liu GR (2018) Space moving target detection and tracking method in complex background. Infrared Phys Technol 91:107–118

    Article  Google Scholar 

  21. Ou X, Yan P, Wei H, Yong KK, Zhang G, Xin P et al (2019) Adaptive GMM and BP neural network hybrid method for moving objects detection in complex scenes. International Journal of Pattern Recognition & Artificial Intelligence 33:1–16

    Article  Google Scholar 

  22. Pang Y, Zhu H, Li X, Li X (2017) Classifying discriminative features for blur detection. IEEE Transactions on Cybernetics 46:2220–2227

    Article  Google Scholar 

  23. Pang Y, Zhu H, Li X, Pan J (2016) Motion blur detection with an Indicator function for surveillance machines. IEEE Trans Ind Electron 63:5592–5601

    Article  Google Scholar 

  24. Sobral A, Vacavant A (2014) A comprehensive review of background subtraction algorithms evaluated with synthetic and real videos. Computer Vision & Image Understanding 122:4–21

    Article  Google Scholar 

  25. Song J, Guo Y, Gao L, Li X, Hanjalic A, Shen HT (2019) From deterministic to generative: multimodal stochastic RNNs for video captioning. IEEE Transactions on Neural Networks and Learning Systems 30:3047–3058

    Article  Google Scholar 

  26. Su H, Wang J, Li Y, Hong X, Li P (2014) An algorithm for stitching images with different contrast and elimination of ghost. 2014 Seventh International Symposium on Computational Intelligence and Design, Hangzhou, pp 104–107

  27. Varadarajan S, Miller P, Zhou H (2015) Region-based mixture of Gaussians modelling for foreground detection in dynamic scenes. Pattern Recogn 48:3488–3503

    Article  Google Scholar 

  28. Wan M, Gu G, Cao E et al (2016) In-frame and inter-frame information based infrared moving small target detection under complex cloud backgrounds[J]. Infrared Phys Technol 77:455–467

    Article  Google Scholar 

  29. Wang X, Gao L, Song J, Shen H (2017) Beyond frame-level CNN: saliency-aware 3-D CNN with LSTM for video a ction recognition. IEEE Signal Processing Letters 24:510–514

    Article  Google Scholar 

  30. Wang Y, Jodoin P-M, Porikli F, Konrad J, Benezeth Y, Ishwar P (2014) CDnet 2014: an expanded change detection benchmark dataset[C]. IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops

  31. Wei H, Lei L, Chao Y, He L (2015) The moving target detection algorithm based on the improved visual background extraction. Infrared Phys Technol 71:518–525

    Article  Google Scholar 

  32. Wu S, Chen D, Wang X (2017) Moving target detection based on improved three frame difference and visual background extractor. 2017 10th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI), Shanghai pp 1–5

  33. Xin Y, Jie H, Dong L, Ding L (2014) A self-adaptive optical flow method for the moving object detection in the video sequences. Optik - International Journal for Light and Electron Optics 125:5690–5694

    Article  Google Scholar 

  34. Yang Y, Han D, Ding J, Yang Y (2016) An improved visual background extraction for video moving object detection based on evidential reasoning. 2016 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI), Baden-Baden, pp 26–31

Download references

Acknowledgements

This work was supported by the National Science Foundation of China (nos.U1803261 and 61665012) and the International Science and Technology Cooperation Project of the Ministry of Education of the People’s Republic of China (nos. 2016–2196).(Corresponding author: Zhenhong Jia).

Author information

Authors and Affiliations

  1. College of Information Science and Engineering, Xinjiang University, 666 Shengli Road, Tianshan District, Urumqi, China

    Junhui Zuo & Zhenhong Jia

  2. Institute of Image Processing and Pattern Recognition, Shanghai Jiao Tong University, 2-427 SEIEE Building, 800 Dong Chun Road, Shanghai, China

    Jie Yang

  3. Knowledge Engineering and Discovery Research Institute, Auckland University of Technology, Private Bag 92006, Auckland, New Zealand

    Nikola Kasabov

Authors
  1. Junhui Zuo
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Zhenhong Jia
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jie Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Nikola Kasabov
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zhenhong Jia.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zuo, J., Jia, Z., Yang, J. et al. Moving object detection in video sequence images based on an improved visual background extraction algorithm. Multimed Tools Appl 79, 29663–29684 (2020). https://doi.org/10.1007/s11042-020-09530-0

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-020-09530-0

Keywords

Search

Navigation