Skip to main content
SpringerLink
Log in

On line background modeling for moving object segmentation in dynamic scenes

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Fast and accurate moving object segmentation in dynamic scenes is the first step in many computer vision applications. In this paper, we propose a new background modeling method for moving object segmentation based on dynamic matrix and spatio-temporal analyses of scenes. Our method copes with some challenges related to this field. A new algorithm is proposed to detect and remove cast shadow. A comparative study by quantitative evaluations shows that the proposed approach can detect foreground robustly and accurately from videos recorded by a static camera and which include several constraints. A Highway Control and Management System called RoadGuard is proposed to show the robustness of our method. In fact, our system has the ability to control highway by detecting strange events that can happen like vehicles suddenly stopped in roads, parked vehicles in emergency zones or even illegal conduct such as going out from the road. Moreover, RoadGuard is capable of managing highways by saving information about the date and time of overloaded roads.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Fig. 22
Fig. 23
Fig. 24
Fig. 25
Fig. 26
Fig. 27
Fig. 28
Fig. 29
Fig. 30

Similar content being viewed by others

Notes

  1. Results are available on-line: http://sites.google.com/site/backgroundsubtraction/test-image-sequences---results/third-generation

  2. Video sequences are courtesy of the Computer Vision and Robotics Research Laboratory at UCSD

  3. http://research.microsoft.com/enus/um/people/jckrumm/wallflower/testimages.htm

  4. http://www.anc.ed.ac.uk/demos/tracker/

  5. Laboratory sequence used by T. Yang, Z. Li, Q. Pan and J. Li, in “Real-Time and Accurate Segmentation of Moving Objects in Dynamic Scene,”MM’04, New York, USA, pp. 10–16,2004

References

  1. Biswas S, Sil J, Sengupta N (2011) Background Modeling and Implementation using Discrete Wavelet Transform: a Review. Journal ICGST-GVIP 11(1):29–42

    Google Scholar 

  2. Boult T, Ali Erkin A, Lewis P (1999) Frame-rate omnidirectional surveillance and tracking of camouflaged and occluded targets. In Proceedings Second IEEE Workshop on Visual Surveillance, 48–55.

  3. Bouwmans T, El Baf F, Vachon B (2010) Statistical Background Modeling for Foreground Detection: A Survey. Handbook of Pattern Recognition and Computer Vision, World Scientific Publishing, 4:2:Chapter 3:181–199.

  4. Bruce D, Lucas K, Takeo K (1981) An iterative image registration technique with an application to stereo vision. Proceedings of the International Joint Conference on, Artificial Intelligence, pp 674–679

    Google Scholar 

  5. Bucak S, Gunsel B, Gursoy O (2007) Incremental Non-negative Matrix Factorization for Dynamic Background Modeling. International Workshop on Pattern Recognition in Information Systems, Funchal, Portugal, June 2007.

  6. Cavallaro A, Ebrahimi T (2003) Classification of change detection algorithms for object-based applications. Proc. of Workshop on Image Analysis For Multimedia Interactive Services (WIAMIS), 9–11.

  7. Chang Me, Cheng Y (2007) “Motion Detection by Using Entropy Image and Adaptive State-Labeling Technique,” Circuits and Systems, ISCAS 2007. IEEE International Symposium on. New Orleans, pp.3667–3670.

  8. Cheung S-C, Kamath C, Robust techniques for background subtraction in urban traffic video. In S. Panchanathan and B. Vasudev, editors, Proc Elect Imaging: Visual Comm Image Proce 5308: 881–892.

  9. Cheung S-C., Kamath C. (2004) Robust techniques for background subtraction in urban traffic video. In S. Panchanathan and B. Vasudev, editors, Proc Elect Imaging: Visual Comm Image Proce 2004 (Part One) SPIE, 5308:881–892.

  10. Cristani M, Farenzena M, Bloisi D, Murino V (2010) Background Subtraction for Automated Multisensor Surveillance: A Comprehensive Review. EURASIP Journal on Advances in Signal Processing, 24 pages, Volume 2010.

  11. Cucchiara R, Grana C, Neri G, Piccardi M, Prati A (2001) The Sakbot System for Moving Object Detection and Tracking. In Video-Based Surveillance Systems Computer Vision and Distributed Processing, 145–158.

  12. Elgammal A, Duraiswami R, Harwood D, Davis LS (2002) Background and foreground modeling using nonparametric kernel density estimation for visual surveillance. Proc IEEE 90(7):1151–1163

    Article  Google Scholar 

  13. Elhabian K, El-Sayed M, Ahmed SH (2008) Moving Object Detection in Spatial Domain using Background Removal Techniques - State-of-Art. Recent Patents on Computer Science 1:32–54

    Article  Google Scholar 

  14. Fayyad UM, Piatetsky-Shapiro G, Smyth P (1996) The kdd process for extracting useful knowledge from volumes of data. Communications of the ACM (CACM) 39:27–34

    Article  Google Scholar 

  15. Fei Ma Y, Zhang HJ (2001) “Detecting motion object by spatio-temporal entropy,” Proceedings of the 2001 IEEE International Conference on Multimedia and Expo, pp.381–384.

  16. González RC, Woods RE, Eddins SL (2009) Digital Image Processing Using MATLAB, 2nd edition.

  17. Grimson Y, Stauffer C, Romano R, Lee L (1998) Using adaptive tracking to classify and monitor activities in a site. Proc. Conf. Comp. Vision Pattern Rec, 22–29.

  18. Hammami M, Chahir Y, Chen L (2006) WebGuard: A Web Filtering Engine Combining Textual, Structural, and Visual Content-Based Analysis. In IEEE Transaction on Knowledge and Data Engineering 18:272–284

    Article  Google Scholar 

  19. Hedayati M, Zaki W.M.D.W, Hussain A. (2010) Real-Time Background Subtraction for Video Surveillance: From Research to Reality. 6th International Colloquium on Signal Processing & Its Applications (CSPA), 1 – 6.

  20. Ho MAT, Yamada Y, Umetani Y (2002) “An HMM-based temporal difference learning with model-updating capability for visual tracking of human communicational behaviors”, 5 th IEEE International Conference on Automatic Face and Gesture Recognition, pp. 163–168.

  21. Hu W, Tan T, Wang L, Maybank S (2004) A survey on visual surveillance of object motion and behaviors. In IEEE Transactions on Systems, Man and Cybernetics (Part C): Applications and Reviews, 34: 334–352.

  22. Jarraya SK, Hammami M, Ben-Abdallah H (2010) Accurate Background Modeling for Moving Object Detection in a Dynamic Scene. Digital Image Computing, Techniques and Applications (DICTA), pp 52–57

    Google Scholar 

  23. Jarraya SK, Hammami M, Ben-Abdallah H (2010) An Improved Hybrid Method for Moving Object Detection. Signal and Image Processing 23–25:2010

    Google Scholar 

  24. Jing G, Siong Ch.E., Rajan D (2004) “Foreground motion detection by difference-based spatial temporal entropy image,” Proceedings of IEEE region 10 Conference (TENCON 2004), vol.A,, pp.379–382.

  25. Joshi AJ, Atev S, Masoud O, Papanikolopoulos N (2007) Moving shadow detection with low- and – mid level reasoning. In IEEE Int 1 Conf Robotics and Automation, 4827–4832.

  26. Julio C.S.J, Claudio R.J, Soraia R.M (2005) Background Subtraction and Shadow Detection in Grayscale Video Sequences. In Computer Graphics and Image Processing, 189–196.

  27. Kanungo T, Mount DM, Netanyahu S, Piatko D, Silverman RY (2002) An Efficient k-Means Clustering Algorithm: Analysis and Implementation. IEEE Transaction on pattern Analysis And. Machine Intelligence 24:7

    Article  Google Scholar 

  28. Kilger M (1992) A Shadow Handler in a Video-Based Real-Time Traffic Monitoring System. In IEEE Workshop Applications of Computer Vision, 11–18.

  29. Kinoshita K, Enokidani M, Izumida M, Murakami K (2006) Tracking of a Moving Object Using One-Dimensional Optical Flow with a Rotating Observer. 9th International Conference ICARCV on Control, Automation, Robotics and Vision, 1–6.

  30. Li X, Hu W, Zhang Z, Zhang X (2008) Robust Foreground Segmentation Based on Two Effective Background Models. MIR 2008, 223–228.

  31. Lim S, Apostolopoulos JG, Gamal AE (2005) Optical flow estimation using temporally oversampled video. IEEE Transactions on Image Processing 1074–1087. doi:10.1109/TIP.2005.851688

  32. Lu N, Wang J, Wu QH, Yang L (2008) An Improved Motion Detection Method for Real-Time Surveillance. IAENG Int J Comput Sci 35:1–16

    MATH  Google Scholar 

  33. Mei X, Chong-Zhao H, Lei Z (2007) Moving Shadow Detection and Removal for Traffic Sequences. In International Journal of Automation and Computing 1:38–46

    Google Scholar 

  34. Mikic I, Cosman P, Kogut G, Trivedi MM (2000) Moving Shadow and Object Detection in Traffic Scenes. In Proceeding Int’l Conference Pattern Recognition 1:321–324

    Google Scholar 

  35. Monnet A, Mittal A, Paragios N, Visvanathan R (2003) Background modeling and subtraction of dynamic scenes. 9th IEEE International Conference on Computer Vision, 1305–1312.

  36. Nan L, Jihong W, Wu Q.H, Li Y (2008) An Improved Motion Detection Method for Real-Time Surveillance. International Journal of Computer Science IJCS, 1–16.

  37. Pathirana PN, Lim AEK, Carminati J, Premaratne M (2007) “Simultaneous estimation of optical flow and object state, A modified approach to optical flow calculation”, IEEE International Conference on Networking, Sensing and Control, pp. 634–638.

  38. Piccardi M (2004) Background subtraction techniques a review. IEEE International Conference on Systems, Man and Cybernetics, 3099–3104.

  39. Piccardi M (2004) Background subtraction techniques: a review. In Proc. of IEEE SMC 2004 Int. Conf. on Systems, Man and. Cybernetics 4:3099–3104

    Google Scholar 

  40. Prati A, Mikic I, Trivedi MM, Cucchiara R (2003) Detecting Moving Shadows: Algorithms and Evaluation. In IEEE Trans. Pattern Analysis and Machine Intelligence.

  41. Quinlan JR (1986) Induction of Decision Trees. Mach Learn 1:81–106

    Google Scholar 

  42. Quinlan JR (1993) C4.5: Programs for Machine Learning. Los Altos, California: Morgan Kanfmann Publishers, Inc.

  43. Radke RJ, Andra S, Al-Kofahi O, Roysam B, Image Change Detection Algorithms: A systematic survey, image processing. IEEE Trans, 14: 294–307.

  44. Roth S, Black MJ (2005) “On the spatial statistics of optical flow”, 10 th IEEE International Conference on Computer Vision, pp. 42–49.

  45. Soumya T (2008) A Moving Object Segmentation Method for Low Illumination Night Videos. Proceedings of the World Congress on Engineering and Computer Science (WCECS), 1161–1165.

  46. Spagnolo P, D’Orazio T, Leo M, Distante A (2005) Advances in Background Updating and Shadow Removing for Motion Detection Algorithms. Computer Analysis of Images and Patterns, pp. 398–406.

  47. Stocker AA (2002) “An improved 2D optical flow sensor for motion segmentation”, IEEE International Symposium on Circuits and Systems, pp. 332–335.

  48. Thongkamwitoon T, Aramvith S, Chalidabhongse T.H (2004) An adaptive real-time background subtraction and moving shadows detection. IEEE International Conference on Multimedia and Expo, 1459–1462.

  49. Toyama K (1999) Wallflower:Principles and practice of background maintenance. International Conference on Computer Vision, 255–261.

  50. Tsai D, Lai C (2008) Independent Component Analysis-Based Background Subtraction for Indoor Surveillance. IEEE Transactions on Image Processing.

  51. Vladimir N, Martijn L, Maarten C, Mark S (2008) Kernel-based object tracking using adaptive feature selection. Informatics Institute, University of Amsterdam, In technical report

    Google Scholar 

  52. Yang T, Li Z, Pan Q, Li J (2004) Real-Time and Accurate Segmentation of Moving Objects in Dynamic Scene. MM’04, 10–16.

  53. Yeon-sung C, Piao Z, Sun-woo K, Tae-hun K, Chun-bae P (2006) “Motion Information Detection Technique Using Weighted Subtraction Image and Motion Vector”, International Conference ICHIT on Hybrid Information Technology, 263–269.

  54. Yu-Fei M, Hong-Jiang Z (2001) “Detecting motion object by spatio-temporal entropy”, IEEE International Conference on Multimedia and Expo, pp. 381–384.

  55. Zhen Y, Yanping C (2009) “A real-time motion detection algorithm for traffic monitoring systems based on consecutive temporal difference”, 7 th Asian Control Conference, pp. 1594–1599, Hong Kong.

  56. Zhen T, Zhenjiang M (2007) Fast Background Subtraction and Shadow Elimination Using Improved Gaussian Mixture Model. IEEE International Workshop on Haptic, Audio and Visual Environments and Games, 38–41.

  57. Zhou D, Zhang H (2005) Modified GMM background modeling and optical flow for detection of moving objects. International Conference on Systems, Man, and Cybernetics,.2224 - 2229.

Download references

Author information

Authors and Affiliations

  1. MIRACL-FS, Sfax University, Rte Soukra Km 3 BP 802, 3018, Sfax, Tunisia

    Mohamed Hammami

  2. MIRACL-FSEG, Sfax University, Rte Aeroport Km 4, 3018, Sfax, Tunisia

    Salma Kammoun Jarraya & Hanene Ben-Abdallah

Authors
  1. Mohamed Hammami
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Salma Kammoun Jarraya
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Hanene Ben-Abdallah
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Salma Kammoun Jarraya.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Hammami, M., Jarraya, S.K. & Ben-Abdallah, H. On line background modeling for moving object segmentation in dynamic scenes. Multimed Tools Appl 63, 899–926 (2013). https://doi.org/10.1007/s11042-011-0935-6

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-011-0935-6

Keywords

Search

Navigation