Skip to main content
SpringerLink
Log in

Foreground detection using motion histogram threshold algorithm in high-resolution large datasets

  • Special Issue Paper
  • Published:
Multimedia Systems Aims and scope Submit manuscript

Abstract

Background subtraction, being the most cited algorithm for foreground detection, encounters the major problem of proper threshold value at run time. For effective value of the threshold at run time in background subtraction algorithm, the primary component of the foreground detection process, motion is used, in the proposed algorithm. For the said purpose, the smooth histogram peaks and valley of the motion were analyzed, which reflects the high and slow motion areas of the moving object(s) in the given frame and generates the threshold value at run time by exploiting the values of peaks and valley. This proposed algorithm was tested using four recommended video sequences, including indoor and outdoor shoots, and were compared with five high ranked algorithms. Based on the values of standard performance measures, the proposed algorithm achieved an average of more than 12.30% higher accuracy results.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  1. Ahmed, I., Ahmad, M., Nawaz, M., Haseeb, K., Khan, S., Jeon, G.: Efficient topview person detector using point based transformation and lookup table. Comput Commun 147, 188–197 (2019)

    Article  Google Scholar 

  2. Muzammal, M., Gohar, M., Rahman, A.U., Qu, Q., Ahmad, A., Jeon, G.: Trajectory mining using uncertain sensor data. IEEE Access 6, 4895–4903 (2017)

    Article  Google Scholar 

  3. Li, J., Wu, J., You, Y., Jeon, G.: Parallel binocular stereo-vision-based GPU accelerated pedestrian detection and distance computation. J Real-Time Image Processing 17(3), 447–457 (2020)

  4. Bouwmans, T.: Traditional and recent approaches in background modeling for foregrounddetection: an overview. Comput Sci Rev 11, 31–66 (2014)

    Article  Google Scholar 

  5. Jeeva, S., Sivabalakrishnan, M.: Survey on background modeling and foreground detection for real time video surveillance. Procedia Comput Sci 50, 566–571 (2015)

    Article  Google Scholar 

  6. Stauffer, C., Grimson, W. E. L.: Adaptive background mixture models for real-time tracking. In: Proceedings 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149) 2 pp. 246–252 IEEE (1999)

  7. Stauffer, C., Grimson, W. E. L.: Learning patterns of activity using real-time tracking. IEEE Trans Patt Anal Mach Int. 22(8), 747–757 (200)

  8. X. Lv, Q.-J. Kong, F. Weng, and Y. Liu, “Analysis of appearance features for humanmatching between different fields of view,” in Multimedia and Expo, 2009. ICME 2009. IEEE International Conference on. IEEE, 2009, pp. 670–673

  9. X. Xu and T. S. Huang (2008) “A loopy belief propagation approach for robust background estimation,” in Computer Vision and Pattern Recognition, 2008. CVPR 2008. IEEE Conference on. IEEE, pp. 1–7.

  10. T. Yang, Q. Pan, J. Li, and S. Z. Li (2005) “Real-time multiple objects tracking with occlusionhandling in dynamic scenes,” in Computer Vision and Pattern Recognition, 2005. CVPR 2005. IEEE Computer Society Conference on, vol. 1. IEEE, pp. 970–975.

  11. Li, L., Leung, M.K.: Integrating intensity and texture differences for robust changedetection. IEEE Trans Image Process 11(2), 105–112 (2002)

    Article  Google Scholar 

  12. Aach, T., Kaup, A., Mester, R.: Statistical model-based change detection in movingvideo. Signal processing 31(2), 165–180 (1993)

    Article  Google Scholar 

  13. F. Archetti, C. E. Manfredotti, V. Messina, and DG. Sorrenti (2006) “Foreground-to-ghost discrimination in single-difference pre-processing,” in International Conference on Advanced Concepts for Intelligent Vision Systems. Springer, pp. 263–274.

  14. J. Xia, J. Wu, H. Zhai, and Z. Cui (2009) “Moving vehicle tracking based on double differenceand camshift,” in Proceedings of the International Symposium on Information Processing, vol. 2

  15. Collins, R. T., Lipton, A. J., Kanade, T., Fujiyoshi, H., Duggins, D., Tsin, Y., Wixson, L.: A system for video surveillance and monitoring. VSAM final report, pp 1–68 (2000)

  16. Horn, B.K., Schunck, B.G.: Determining optical flow. Artif Intell 17(1–3), 185–203 (1981)

    Article  Google Scholar 

  17. Toyama, K., Krumm, J., Brumitt, B., Meyers, B.: Wallflower: Principles and practice of background maintenance. In: Proceedings of the seventh IEEE international conference on computer vision 1 255–261. IEEE (2019)

  18. Wren, C.R., Azarbayejani, A., Darrell, T., Pentland, A.P.: Pfinder: Real-time trackingof the human body. IEEE Trans Pattern Anal Mach Intell 19(7), 780–785 (1997)

    Article  Google Scholar 

  19. Haritaoglu, I., Harwood, D., Davis, L.S.: W/sup 4: real-time surveillance of peopleand their activities. IEEE Trans Pattern Anal Mach Intell 22(8), 809–830 (2000)

    Article  Google Scholar 

  20. Elgammal, A., Duraiswami, R., Harwood, D., Davis, L.S.: Background and foregroundmodeling using nonparametric kernel density estimation for visual surveillance. Proc IEEE 90(7), 1151–1163 (2002)

    Article  Google Scholar 

  21. Kim, K., Chalidabhongse, T.H., Harwood, D., Davis, L.: Real-time foreground–background segmentation using codebook model. Real-time Imaging 11(3), 172–185 (2005)

    Article  Google Scholar 

  22. D. Conte, P. Foggia, G. Percannella, and M. Vento (2010) “Performance evaluation of a peopletracking system on pets2009 database,” in Advanced Video and Signal Based Surveillance (AVSS), 2010 Seventh IEEE International Conference on. IEEE, pp. 119–126.

  23. H. Ishiyama, T. Okatani, and K. Deguchi, (2004) “High-speed and high-precision optical flowdetection for real-time motion segmentation,” in SICE 2004 Annual Conference, vol. 2. IEEE, pp. 1202–1205

  24. SC Sen-Ching, C Kamath (2004) “Robust techniques for background subtraction in urbantraffic video,” in Visual Communications and Image Processing 2004, vol. 5308. International Society for Optics and Photonics pp. 881–893

  25. M. Nawaz, J. Cosmas, A. Adnan, M. Ali (2011) “Inter-intra frame segmentation using colourand motion for region of interest coding of video,” in Broadband Multimedia Systems and Broadcasting (BMSB), 2011 IEEE International Symposium on. IEEE, pp. 1–4

  26. S. Mahendran, D. Vaithiyanathan, and R. Seshasayanan (2013) “Object tracking system basedon invariant features,” in Communications and Signal Processing (ICCSP), 2013 International Conference on. IEEE, pp. 1138–1142.

  27. Qin, M., Lu, Y., Di, H., Huang, W.: A background basis selection-based foregrounddetection method. IEEE Trans Multimedia 18(7), 1283–1296 (2016)

    Article  Google Scholar 

  28. T. Kanade, R. Collins, A. Lipton, P. Burt, and L. Wixson (1998) “Advances in cooperative multisensor video surveillance,” in Proceedings of DARPA Image Understanding Workshop, vol. 1, no. 3–24. Citeseer, p. 2.

  29. Martínez-Martín, E., del Pobil, Á. P.: Robust motion detection in real-life scenarios. Springer Science & Business Media. (2012)

  30. D. A. Migliore, M. Matteucci, and M. Naccari “A revaluation of frame difference in fastand robust motion detection,” in Proceedings of the 4th ACM international workshop on Video surveillance and sensor networks. ACM, pp. 215–218 (2006)

  31. Y. Zhang, Q. He, H. Wang, G. Guan, T. Xu, and H. Chen “Background subtraction basedon pixel clustering,” in Information and Automation (ICIA), 2016 IEEE International Conference on. IEEE, pp. 1496–1500 (2016)

  32. M. Braham and M. Van Droogenbroeck “Deep background subtraction with scene-specificconvolutional neural networks,” in Systems, Signals and Image Processing (IWSSIP), 2016 International Conference on. IEEE, pp. 1–4 (2016)

  33. Feng, Z., Yu, Y.: Motion object detection based on improved background subtractionalgorithm. Bolet´ın T´ecnico 55(1), 129–137 (2017)

    Google Scholar 

  34. Panda, D.K., Meher, S.: Detection of moving objects using fuzzy color differencehistogram based background subtraction. IEEE Signal Process Lett 23(1), 45–49 (2016)

    Article  Google Scholar 

  35. Chen, M., Wei, X., Yang, Q., Li, Q., Wang, G., Yang, M. H.: Spatiotemporal GMM for background subtraction with superpixel hierarchy. IEEE transactions on pattern analysis and machine intelligence, 40(6), 1518–1525 (2017)

  36. Subudhi, B.N., Ghosh, S., Shiu, S.C., Ghosh, A.: Statistical feature bag based background subtraction for local change detection. Inf Sci 366, 31–47 (2016)

    Article  MathSciNet  Google Scholar 

  37. Tripathy, D., Reddy, K. G. R.: Adaptive threshold background subtraction for detecting moving object on conveyor belt. Intl. J. Indestructible Math Comput. 1(1), 41–46 (2017)

    Google Scholar 

  38. Babaee, M., Dinh, D. T., Rigoll, G.: A deep convolutional neural network for video sequence background subtraction. Pat. Recogn. 76, 635–649. (2018). https://doi.org/10.1016/j.patcog.2017.09.040  

  39. Zeng, D., Zhu, M.: Background subtraction using multiscale fully convolutional network. IEEE Access 6, 16010–16021 (2018)

    Article  Google Scholar 

  40. Paul, A., Ahmad, A., Rathore, M.M., Jabbar, S.: Smartbuddy: defining human behaviors using big data analytics in social internet of things. IEEE Wirel Commun 23(5), 68–74 (2016)

    Article  Google Scholar 

  41. Ahmad, A., Paul, A., Rathore, M.M., Chang, H.: Smart cyber society: integration of capillary devices with high usability based on cyber-physical system. Future Gener Comput Syst 56, 493–503 (2016)

    Article  Google Scholar 

  42. Khalid, A., Khan, F. A., Imran, M., Alharbi, M., Khan, M., Ahmad, A., Jeon, G.: Reference terms identification of cited articles as topics from citation contexts. Comp. Elect. Eng. 74, 569–580 (2019)

  43. Hussain, M., Ahmed, M., Khattak, H.A., Imran, M., Khan, A., Din, S., Ahmad, A., Jeon, G., Reddy, A.G.: Towards ontology-based multilingual url filtering: a big data problem. J Supercomput 74(10), 50035021 (2018)

    Article  Google Scholar 

  44. A. Ahmad, A. Paul, M. Rathore, and H. Chang (2016) “An efficient multidimensional big data fusion approach in machine-to-machine communication," ACM Transactions on Embedded Computing Systems (TECS) 15 (2): 125

  45. K. Makino, T. Shibata, S. Yachida, T. Ogawa, and K. Takahashi (2017) “Moving-object detectionmethod for moving cameras by merging background subtraction and optical flow methods,” in Signal and Information Processing (GlobalSIP), 2017 IEEE Global Conference on. IEEE, pp. 383–387.

  46. Goyette, N., Jodoin, P.M., Porikli, F., Konrad, J., Ishwar, P.: Changedetection. net: Anew change detection benchmark dataset. In: Computer Vision and Pattern Recognition Workshops (CVPRW) 12 IEEE Computer Society Conference on IEEE, pp. 1–8 (2012)

  47. Karma, K. von Brandt, A.: Moving Object Recognition Using an Adaptive Background Memory. In: Capellini, V., (ed.) Time-Varying image processing and moving object recognition, pp 297–307, Elsevier Publishers B.V, Amsterdam (1990)

  48. Sun, S.-W., Wang, Y.-C.F., Huang, F., Liao, H.-Y.M.: Moving foreground object detection via robust sift trajectories. J Vis Commun Image Represent 24(3), 232–243 (2013)

    Article  Google Scholar 

  49. Jodoin, J. P., Bilodeau, G. A., & Saunier, N.: Background subtraction based on local shape. (2012). arXiv:1204.6326

Download references

Author information

Authors and Affiliations

  1. Centre for Excellence in IT, Institute of Management Sciences, Peshawar, Pakistan

    Fakhri Alam Khan & Muhammad Nawaz

  2. Institute of Computer Sciences and Information Technology, Faculty of Management and Computer Sciences, The University of Agriculture, Peshawar, Pakistan

    Muhammad Imran

  3. Department of Computer Science, Bahria University Islamabad, Islamabad, Pakistan

    Arif Ur Rahman

  4. Department of Computer Science and IT, University of Malakand, Malakand, Pakistan

    Fawad Qayum

Authors
  1. Fakhri Alam Khan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Muhammad Nawaz
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Muhammad Imran
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Arif Ur Rahman
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Fawad Qayum
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Muhammad Imran.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Khan, F.A., Nawaz, M., Imran, M. et al. Foreground detection using motion histogram threshold algorithm in high-resolution large datasets. Multimedia Systems 27, 667–678 (2021). https://doi.org/10.1007/s00530-020-00676-3

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00530-020-00676-3

Keywords

Search

Navigation