Skip to main content
SpringerLink
Log in

Integral region-based covariance tracking with occlusion detection

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Covariance tracking has achieved impressive successes in recent years due to its competent region covariance-based feature descriptor. Although adopt fast integral image computation, covariance tracking’s brute-force search strategy is still inefficient and it possibly leads to inconsecutive tracking trajectory and distraction. In this work, a generalized, adaptive covariance tracking approach with novel integral region computation and occlusion detection is proposed. The integral region is much faster than integral image and adaptive to the tracking target and tracking condition. The adaptive search window can be adjusted dynamically by simple occlusion detection. The integral image and the global covariance tracking can be seen just a special case of integral region and the proposed approach, respectively. The proposed approach unifies the local and global search strategies in an elegant way and smoothly switches between them according to the tracking conditions (i.e. occlusion distraction or sudden motion) which are judged by occlusion detector. It gets much better efficiency, robustness of distraction, and stable trajectory by local search in normal steady state, while obtains more abilities for occlusion and re-identification by enlarged search window (until to global search) in abnormal situation at the same time. Our approach shows excellent target representation ability, faster speed, and more robustness, which has been verified on some video sequences.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. Adam A, Rivlin E, Shimshoni I (2006) Robust fragments-based tracking using the integral histogram. In: Proceeding of the IEEE conference on computer vision and pattern recognition (CVPR 2006)

  2. Andriyenko A, Schindler K, Roth S (2012) Discrete-continuous optimization for multi-target tracking. In: Proceeding of the IEEE conference on computer vision and pattern recognition (CVPR 2012)

  3. Arsigny V, Fillard P, Pennec X, Ayache N (2006) Log-Euclidean metrics for fast and simple calculus on diffusion tensors. Magnet Reson Med 56:411–421

    Article  Google Scholar 

  4. Arsigny V, Fillard P, Pennec X, Ayache N (2007) Geometric means in a novel vector space structure on symmetric positive definite matrices. SIAM J Matrix Anal Appl 29:328–347

    Article  MATH  MathSciNet  Google Scholar 

  5. Babenko B, Yang MH, Belongie S (2009) Visual tracking with online multiple instance learning. In: Proceeding of the IEEE conference on computer vision and pattern recognition (CVPR 2009)

  6. Bao CL, Wu Y, Ling HB, Ji H (2012) Real time robust L1 tracker using accelerated proximal gradient approach. In: Proceeding of the IEEE conference on computer vision and pattern recognition (CVPR 2012)

  7. Cherian A, Sra A, Banerjee A, Papanikolopoulos N (2011) Efficient similarity search for covariance matrices via the Jensen-Bregman LogDet divergence. In: Proceeding of the 13th international conference on computer vision (ICCV 2011)

  8. Collins RT (2003) Mean-shift blob tracking through scale space. In: Proceeding of the IEEE conference on computer vision and pattern recognition (CVPR 2003)

  9. Comaniciu D, Meer P (2002) Mean shift: a robust approach toward feature space analysis. IEEE Trans Pattern Anal Mach Intell 24:603–609

    Article  Google Scholar 

  10. Comaniciu D, Ramesh V, Meer P (2000) Real-time tracking of non-rigid objects using mean shift. In: Proceeding of the IEEE conference on computer vision and pattern recognition (CVPR 2006)

  11. Comaniciu D, Ramesh V, Meer P (2003) Kernel-based object tracking. IEEE Trans Pattern Anal Mach Intell 25:564–577

    Article  Google Scholar 

  12. Duan G, Ai H, Cao S, Lao S (2012) Group tracking: exploring mutual relations for multiple object tracking. In: Proceeding of the 12th European conference on computer vision (ECCV 2012)

  13. Grabner H, Leistner C, Bischof H (2008) Semi-supervised on-line boosting for robust tracking. In: Proceeding of the 10-th European conference on computer vision (ECCV 2008)

  14. Hare S, Saffari A, Torr P (2011) Struck: structured output tracking with kernels. In: Proceeding of the 13th international conference on computer vision (ICCV 2011)

  15. Hare S, Saffari A, Torr PHS (2012) Efficient online structured output learning for keypoint-based object tracking. In: Proceeding of the IEEE conference on computer vision and pattern recognition (CVPR 2012)

  16. Jia X, Lu H, Yang MH (2012) Visual tracking via adaptive structural local sparse appearance model. In: Proceeding of the IEEE conference on computer vision and pattern recognition (CVPR 2012)

  17. Jiang N, Liu W, Wu Y (2012) Order determination and sparsity-regularized metric learning adaptive visual tracking. In: Proceeding of the IEEE conference on computer vision and pattern recognition (CVPR 2012)

  18. Kalal Z, Mikolajczyk K, Matas J (2010) Face-TLD: tracking-learning-detection applied to face. In: Proceeding of the International Conference on Image Processing (ICIP 2010)

  19. Kalal Z, Matas J, Mikolajczyk K (2010) P-N learning: bootstrapping binary classifiers by structural constraints. In: Proceeding of the IEEE conference on computer vision and pattern recognition (CVPR 2010)

  20. Kwon J, Lee KM (2010) Visual tracking decomposition. In: Proceeding of the IEEE conference on computer vision and pattern recognition (CVPR 2010)

  21. Li X, Shen C, Shi Q, Dick A, Hengel AVD (2012) Non-sparse linear representations for visual tracking with online reservoir metric learning. In: Proceeding of the IEEE conference on computer vision and pattern recognition (CVPR 2012)

  22. Liu J, Carr P, Collins RT, Liu Y (2013) Tracking sports players with context-conditioned motion models. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR 2013)

  23. Maggio E, Cavallaro A (2005) Multi-Part target representation for color tracking. In: Proceeding of the IEEE international conference on image processing (ICIP 2005)

  24. Mei X, Ling H (2009) Robust visual tracking using L1 minimization. In: Proceeding of the IEEE 12th international conference on computer vision (ICCV 2009)

  25. Nguyen QA, Robles-Kelly A, Shen C (2007) Kernel-based tracking from a probabilistic viewpoint. In: Proceedings of the IEEE computer society conference on computer vision and pattern recognition (CVPR 2007)

  26. Parameswaran V, Ramesh V, Zoghlami I (2006) Tunable Kernels for tracking. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR 2006)

  27. Park DW, Kwon J, Lee KM (2012) Robust visual tracking using autoregressive hidden Markov model. In: Proceeding of the IEEE conference on computer vision and pattern recognition (CVPR 2012)

  28. Pennec X, Fillard P, Ayache N (2006) A riemannian framework for tensor computing. Int J Comput Vis 66:41–66

    Article  MATH  Google Scholar 

  29. Perez P, Hue C, Vermaak J, Gangnet M (2002) Color-based probabilistic tracking. In: Proceeding of the 7th European conference on computer vision (ECCV 2002)

  30. Porikli F, Tuzel O (2005) Multi-Kernel object tracking. In: Proceeding of the IEEE international conference on multimedia and expo (ICME 2005)

  31. Porikli F, Tuzel O, Meer P (2006) Covariance tracking using model update based on lie algebra. In: Proceeding of the IEEE conference on computer vision and pattern recognition (CVPR 2006)

  32. Ross DA, Lim J, Lin RS, Yang MH (2008) Incremental learning for robust visual tracking. Int J Comput Vis 77:125–141

    Article  Google Scholar 

  33. Rui Y, Shi Q, Shen S, Zhang Y, Hengel AVD (2013) Part-based visual tracking with online latent structural learning. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR 2013)

  34. Tuzel O, Porikli F, Meer P (2006) Region covariance: a fast descriptor for detection and classification. In: Proceeding of the 9th European conference on computer vision (ECCV 2006)

  35. Tyagi A, James WD, Potamianos G (2008) Steepest descent for efficient covariance tracking. In: Proceeding of the IEEE workshop on in motion and video computing (WMVC 2008)

  36. Viola P, Jones MJ (2004) Robust real-time face detection. Proc Int J Comput Vis 57(2):137–154

    Article  Google Scholar 

  37. Wang J, Yagi Y (2008) Switching local and covariance matching for efficient object tracking. In: Proceeding of the international conference on pattern recognition (ICPR 2008)

  38. Wu Y, Cheng J, Wang J, Lu H (2009) Real-time visual tracking via incremental covariance tensor learning. In: Proceeding of the 12th international conference on computer vision (ICCV 2009)

  39. Wu Y, Cheng J, Wang J (2012) Real-time probabilistic covariance tracking with efficient model update. IEEE Trans Image Process 21(5): 2824–2837

    Article  MathSciNet  Google Scholar 

  40. Wu Y, Lim J, Yang MH (2013) Online object tracking: a benchmark. In: Proceeding of the IEEE conference on computer vision and pattern recognition (CVPR 2013)

  41. Xu D, Wang Y, An J (2005) Applying a new spatial color histogram in mean-shift based tracking algorithm. In: Proceeding of the New Zealand conference on image and vision computing

  42. Xu J, Lu H, Yang MH (2012) Visual tracking via adaptive structural local sparse appearance model. In: Proceeding of the IEEE conference on computer vision and pattern recognition (CVPR 2012)

  43. Yang B, Nevatia R (2012) An online learned CRF model for multi-target tracking. In: Proceeding of the IEEE conference on computer vision and pattern recognition (CVPR 2012)

  44. Yang B, Nevatia R (2012) Multi-target tracking by online learning of non-linear motion patterns and robust appearance models. In: Proceeding of the IEEE conference on computer vision and pattern recognition (CVPR 2012)

  45. Yilmaz A, Javed O, Shah M (2006) Object tracking: a survey. ACM Comput Surv 38:1–45

    Article  Google Scholar 

  46. Zamir AR, Dehghan A, Shah M (2012) GMCP-Tracker: global multi-object tracking using generalized minimum clique graphs. In: Proceeding of the 12th European conference on computer vision (ECCV 2012)

  47. Zhang L, Maaten LVD (2013) Structure preserving object tracking. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR 2013)

  48. Zhang T, Ghanem B, Ahuja N (2012) Robust visual tracking via multi-task sparse learning. In: Proceeding of the IEEE conference on computer vision and pattern recognition (CVPR 2012)

  49. Zhong W, Lu H, Yang MH (2012) Robust object tracking via sparsity-based collaborative model. In: Proceeding of the IEEE conference on computer vision and pattern recognition (CVPR 2012)

Download references

Acknowledgments

This work is supported by National Natural Science Foundation of China (No.61170093) and China Postdoctoral Science Foundation (No. 20110491149).

Author information

Authors and Affiliations

  1. College of Mathematics and Computer Science, Wuhan Textile University, Wuhan, 430073, China

    Ruhan He

  2. School of Education, HuBei University, Wuhan, 430062, China

    Bing Yang

  3. Institute for Pattern Recognition and Artificial Intelligence, Huazhong University of Science and Technology, Wuhan, 430074, China

    Nong Sang

  4. The Green Building Materials and Manufacturing Engineering Research Center of Ministryof Education, Wuhan University of Technology, Wuhan, 430070, China

    Yongsheng Yu

  5. College of computer and information engineering, Inner Mongolia Agricultural University, Huhhot, 010018, China

    Geli Bai

  6. School of Management, Wuhan Textile University, Wuhan, 430073, China

    Jizi Li

Authors
  1. Ruhan He
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Bing Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Nong Sang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yongsheng Yu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Geli Bai
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Jizi Li
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Bing Yang.

Rights and permissions

Reprints and permissions

About this article

Cite this article

He, R., Yang, B., Sang, N. et al. Integral region-based covariance tracking with occlusion detection. Multimed Tools Appl 74, 2157–2178 (2015). https://doi.org/10.1007/s11042-013-1797-x

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-013-1797-x

Keywords

Search

Navigation