Skip to main content
SpringerLink
Log in

A review of visual moving target tracking

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Recently, computer vision and multimedia understanding become important research domains in computer science. Meanwhile, visual tracking of moving target, one of most important application in computer vision, becomes a highlight today. So, this paper reviews research and technology in this domain. First, background and application of visual tracking is introduced. Then, visual tracking methods are classified by different thinking and technologies. Their positiveness, negativeness and improvement are analyzed deeply. Finally, difficulty in this domain is summarized and future prospect of related fields is presented.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17

Similar content being viewed by others

References

  1. Abdel-Hakim AE, Farag AA (2006) CSIFT: A SIFT descriptor with color invariant characteristics//Computer Vision and Pattern Recognition, 2006 I.E. Computer Society Conference on. IEEE 2:1978–1983

  2. Agrafiotis D, Davies SJC, Canagarajah N et al (2007) Towards efficient context-specific video coding based on gaze-tracking analysis. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM) 3(4):4

    Google Scholar 

  3. Aitfares W, Bouyakhf EH, Herbulot A et al (2013) Hybrid region and interest points-based active contour for object tracking. Appl Math Sci 7(118):5879–5899

    Google Scholar 

  4. Allili MS, Ziou D (2008) Object tracking in videos using adaptive mixture models and active contours. Neurocomputing 71(10):2001–2011

    Article  Google Scholar 

  5. Babenko B, Yang MH, Belongie S (2011) Robust object tracking with online multiple instance learning. Pattern Analysis and Machine Intelligence, IEEE Transactions on 33(8):1619–1632

    Article  Google Scholar 

  6. Bao C, Wu Y, Ling H et al (2012) Real time robust l1 tracker using accelerated proximal gradient approach//Computer Vision and Pattern Recognition (CVPR), 2012 I.E. Conference on. IEEE:1830–1837

  7. Bay H, Tuytelaars T, Gool LV (2006) SURF: speeded up robust features. Computer Vision & Image Understanding 110(3):404–417

    Google Scholar 

  8. Beauchemin SS, Barron JL (1995) The computation of optical flow. ACM Computing Surveys (CSUR) 27(3):433–466

    Article  Google Scholar 

  9. Birchfield ST, Rangarajan S (2005) Spatiograms versus histograms for region-based tracking//Computer Vision and Pattern Recognition, 2005. CVPR 2005. IEEE Computer Society Conference on. IEEE 2:1158–1163

  10. Bosch A, Zisserman A, Muoz X (2008) Scene classification using a hybrid generative/discriminative approach. Pattern Analysis and Machine Intelligence, IEEE Transactions on 30(4):712–727

    Article  Google Scholar 

  11. Brox T, Rousson M, Deriche R et al (2010) Colour, texture, and motion in level set based segmentation and tracking. Image and Vision Computing 28(3):376–390

    Article  Google Scholar 

  12. Cai Z, Wen L, Lei Z et al (2014) Robust deformable and occluded object tracking with dynamic graph. Image Processing, IEEE Transactions on 23(12):5497–5509

    Article  MathSciNet  Google Scholar 

  13. Chen Z (2003) Bayesian filtering: fKalman filters to particle filters, and beyond. Statistics 182(1):1–69

    Article  Google Scholar 

  14. Cheng Y (1995) Mean shift, mode seeking, and clustering. Pattern Analysis and Machine Intelligence, IEEE Transactions on 17(8):790–799

    Article  Google Scholar 

  15. Chiverton J, Xie X, Mirmehdi M (2012) Automatic bootstrapping and tracking of object contours. Image Processing, IEEE Transactions on 21(3):1231–1245

    Article  MathSciNet  Google Scholar 

  16. Choi JW, Whangbo TK, Kim CG (2015) A contour tracking method of large motion object using optical flow and active contour model. Multimedia Tools and Applications 74(1):199–210

    Article  Google Scholar 

  17. Chu DM, Smeulders AWM (2010) Color invariant surf in discriminative object tracking,” in Proc. IEEE ECCV, Heraklion

  18. Cohen LD (1991) On active contour models and balloons. CVGIP: Image understanding 53(2):211–218

    Article  MATH  Google Scholar 

  19. Coifman B, Beymer D, McLauchlan P et al (1998) A real-time computer vision system for vehicle tracking and traffic surveillance. Transportation Research Part C: Emerging Technologies 6(4):271–288

    Article  Google Scholar 

  20. Collins RT (2003) Mean-shift blob tracking through scale space//Computer Vision and Pattern Recognition, 2003. Proceedings. 2003 I.E. Computer Society Conference on. IEEE, 2: II-234-40 vol. 2

  21. Collins RT, Liu Y, Leordeanu M (2005) Online selection of discriminative tracking features. Pattern Analysis and Machine Intelligence, IEEE Transactions on 27(10):1631–1643

    Article  Google Scholar 

  22. Collins R, Zhou X, Seng KT (2005) An open source tracking testbed and evaluation web site. Perf.eval.track. & Surveillance

  23. Comaniciu D, Meer P (2002) Mean shift: a robust approach toward feature space analysis. Pattern Analysis and Machine Intelligence, IEEE Transactions on 24(5):603–619

    Article  Google Scholar 

  24. Comaniciu D, Ramesh V, Meer P (2000) Real-time tracking of non-rigid objects using mean shift, BEST PAPER AWARD, IEEE Conf. Computer Vision and Pattern Recognition (CVPR’00), Hilton Head Island, South Carolina 2:142–149

  25. Comaniciu D, Ramesh V, Meer P (2003) Kernel-based object tracking. Pattern Analysis and Machine Intelligence, IEEE Transactions on 25(5):564–577

    Article  Google Scholar 

  26. Cuenca C, González E, Trujillo A et al (2015) Fast and accurate circle tracking using active contour models. J Real-Time Image Process:1–10

  27. Dalal N, Triggs B (2005) Histograms of oriented gradients for human detection. Computer Vision and Pattern Recognition 1:886–893

    Google Scholar 

  28. Danelljan M, Hager G, Shahbaz Khan F et al (2015) Learning spatially regularized correlation filters for visual tracking//Proceedings of the IEEE International Conference on Computer Vision:4310–4318

  29. Fisher RB (2004) The PETS04 surveillance ground-truth data sets. Proc. Sixth IEEE Int. Work. on Performance Evaluation of Tracking and Surveillance (PETS04)

  30. Fu W, Zhou J, Liu S et al (2014) Differential trajectory tracking with automatic learning of background reconstruction. Multimedia Tools & Applications. doi:10.1007/s11042-014-2391-6

    Google Scholar 

  31. Fu W, Zhou J, An C (2015) Distributed dynamic target tracking method by block diagonalization of topological matrix. Journal of Supercomputing. doi:10.1007/s11227-015-1499-4

    Google Scholar 

  32. Fu W, Zhou J, Ma Y (2015) Moving tracking with approximate topological isomorphism. Multimedia Tools & Applications. doi:10.1007/s11042-015-2519-3

    Google Scholar 

  33. Fukunaga K, Hostetler LD (1975) The estimation of the gradient of a density function, with applications in pattern recognition. Information Theory, IEEE Trans 21(1):32–40

    Article  MathSciNet  MATH  Google Scholar 

  34. Gress O, Posch S (2012) Trajectory retrieval from Monte Carlo data association samples for tracking in fluorescence microscopy images//Biomedical Imaging (ISBI), 2012 9th IEEE International Symposium on. IEEE:374–377

  35. Guo S, Shi X, Wang Y et al (2016) Non-rigid object tracking using modified mean-shift method//Information Science and Applications (ICISA) 2016. Springer Singapore:451–458

  36. Hinton GE, Salakhutdinov RR (2006) Reducing the dimensionality of data with neural networks. Science 313(5786):504–507

    Article  MathSciNet  MATH  Google Scholar 

  37. Hong S, Bolić M, Djuric PM (2012) An efficient fixed-point implementation of residual resampling scheme for high-speed particle filters. IEEE Signal Processing Letters 11(5):482–485

    Article  Google Scholar 

  38. Hong S, Shi Z, Wang L et al (2013) Adaptive regularized particle filter for synchronization of chaotic colpitts circuits in an AWGN Channel. Circuits Systems & Signal Processing 32(2):825–841

    Article  MathSciNet  Google Scholar 

  39. Horn B K, Schunck B G (1981) Determining optical flow//1981 Technical symposium east. Int Soc Optics Photon:319–331

  40. Hou Z, Han C (2006) A survey of visual tracking. Acta Automatica Sinica 32(4):603–617

    Google Scholar 

  41. Huang K, Chen X, Kang Y et al (2015) Intelligent visual surveillance: a review. Chinese Journal of Computers 38(6):1093–1118

    MathSciNet  Google Scholar 

  42. Huang Y, Liu Z (2015) Segmentation and tracking of lymphocytes based on modified active contour models in phase contrast microscopy images. Comput Math Methods Med 2015

  43. Hwang SS, Speyer JL (2011) Particle filters with adaptive resampling technique applied to relative positioning using GPS carrier-phase measurements. IEEE Transactions on Control Systems Technology 19(19):1384–1396

    Article  Google Scholar 

  44. Jatoth RK, Gopisetty S, Hussain M (2015) Performance analysis of alpha beta filter, kalman filter and meanshift for object tracking in video sequences. International Journal of Image, Graphics and Signal Processing (IJIGSP) 7(3):24

    Article  Google Scholar 

  45. Jeyakar J, Babu RV, Ramakrishnan KR (2008) Robust object tracking with background-weighted local kernels. Computer Vision and Image Understanding 112(3):296–309

    Article  Google Scholar 

  46. Jia X, Lu H, Yang MH (2012) Visual tracking via adaptive structural local sparse appearance model//Computer vision and pattern recognition (CVPR), 2012 I.E. Conference on. IEEE:1822–1829

  47. Jia D, Zhang L, Li C (2015) The improvement of mean-shift algorithm in target tracking. International Journal of Security and Its Applications 9(2):21–28

    Article  Google Scholar 

  48. Kalal Z, Mikolajczyk K, Matas J (2012) Tracking-learning-detection. Pattern Analysis and Machine Intelligence, IEEE Transactions on 34(7):1409–1422

    Article  Google Scholar 

  49. Kalton G (2014) Systematic sampling//Wiley StatsRef: Statistics Reference Online. Wiley

  50. Kass M, Witkin A, Terzopoulos D (1988) Snakes: active contour models. International journal of computer vision 1(4):321–331

    Article  MATH  Google Scholar 

  51. Ke Y, Sukthankar R (2004) PCA-SIFT: A more distinctive representation for local image descriptors//Computer Vision and Pattern Recognition, 2004. CVPR 2004. Proceedings of the 2004 I.E. Computer Society Conference on. IEEE 2: II-506-II-513 Vol. 2

  52. Kotecha JH, Djurić PM (2003) Gaussian particle filtering. Signal Processing, IEEE Transactions on 51(10):2592–2601

    Article  MathSciNet  Google Scholar 

  53. Kristan M, Matas J, Leonardis A et al (2015) The Visual Object Tracking VOT2015 challenge results//Proceedings of the IEEE International Conference on Computer Vision Workshops:1–23.

  54. Kwok C, Fox D, Meila M (2004) Real-time particle filters. Proceedings of the IEEE 92(3):469–484

    Article  Google Scholar 

  55. Kwon J, Lee KM, Park FC (2009) Visual tracking via geometric particle filtering on the affine group with optimal importance functions//Computer Vision and Pattern Recognition, 2009. CVPR 2009. IEEE Conference on. IEEE:991–998

  56. Leichter I (2012) Mean shift trackers with cross-bin metrics. Pattern Analysis and Machine Intelligence, IEEE Transactions on 34(4):695–706

    Article  Google Scholar 

  57. Li X, Hu W, Shen C et al (2013) A survey of appearance models in visual object tracking. ACM transactions on Intelligent Systems and Technology (TIST) 4(4):58

    Google Scholar 

  58. Li A, Lin M, Wu Y et al (2016) NUS-PRO: a new visual tracking challenge. IEEE Transactions on Pattern Analysis & Machine Intelligence 38(2):335–349

    Article  Google Scholar 

  59. Li S, Wu O, Zhu C et al (2014) Visual object tracking using spatial context information and global tracking skills. Computer Vision and Image Understanding 125:1–15

    Article  Google Scholar 

  60. Li X, Wu F, Hu Z (2005) Convergence of a mean shift algorithm. Journal of Software 16(3):365–374

    Article  MathSciNet  MATH  Google Scholar 

  61. Lowe DG (1999) Object recognition from local scale-invariant features//Computer vision, 1999. The proceedings of the seventh IEEE international conference on. Ieee 2:1150–1157

  62. Lowe DG (2004) Distinctive image features from scale-invariant key points. International journal of computer vision 60(2):91–110

    Article  Google Scholar 

  63. Lucas BD, Kanade T (1981) An iterative image registration technique with an application to stereo vision. IJCAI 81:674–679

    Google Scholar 

  64. Masoud O, Papanikolopoulos NP (2001) A novel method for tracking and counting pedestrians in real-time using a single camera. Vehicular Technol, IEEE Trans 50(5):1267–1278

    Article  Google Scholar 

  65. Mei X, Ling H (2009) Robust visual tracking using L1 minimization//Computer Vision, 2009 I.E. 12th International Conference on. IEEE:1436–1443

  66. Menet S, Saint-Marc P, Medioni G (1990) B-snakes: implementation and application to stereo//proceedings DARPA 720:726

  67. Mondal A, Ghosh S, Ghosh A (2016) Efficient silhouette-based contour tracking using local information. Soft Computing 20(2):785–805

    Article  Google Scholar 

  68. Morel JM, Yu G (2009) ASIFT: a new framework for fully affine invariant image comparison. SIAM Journal on Imaging Sciences. SIAM J Imaging Sci 2(2):438–469

    Article  MathSciNet  MATH  Google Scholar 

  69. Nam H, Han B (2015) Learning multi-domain convolutional neural networks for visual tracking. Comput Sci

  70. Nieto M, Cortés A, Otaegui O et al (2016) Real-time lane tracking using Rao-Blackwellized particle filter. Journal of Real-Time Image Processing 11(1):179–191

    Article  Google Scholar 

  71. Ning J, Zhang L, Zhang D et al (2013) Joint registration and active contour segmentation for object tracking. Circuits and Systems for Video Technology, IEEE Transactions on 23(9):1589–1597

    Article  Google Scholar 

  72. Oron S, Bar-Hillel A, Levi D et al (2015) Locally orderless tracking. International Journal of Computer Vision 111(2):213–228

    Article  MathSciNet  Google Scholar 

  73. Pai CJ, Tyan HR, Liang YM et al (2004) Pedestrian detection and tracking at crossroads. Pattern Recognition 37(5):1025–1034

    Article  MATH  Google Scholar 

  74. Peng N, Yang J, Liu Z et al (2005) Automatic selection of kernel-bandwidth for mean-shift object tracking. Journal of Software 16(9):1542–1550

    Article  Google Scholar 

  75. Rosenfeld A (2001) From image analysis to computer vision: an annotated bibliography, 1955–1979. Computer Vision and Image Understanding 84(2):298–324

    Article  MATH  Google Scholar 

  76. Shaul Oron DL, Aharon B-H, Avidan S (2012) Locally orderless tracking,” in Proc. IEEE CVPR, Providence

  77. Smeulders AWM, Chu DM, Cucchiara R et al (2014) Visual tracking: an experimental survey. Pattern Analysis and Machine Intelligence, IEEE Transactions on 36(7):1442–1468

    Article  Google Scholar 

  78. Sun S, Guo Q, Dong F et al (2013) On-line boosting based real-time tracking with efficient hog//Acoustics, Speech and Signal Processing (ICASSP), 2013 I.E. International Conference on. IEEE:2297–2301

  79. Sun X, Yao H, Zhang S et al (2015) Non-rigid object contour tracking via a novel supervised level set model. Image Processing, IEEE Transactions on 24(11):3386–3399

    Article  MathSciNet  Google Scholar 

  80. Tao X, Shaogang G (2006) Beyond tracking: modeling activity and understanding behavior. Int J Comput Vis

  81. Vezzani R, Cucchiara R (2010) Video surveillance online repository (visor): an integrated framework. Multimedia Tools and Applications 50(2):359–380

    Article  Google Scholar 

  82. Vojir T, Noskova J, Matas J (2014) Robust scale-adaptive mean-shift for tracking. Pattern Recognition Letters 49:250–258

    Article  Google Scholar 

  83. Wang Z, Hong K (2012) A new method for robust object tracking system based on scale invariant feature transform and camshaft //Proceedings of the 2012 ACM Research in Applied Computation Symposium. ACM:132–136

  84. Wang N, Shi J, Yeung D Y et al (2015) Understanding and diagnosing visual tracking systems//Proceedings of the IEEE International Conference on Computer Vision:3101–3109

  85. Wang H, Wang J, Ren M et al (2009) A new robust object tracking algorithm by fusing multi-features. Journal of Image and Graphics 14(3):489–498

    MathSciNet  Google Scholar 

  86. Wu Y, Lim J, Yang MH (2013) Online object tracking: a benchmark//IEEE Conference on Computer Vision & Pattern Recognition:2411–2418

  87. Xia C, Sun S F, Chen P et al (2014) Haar-like and HOG fusion based object tracking//Advances in Multimedia Information Processing–PCM 2014. Springer International Publishing:173–182

  88. Xie Z, Wei Z, Bai C (2015) Multi-aircrafts tracking using spatial–temporal constraints-based intra-frame scale-invariant feature transform feature matching. Computer Vision, IET 9(6):831–840

    Article  Google Scholar 

  89. Xu F, Gao M (2010) Human detection and tracking based on HOG and particle filter//Image and Signal Processing (CISP), 2010 3rd International Congress on. IEEE 3:1503–1507

  90. Yan H, Dechant CM, Moradkhani H (2015) Improving soil moisture profile prediction with the particle filter-markov chain Monte Carlo method. IEEE Transactions on Geoscience & Remote Sensing 53(11):6134–6147

    Article  Google Scholar 

  91. Yang F, Lu H, Yang MH (2014) Robust superpixel tracking. Image Processing, IEEE Transactions on 23(4):1639–1651

    Article  MathSciNet  Google Scholar 

  92. Yi S, He Z, You X et al (2015) Single object tracking via robust combination of particle filter and sparse representation. Signal Processing 110:178–187

    Article  Google Scholar 

  93. Yilmaz A, Javed O, Shah M (2006) Object tracking: a survey. Acm computing surveys (CSUR) 38(4):13

    Article  Google Scholar 

  94. Youm S, Liu S (2015) Development healthcare PC and multimedia software for improvement of health status and exercise habits. Multimedia Tools and Applications. doi:10.1007/10.1007/s11042-015-2998-2

    Google Scholar 

  95. Zhong W, Lu H, Yang MH (2012) Robust object tracking via sparsity-based collaborative model//Computer vision and pattern recognition (CVPR), 2012 I.E. Conference on. IEEE:1838–1845

  96. Zhou Z, Zhou M, Li J (2016) Object tracking method based on hybrid particle filter and sparse representation. Multimed Tools Appl:1–15

  97. Zhu Q, Yeh MC, Cheng KT et al (2006) Fast human detection using a cascade of histograms of oriented gradients//Computer Vision and Pattern Recognition, 2006 I.E. Computer Society Conference on. IEEE 2:1491–1498

Download references

Acknowledgments

This research is supported by following grants:

National Natural Science Foundation of China [61502254] and National Natural Science Foundation of Inner Mongolia [2014BS0606].

Author information

Authors and Affiliations

  1. College of Computer Science, Inner Mongolia University, Hohhot, 130012, China

    Zheng Pan, Shuai Liu & Weina Fu

  2. College of Computer and Information Engineering, Inner Mongolia Agricultural University, Hohhot, 130012, China

    Weina Fu

Authors
  1. Zheng Pan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Shuai Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Weina Fu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Shuai Liu.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Pan, Z., Liu, S. & Fu, W. A review of visual moving target tracking. Multimed Tools Appl 76, 16989–17018 (2017). https://doi.org/10.1007/s11042-016-3647-0

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-016-3647-0

Keywords

Search

Navigation