Skip to main content
SpringerLink
Log in

Visual object tracking with discriminative correlation filtering and hybrid color feature

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

The technology of visual object tracking based on correlation filter has good accuracy and efficiency. However, it is still necessary to be study further on the appearance model of the target, the scale variation of the target and so on. This paper proposes a tracking algorithm based on discriminative correlation filtering and a hybrid color feature. The hybrid color feature is composed of two parts, which are compressed color name features and Histogram of Oriented Gradient features based on opponent color space. These two parts features above are extracted from the target patch, respectively. For the first part, color-name features are extracted from a target patch firstly, and then block-based compressed color-name features are extracted according to these color-name features. For the second part, opponent color features are extracted from the target patch firstly, and then HOG features are extracted from these opponent color features. At the basis of the hybrid color feature, two different discriminative correlation filters are used to estimate the translation and the scale of the target, respectively. Finally, extensive experiments show that the tracking algorithm with the hybrid color features of this paper outperforming several state-of-the-art tracking algorithms.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. Bai B, Zhong B, Ouyang G, Wang P, Liu X, Chen Z, Wang C (2018) Kernel correlation filters for visual tracking with adaptive fusion of heterogeneous cues. Neurocomputing 286:109–120

    Article  Google Scholar 

  2. Bolme DS, Beveridge JR, Draper BA, Lui YM (2010) Visual object tracking using adaptive correlation filters. Comput Vis Pattern Recognit, pp 2544–2550

  3. Bolme DS, Draper B, Beveridge JR (2009) Average of synthetic exact filters. In: IEEE Conference on Computer Vision and Pattern Recognition, 2009. CVPR 2009, pp 2105–2112

  4. Camplani M, Hannuna S, Mirmehdi M, Damen D, Paiement A, Tao L, Burghardt T (2015) Real-time rgb-d tracking with depth scaling kernelised correlation filters and occlusion handling, pp 145.1– 145.11

  5. Dalal N, Triggs B (2005) Histograms of oriented gradients for human detection. In: IEEE computer society conference on computer vision and pattern recognition, 2005. CVPR 2005, pp 886–893

  6. Danelljan M, Häger G., Khan FS, Felsberg M (2014) Accurate scale estimation for robust visual tracking. In: British machine vision conference, pp 65.1–65.11

  7. Danelljan M, Hager G, Khan FS, Felsberg M (2015) Learning spatially regularized correlation filters for visual tracking. In: IEEE international conference on computer vision, pp 4310–4318

  8. Danelljan M, Hager G, Khan FS, Felsberg M (2016) Discriminative scale space tracking. IEEE Trans Pattern Anal Mach Intell 39(8):1561

    Article  Google Scholar 

  9. Danelljan M, Khan FS, Felsberg M, Weijer JVD (2014) Adaptive color attributes for real-time visual tracking. Comput Vis Pattern Recognit, pp 1090–1097

  10. Danelljan M, Robinson A, Khan FS, Felsberg M (2016) Beyond correlation filters: learning continuous convolution operators for visual tracking. In: European conference on computer vision, pp 472–488

    Chapter  Google Scholar 

  11. Dong X, Shen J, Yu D, Wang W, Liu J, Huang H (2017) Occlusion-aware real-time object tracking. IEEE Trans Multimedia 19(4):763

    Article  Google Scholar 

  12. Everts I, Van Gemert JC, Gevers T (2013) Evaluation of color stips for human action recognition. Comput Vis Pattern Recognit, pp 2850–2857

  13. Fan H, Ling H (2017) Sanet: structure-aware network for visual tracking. Computer Vision and Pattern Recognition Workshops, pp 2217–2224

  14. Fan H, Ling H, tracking Parallel (2017) Verifying a framework for real-time and high accuracy visual tracking. In: IEEE international conference on computer vision, pp 5487–5495

  15. Hare S, Saffari A, Torr PHS (2012) Struck: structured output tracking with kernels. In: IEEE international conference on computer vision, pp 263–270

  16. Henriques JF, Rui C, Martins P, Batista J (2012) Exploiting the circulant structure of tracking-by-detection with kernels. In: European conference on computer vision, pp 702–715

    Chapter  Google Scholar 

  17. Henriques JF, Rui C, Martins P, Batista J (2015) High-speed tracking with kernelized correlation filters. IEEE Trans Pattern Anal Mach Intell 37(3):583

    Article  Google Scholar 

  18. Ji H, Ling H, Wu Y, Bao C (2012) Real time robust l1 tracker using accelerated proximal gradient approach. Comput Vis Pattern Recognit, pp 1830–1837

  19. Jiang H, Li J, Wang D, Lu H (2016) Multi-feature tracking via adaptive weights. Neurocomputing 207(C):189

    Article  Google Scholar 

  20. Ke VDS, Gevers T, Snoek CG (2010) Evaluating color descriptors for object and scene recognition. IEEE Trans Pattern Anal Mach Intell 32(9):1582

    Article  Google Scholar 

  21. Khalid OU, Sanmiguel JC, Cavallaro A (2017) Multi-tracker partition fusion. IEEE Trans Circuits Syst Video Technol 27(7):1527

    Article  Google Scholar 

  22. Khan FS, Anwer RM, Weijer J, Bagdanov AD, Lopez AM, Felsberg M (2013) Coloring action recognition in still images. Int J Comput Vis 105(3):205

    Article  Google Scholar 

  23. Khan FS, Weijer JVD, Vanrell M (2012) Modulating shape features by color attention for object recognition. Int J Comput Vis 98(1):49

    Article  Google Scholar 

  24. Kim DH, Jung SW, Suryanto, Lee SJ, Kim HK, Ko SJ (2012) Object modeling with color arrangement for region-based tracking. ETRI J 34(3):399

    Google Scholar 

  25. Kristan M, Pflugfelder R, Leonardis A, Matas J, Porikli F, Cehovin L, Nebehay G, Fernandez G, Vojir T, Gatt A (2014) The visual object tracking vot2013 challenge results

  26. Li Y, Zhu J (2014) A scale adaptive kernel correlation filter tracker with feature integration. In: European conference on computer vision, pp 254–265

    Google Scholar 

  27. Li Y, Zhu J, Hoi SCH (2015) Reliable patch trackers: robust visual tracking by exploiting reliable patches. Comput Vis Pattern Recognit, pp 353–361

  28. Liang P, Blasch E, Ling H (2015) Encoding color information for visual tracking: algorithms and benchmark. IEEE Transactions on Image Processing A Publication of the IEEE Signal Processing Society 24(12):5630

    Article  MathSciNet  Google Scholar 

  29. Liu B, Huang J, Kulikowski C, Yang L (2013) Robust visual tracking using local sparse appearance model and k-selection. IEEE Trans Pattern Anal Mach Intell 35(12):2968

    Article  Google Scholar 

  30. Lu H, Jia X, Yang MH (2012) Visual tracking via adaptive structural local sparse appearance model. Comput Vis Pattern Recognit, pp 1822–1829

  31. Ma C, Huang JB, Yang X, Yang MH (2015) Hierarchical convolutional features for visual tracking. In: IEEE international conference on computer vision, pp 3074–3082

  32. Mueller M, Smith N, Ghanem B (2016) A benchmark and simulator for uav tracking. In: European conference on computer vision, pp 445–461

    Chapter  Google Scholar 

  33. Nam H, Han B (2016) Learning multi-domain convolutional neural networks for visual tracking. Comput Vis Pattern Recognit, pp 4293–4302

  34. Sande KEAVD, Gevers T, Snoek CGM (2008) Evaluation of color descriptors for object and scene recognition. In: IEEE conference on computer vision and pattern recognition, 2008. CVPR 2008, pp 1–8

  35. Sevilla-Lara L (2012) Distribution fields for tracking. Proc. Conf Comput Vis Pattern Recognit, pp 1910–1917

  36. Smeulders AWM, Chu DM, Cucchiara R, Calderara S, Dehghan A, Shah M (2014) Visual tracking: an experimental survey. IEEE Trans Pattern Anal Mach Intell 36(7):1442

    Article  Google Scholar 

  37. Weijer JVD, Schmid C, Verbeek J, Larlus D (2009) Learning color names for real-world applications. IEEE Transactions on Image Processing a Publication of the IEEE Signal Processing Society 18(7):1512

    Article  MathSciNet  Google Scholar 

  38. Wu Y, Lim J, Yang MH (2013) Online object tracking: a benchmark. Comput Vis Pattern Recognit, pp 2411–2418

  39. Wu Y, Lim J, Yang MH (2015) Object tracking benchmark. IEEE Trans Pattern Anal Mach Intell 37(9):1834

    Article  Google Scholar 

  40. Yan C, Xie H, Yang D, Yin J, Zhang Y, Dai Q (2017) Supervised hash coding with deep neural network for environment perception of intelligent vehicles. IEEE Trans Intell Transp Syst 19(1):284

    Article  Google Scholar 

  41. Yao R, Xia S, Zhang Z, Zhang Y (2017) Real-time correlation filter tracking by efficient dense belief propagation with structure preserving. IEEE Trans Multimedia 19(4):772

    Article  Google Scholar 

  42. Yu L, Zhang L, Weijer JVD, Khan FS, Cheng Y, Parraga CA (2018) Beyond eleven color names for image understanding. Mach Vis Appl 29(2):361

    Article  Google Scholar 

  43. Zhang J, Ma S, Sclaroff S (2014) Meem: robust tracking via multiple experts using entropy minimization. In: European conference on computer vision, pp 188–203

    Chapter  Google Scholar 

  44. Zhang K, Zhang L, Yang MH (2012) Real-time compressive tracking. European Conference on Computer Vision, pp 864–877

  45. Zuo W, Wu X, Lin L, Zhang L, Yang MH (2016) Learning support correlation filters for visual tracking. IEEE Trans Pattern Anal Mach Intell PP(99):1

    Google Scholar 

Download references

Acknowledgment

Thank the editor and the anonymous referees for their valuable comments. This research was supported by the Science and Technology Research Project of Jiangxi Education Department (No. GJJ180904), the National Natural Science Foundation of China (No. 61762055, 61572214 and 61662039), the Jiangxi Provincial Natural Science Foundation of China (No. 20181BAB202014) and the Humanities and Social Sciences Foundation of Colleges and Universities in Jiangxi Province (No. TQ18111).

Author information

Authors and Affiliations

  1. School of Information Science and Technology, Jiujiang University, JiuJiang, JiangXi, 332005, China

    Yang Huang, Zhiqiang Zhao, Bin Wu, Zhuolin Mei, Zongmin Cui & Guangyong Gao

  2. School of Computer and Software, Nanjing University of Information Science and Technology, Nanjing, Jiangsu, 210000, China

    Guangyong Gao

Authors
  1. Yang Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Zhiqiang Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Bin Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Zhuolin Mei
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Zongmin Cui
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Guangyong Gao
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zhiqiang Zhao.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Huang, Y., Zhao, Z., Wu, B. et al. Visual object tracking with discriminative correlation filtering and hybrid color feature. Multimed Tools Appl 78, 34725–34744 (2019). https://doi.org/10.1007/s11042-019-07901-w

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-019-07901-w

Keywords

Search

Navigation