Skip to main content
SpringerLink
Log in

Adaptive fast scale estimation, with accurate online model update based on kernelized correlation filter

  • Original Paper
  • Published:
Machine Vision and Applications Aims and scope Submit manuscript

Abstract

Despite the considerable advances that are emerged in correlation filter-based tracking, in fact, they may achieve excellent performance in robustness, speed, and accuracy; they still fail when dealing with large-scale alteration and show the inability to handle long-term tracking in complex scenarios, where the object undergoes partial occlusion, out-of-view, and deformation. In this paper, we propose a robust approach to address two important problems: the first one is scale estimation in kernelized correlation filter (KCF), and the second one is how to update the model in the process of tracking. We aim in this work to overcome the scale fixed size limitation of kernelized correlation filter-based tracking algorithms and improve the mechanism of model online training. Our approach learns a separate correlation filter to estimate the accurate target scale by finding the scale's candidate that maximizes the output response of the correlation filter mentioned above. Besides, we define a minimum rate of similarity for the online model update to avoid training with failure detections. Our approach is evaluated in terms of precision and accuracy, on a commonly used tracking benchmark with 100 challenging videos; the experimental results show that our proposed tracker outperforms the KCF algorithm and shows promising performance compared to state-of-the-art tracking methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

References

  1. Yilmaz, A., Javed, O., Shah, M.: Object tracking: a survey. ACM Comput. Surv. 38(4), 81–93 (2006)

    Article  Google Scholar 

  2. Cannons, K.: A Review of Visual Tracking. Dept. Comput. Sci. Eng. (2008)

  3. Chen, E., Haik, O., Yitzhaky, Y.: Detecting and tracking moving objects in long-distance imaging through turbulent medium. Appl. Opt. 6, 1181–1190 (2014)

    Article  Google Scholar 

  4. Ross, D.A., Lim, J., Lin, R.-S., Yang, M.-H.: Incremental learning for robust visual tracking. Int. J. Comput. Vision 77(1–3), 125–141 (2008)

    Article  Google Scholar 

  5. Danell, J.M., Hager, G., Khan, F.S., Felsberg, M.: Accurate scale estimation for robust visual tracking. In: Proceedings of the BritishMachine Vision Conference (BMVC ’14), Nottingham, UK (2014)

  6. Yang, F., Lu, H.C., Yang, M.-H.: Robust superpixel tracking. IEEE Trans. Image Process. 23(4), 1639–1651 (2014)

    Article  MathSciNet  Google Scholar 

  7. Collins, R.T., Liu, Y., Leordeanu, M.: Online selection of discriminative tracking features. PAMI 27(10), 1631–1643 (2005)

    Article  Google Scholar 

  8. Kalal, Z., Matas, J., Mikolajczyk, K.: P-Nlearning: bootstrapping binary classifiers by structural constraints. In: Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition (CVPR’10), pp. 49–56, San Diego, CA, USA (2010)

  9. Bolme, D.S., Beveridge, J.R., Draper, B.A., Lui, Y.M.: Visual object tracking using adaptive correlation filters. In: CVPR (2010)

  10. Henriques, J.F., Caseiro, R., Martins, P., Batista, J.: Exploiting the circulant structure of tracking-by-detection with kernels. In: Proceedings of the European Conference on Computer Vision—Volume Part IV, ECCV’12, pp. 702–715. Springer, Berlin (2012)

  11. Henriques, J.F., Caseiro, R., Martins, P., Batista, J.: Highspeed tracking with kernelized correlation filters. IEEE Trans. Pattern Anal. Mach. Intell. 5, 66 (2015)

    Google Scholar 

  12. Hare, S., Saffari, A., Torr, P.H.S.: Struck: structured output tracking with kernels. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV ’11), pp. 263–270. IEEE, Barcelona (2011)

  13. Sevilla-Lara, L., Learned-Miller, E.: Distribution fields for tracking. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR’12), pp. 1910–1917, Providence, RI, USA (2012)

  14. Henriques, J., Caseiro, R., Martins, P., Batista, J.: Exploiting the circulant structure of tracking-by-detection with kernels. In: Proceedings of the European Conference on Computer Vision, pp. 702–715, Florence, Italy (2012)

  15. Wu, Y., Lim, J., Yang, M.-H.: Online object tracking: a benchmark. IEEE Int. Conf. Comput. Vis. Pattern Recognit. 66, 2411–2418 (2013)

    Google Scholar 

  16. Kristan, M., Matas, J., Leonardis, A., Vojir, T., Pflugfelder, R.P., Fernández, G., Nebehay, G., Porikli, F., Cehovin, L.: A novel performance evaluation methodology for single-target trackers. CoRR, abs/1503.01313 )2015)

  17. Hare, S., Saffari, A., Torr, P.H.S.: Struck: structured output tracking with kernels. In: Proceedings of IEEE International Conference on Computer Vision (2011)

  18. Kalal, Z., Matas, J., Mikolajczyk, K.: P–N Learning: Bootstrapping binary classifiers by structural constraints. In: Proceedings of the IEEE Conference on Computing Visions Pattern Recognition pp. 49–56 (2010)

  19. Babenko, B., Yang, M.-H., Belongie, S.: Robust object tracking with online multiple instance learning. IEEE Trans. Pattern Anal. Mach. Intell. 33(7), 1619–1632 (2011)

    Article  Google Scholar 

  20. Zhong, W., Lu, H., Yang, M.-H.: Robust object tracking via sparse collaborative appearance model. IEEE Trans. Image Process. 23(5), 2356–2368 (2014)

    Article  MathSciNet  Google Scholar 

  21. Bolme, D.S., Beveridge, J.R., Draper, B.A., Lui, Y.M.: `Visual tracking using adaptive correlation filters. In: Proceedings of the IEEE Conference on Computing Vision Pattern Recognition, pp. 2544–2550 (2010)

  22. Wu, Y., Lim, J., Yang, M.-H.: `Online object tracking: a benchmark. In: Proceedings of the CVPR, Portland, OR, USA, pp. 2411–2418 (2013)

  23. Danelljan, M., Hager, G., Khan, F.S., Felsberg, M.: Accurate scale estimation for robust visual tracking. In: Proceedings of British Machine Vision Conference (2014)

  24. Li, Y., Zhu, Y.: `A scale adaptive kernel correlation _lter tracker with feature integration. In: Proceedings European Conference Computing Vision, pp. 254–265 (2014)

  25. van de Weijer, J., Schmid, C., Verbeek, J., Larlus, D.: Learning color names for real-world applications. Trans. Image Process. 18(7), 1512–1523 (2009)

    Article  MathSciNet  Google Scholar 

  26. Zha, Y., Ku, T., Li, Y., Zhang, P.: Deep position-sensitive tracking. IEEE Trans. Multimed. 8, 66 (2019)

    Google Scholar 

  27. Zhu, Z., Huang, G., Zou, W., Du, D., . Huang, and : UCT: learning unified convolutional networks for real-time visual tracking. In: Proceedings of the ICCVW, pp. 1973–1982 (2018)

  28. Jung, I., Son, J., Baek, M., Han, B.: Real-time MDNet. In: Proceedings of the ECCV, pp. 89–104 (2018)

  29. Burceanu, E., Leordeanu, M.: Learning a robust society of tracking parts using co-occurrence constraints. In: Proceedings of the ECCVW, pp. 162–178 (2019)

  30. Sun, C., Wang, D., Lu, H., Yang, M.: Learning spatial-aware regressions for visual tracking. In: Proceedings of the IEEE CVPR, pp. 8962–8970 (2018)

  31. Liu, G., Liu, G.: Integrating multi-level convolutional features for correlation filter tracking. In: Proceedings of the ICIP, pp. 3029–3033 (2018)

  32. Li, H., Wang, X., Shen, F., Li, Y., Porikli, F., Wang, M.: Real-time deep tracking via corrective domain adaptation. IEEE Trans. Circuits Syst. Video Technol. 8215, 66 (2019)

    Google Scholar 

  33. Gao, J., Zhang, T., Xu, C.: SMART: joint sampling and regression for visual tracking. IEEE Trans. Image Process. 28(8), 3923–3935 (2019)

    Article  MathSciNet  Google Scholar 

  34. Wang, L., Zhang, L., Wang, J., Yi, Z.: Memory mechanisms for discriminative visual tracking algorithms with deep neural networks. IEEE Trans. Cognit. Dev. Syst. 6, 66 (2019)

    Google Scholar 

  35. Cheng, X., Zhang, Y., Zhou, L., Zheng, Y.: Visual tracking via auto-encoder pair correlation filter. IEEE Trans. Ind. Electron. 5, 56 (2019)

    Google Scholar 

  36. Lu, X., Ni, B., Ma, C., Yang, X.: Learning transform-aware attentive network for object tracking. Neurocomputing 349, 133–144 (2019)

    Article  Google Scholar 

  37. WuYan, Q., LiangYi, Q., Wang, L.: Dsnet: deep and shallow feature learning for efficient visual tracking. In: Proceedings of the ACCV (2018)

  38. Rout, L., Mishra, D., Gorthi, R.K.S.S.: WAEF: weighted aggregation with enhancement filter for visual object tracking. In: Proceedings of the ECCVW, pp. 83–99 (2019)

  39. Li, F., Tian, C., Zuo, W., Zhang, L., Yang, M.H.: Learning spatial-temporal regularized correlation filters for visual tracking. In: Proceedings of the IEEE CVPR, pp. 4904–4913 (2018)

  40. Pu, S., Song, Y., Ma, C., Zhang, H., Yang, M.H.: Deep attentive tracking via reciprocative learning. In: Proceedings of the NIPS, pp. 1931–1941 (2018)

  41. Du, F., Liu, P., Zhao, W., Tang, X.: Spatial–temporal adaptive feature weighted correlation filter for visual tracking. Signal Proc. Image Comm. 67, 58–70 (2018)

    Article  Google Scholar 

  42. Gan, W., Lee, M.S., Wu, C.H., Kuo, C.C.: Online object tracking via motion-guided convolutional neural network (MGNet). J. Vis. Commun. Image Recognit 53, 180–191 (2018)

    Article  Google Scholar 

  43. Li, Y., Fu, C., Huang, Z., Zhang, Y., Pan, J.: Keyfilter-aware real-time uav object tracking. In: Proceedings of the ICRA (2020)

  44. Li, Y., Fu, C., Huang, Z., et al.: Intermittent contextual learning for keyfilter-aware UAV object tracking using deep convolutional feature. IEEE Trans. Multimedia 5, 6 (2020)

    Google Scholar 

  45. Danelljan, M., Bhat, G., Khan, F.S., . Felsberg, F.S.: ATOM: accurate tracking by overlap maximization. In: Proceedings of the IEEE Conference Computing Vision Pattern Recognition, pp. 4660–4669 (2019)

  46. Bertinetto, L., Valmadre, J., Henriques, J.F., Vedaldi, A., Torr, P.H.S.: Fully convolutional siamese networks for object tracking. In: ECCV Workshop (2016)

  47. Li, B., Yan, J., Wu, W., Zhu, Z., Hu, X.: High performance visual tracking with Siamese region proposal network. In: CVPR (2018)

  48. Zhang, Y., Wang, D., Wang, L., Qi, J., Lu, H.: Learning regression and verification networks for long-term visual tracking. CoRR, abs/1809.04320 (2018)

  49. Valmadre, J., Bertinetto, L., Henriques, J.F., Tao, R., Vedaldi, A., Smeulders, A.W.M., Torr, P.H.S., Gavves, E.: Long-term tracking in the wild: a benchmark. In: ECCV (2018)

  50. Eugene, Y.K., Johnston, R.G.: The Ineffectiveness of the Correlation Coefficient for Image Comparisons. Technical Report LAUR-96 2474, Los Alamos (1996)

  51. Wu, Y., Lim, J., Yang, M.H.: Object tracking benchmark. IEEE Trans. Pattern Anal. Mach. Intell. 37(9), 1834–1848 (2015)

    Article  Google Scholar 

  52. Wu, Y., Lim, J., Yang, M.H.: Online object tracking: a benchmark. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (2013)

  53. Kalal, Z., Mikolajczyk, K., Matas, J.: Tracking-learning detection. IEEE Trans. Pattern Anal. Mach. Intell. 34(7), 1409–1422 (2012)

    Article  Google Scholar 

  54. Zhang, J., Ma, S., Sclaroff, S.: MEEM: robust tracking via multiple experts using entropy minimization. In: Proceedings of the European Conference on Computing Vision, pp. 188–203 (2014)

  55. Hong, Z., Chen, Z., Wang, C., Mei, X., Prokhorov, D., Tao, D.: MUlti-Store Tracker (MUSTer): a cognitive psychology inspired approach to object tracking. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (2015)

  56. Bertinetto, L., Valmadre, J., Golodetz, S., Miksik, O., Torr, P.H.S.: Staple: complementary learners for real-time tracking. In: Proceedings of the IEEE Conference Computing Vision Pattern Recognition, pp. 1401–1409 (2016)

  57. Danelljan, M., Häger, G., Khan, F.S., Felsberg, M.: Discriminative scale space tracking. IEEE Trans. Pattern Anal. Mach. Intell. 39(8), 1561–1575 (2017)

    Article  Google Scholar 

  58. Hare, S., Saffari, A., Torr, P.H.S.: Struck: Structured output tracking with kernels. IEEE Trans. Pattern Anal. Mach. Intell. 38(10), 2096–2109 (2016)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Faculty of Technologies, Tahri Mohammed University, 08000, Béchar, Algeria

    Mohammed Chabane & Benahmed Tariq

  2. Faculty of Computer and Mathematics, Tahri Mohammed University, 08000, Béchar, Algeria

    Benahmed Khelifa

Authors
  1. Mohammed Chabane
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Benahmed Khelifa
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Benahmed Tariq
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mohammed Chabane.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chabane, M., Khelifa, B. & Tariq, B. Adaptive fast scale estimation, with accurate online model update based on kernelized correlation filter. Machine Vision and Applications 32, 89 (2021). https://doi.org/10.1007/s00138-021-01216-3

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s00138-021-01216-3

Keywords

Search

Navigation