Skip to main content

Advertisement

Springer Nature Link
Log in

Robust Visual Tracking with Motion-Aware and Automatic Temporal Regularization

  • Published:
Neural Processing Letters Aims and scope Submit manuscript

    We’re sorry, something doesn't seem to be working properly.

    Please try refreshing the page. If that doesn't work, please contact support so we can address the problem.

Abstract

Discriminative correlation filters (DCF) have significantly advanced visual target tracking. However, most DCF-based trackers suffer from various challenges such as occlusion, rotation, and background clutters. Therefore, we propose a novel visual tracking framework, which introduces a motion-aware strategy and automatic temporal regularization mechanism into the spatial-temporal regularization correlation filter (STRCF) to improve tracking stability. Specifically, the motion-aware strategy based on the optimal Kalman filter (KF) is used to estimate the possible state of the target for overcoming the instability problem in complex environments. Furthermore, a novel automatic temporal regularization mechanism is proposed to solve the problem of target drift due to overhigh temporal penalty. Compared with STRCF, our method obtains AUC gains of 5.86%, 2.60%, 3.82%, 4.95%, 3.55%, and 1.90% for the occlusion, motion blur, in-plane Rotation, out-of-plane rotation, background clutters, and scale variation attributes on the OTB-2015 datasets, respectively. Extensive experiment results on OTB-2013, DTB-70, and UAV-123 datasets have proven the effectiveness and stability of our method.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  1. Kim J-S, Kim M-G (2018) 3d articulated human motion analysis system using a single low-cost rgb-d sensor. In: 2018 International conference on information and communication technology convergence (ICTC), pp. 1446–1448. IEEE

  2. Zhu F, Wang L, Wen Y, Yang L, Pan J, Wang Z, Wang W (2021) Failure handling of robotic pick and place tasks with multimodal cues under partial object occlusion. Front Neurorobot 15:11

    Article  Google Scholar 

  3. Zou Y, Zhang W, Weng W, Meng Z (2019) Multi-vehicle tracking via real-time detection probes and a Markov decision process policy. Sensors 19(6):1309

    Article  Google Scholar 

  4. Zhang T, Xu C, Yang M.-H (2017) Multi-task correlation particle filter for robust object tracking. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 4335–4343

  5. Nai K, Li Z, Gan Y, Wang Q (2021) Robust visual tracking via multitask sparse correlation filters learning. IEEE Trans Neural Netw Learn Syst

  6. LuNežič A, Vojíř T, Čehovin Zajc L, Matas J, Kristan M (2018) Discriminative correlation filter Tracner with channel and spatial reliability. Int J Comput Vision 126(7):671–688

    Article  MathSciNet  Google Scholar 

  7. Ma C, Huang J-B, Yang X, Yang M-H (2015) Hierarchical convolutional features for visual tracking. In: Proceedings of the IEEE international conference on computer vision, pp. 3074–3082

  8. Danelljan M, Hager G, Shahbaz Khan F, Felsberg M (2016) Adaptive decontamination of the training set: A unified formulation for discriminative visual tracking. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 1430–1438

  9. Wang N, Song Y, Ma C, Zhou W, Liu W, Li H (2019) Unsupervised deep tracking. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp. 1308–1317

  10. Yun S, Choi J, Yoo Y, Yun K, Young Choi J (2017) Action-decision networks for visual tracking with deep reinforcement learning. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 2711–2720

  11. Li F, Yao Y, Li P, Zhang D, Zuo W, Yang M-H (2017) Integrating boundary and center correlation filters for visual tracking with aspect ratio variation. In: Proceedings of the IEEE international conference on computer vision workshops, pp. 2001–2009

  12. Li Y, Zhu J (2014) A scale adaptive kernel correlation filter tracker with feature integration. In: European conference on computer vision, pp. 254–265. Springer

  13. Bolme DS, Beveridge JR, Draper BA, Lui YM (2010) Visual object tracking using adaptive correlation filters. In: 2010 IEEE computer society conference on computer vision and pattern recognition, pp. 2544–2550 . IEEE

  14. Dalal N, Triggs B (2005) Histograms of oriented gradients for human detection. In: 2005 IEEE computer society conference on computer vision and pattern recognition (CVPR’05), vol. 1, pp. 886–893. Ieee

  15. Wang M, Liu Y, Huang Z (2017) Large margin object tracking with circulant feature maps. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 4021–4029

  16. Danelljan M, Hager G, Shahbaz Khan F, Felsberg M (2015) Learning spatially regularized correlation filters for visual tracking. In: Proceedings of the IEEE international conference on computer vision, pp. 4310–4318

  17. Li F, Tian C, Zuo W, Zhang L, Yang M-H (2018) Learning spatial-temporal regularized correlation filters for visual tracking. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 4904–4913

  18. Danelljan M, Bhat G, Shahbaz Khan F, Felsberg M (2017) Eco: Efficient convolution operators for tracking. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 6638–6646

  19. Xu T, Feng Z-H, Wu X-J, Kittler J (2019) Learning adaptive discriminative correlation filters via temporal consistency preserving spatial feature selection for robust visual object tracking. IEEE Trans Image Process 28(11):5596–5609

    Article  MathSciNet  MATH  Google Scholar 

  20. Wang M, Liu Y, Huang Z (2017) Large margin object tracking with circulant feature maps. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 4021–4029

  21. Wu Y, Lim J, Yang M-H (2013) Online object tracking: A benchmark. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 2411–2418

  22. Wu Y, Lim J, Yang MH (2015) Object tracking benchmark 37:1834–1848

  23. Li S, Yeung D-Y (2017) Visual object tracking for unmanned aerial vehicles: a benchmark and new motion models. In: Thirty-first AAAI conference on artificial intelligence

  24. Mueller M, Smith N, Ghanem B (2016) A benchmark and simulator for uav tracking. In: European conference on computer vision, pp. 445–461. Springer

  25. Kiani Galoogahi H, Fagg A, Lucey S (2017) Learning background-aware correlation filters for visual tracking. In: Proceedings of the IEEE international conference on computer vision, pp. 1135–1143

  26. Dai K, Wang D, Lu H, Sun C, Li J (2019) Visual tracking via adaptive spatially-regularized correlation filters. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp. 4670–4679

  27. Guo Q, Han R, Feng W, Chen Z, Wan L (2019) Selective spatial regularization by reinforcement learned decision making for object tracking. IEEE Trans Image Process 29:2999–3013

    Article  MATH  Google Scholar 

  28. Xu T, Feng Z, Wu X-J, Kittler J (2021) Adaptive channel selection for robust visual object tracking with discriminative correlation filters, vol. 129, pp. 1359–1375. Springer, ???

  29. Huang Z, Fu C, Li Y, Lin F, Lu P (2019) Learning aberrance repressed correlation filters for real-time uav tracking. In: Proceedings of the IEEE/CVF international conference on computer vision, pp. 2891–2900

  30. Li S, Liu Y, Zhao Q, Feng Z (2022) Learning residue-aware correlation filters and refining scale for real-time UAV tracking, vol. 127, p. 108614. Elsevier, ???

  31. Guo Y, Yang D, Chen Z (2019) Object tracking on satellite videos: a correlation filter-based tracking method with trajectory correction by kalman filter. IEEE J Selected Topic Appl Earth Observ Remote Sens 12(9):3538–3551

    Article  Google Scholar 

  32. Yang H, Wang J, Miao Y, Yang Y, Zhao Z, Wang Z, Sun Q, Wu DO (2019) Combining spatio-temporal context and kalman filtering for visual tracking. Mathematics 7(11):1059

    Article  Google Scholar 

  33. Farahi F, Yazdi HS (2020) Probabilistic kalman filter for moving object tracking. Signal Processing: Image Communication 82:115751

    Google Scholar 

  34. Khan B, Ali A, Jalil A, Mehmood K, Murad M, Awan H (2020) Afam-pec: adaptive failure avoidance tracking mechanism using prediction-estimation collaboration. IEEE Access 8:149077–149092

    Article  Google Scholar 

  35. Liao J, Qi C, Cao J, Wang X, Ren L, Zhang C (2022) Rotation-aware correlation filters for robust visual tracking. J Vis Commun Image Represent 83:103422

    Article  Google Scholar 

  36. Liu K, Gao J, Liu H, Li L, Li B, Hu W (2022) Exploring motion information for distractor suppression in visual tracking. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp. 1924–1932

  37. Danelljan M, Häger G, Khan FS, Felsberg M (2016) Discriminative scale space tracking, vol. 39, pp. 1561–1575. IEEE, ???

  38. Zhang K, Zhang L, Liu Q, Zhang D, Yang M-H (2014) Fast visual tracking via dense spatio-temporal context learning. In: European conference on computer vision, pp. 127–141. Springer

  39. Ma C, Yang X, Zhang C, Yang M-H (2015) Long-term correlation tracking. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 5388–5396

  40. Hong Z, Chen Z, Wang C, Mei X, Prokhorov D, Tao D (2015) Multi-store tracker (muster): a cognitive psychology inspired approach to object tracking, 749–758

  41. Li Y, Fu C, Ding F, Huang Z, Lu G (2020) Autotrack: Towards high-performance visual tracking for uav with automatic spatio-temporal regularization. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp. 11923–11932

  42. Henriques JF, Caseiro R, Martins P, Batista J (2014) High-speed tracking with kernelized correlation filters, vol. 37, pp. 583–596. IEEE, ???

  43. Danelljan M, Häger G, Khan F, Felsberg M (2014) Accurate scale estimation for robust visual tracking. Bmva Press

  44. Bertinetto L, Valmadre J, Golodetz S, Miksik O, Torr PH (2016) Staple: Complementary learners for real-time tracking. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 1401–1409

  45. Mueller M, Smith N, Ghanem B (2017) Context-aware correlation filter tracking, 1396–1404

  46. Ma Z, Xiang Z (2017) Robust visual tracking via binocular consistent sparse learning. Neural Process Lett 46(2):627–642

    Article  Google Scholar 

  47. De Ath G, Everson R (2018) Visual object tracking: The initialisation problem, 142–149. IEEE

  48. Wang N, Zhou W, Tian Q, Hong R, Wang M, Li H (2018) Multi-cue correlation filters for robust visual tracking, 4844–4853

  49. Li X, Ma C, Wu B, He Z, Yang M-H (2019) Target-aware deep tracking, 1369–1378

  50. Li F, Yao Y, Li P, Zhang D, Zuo W, Yang M-H (2017) Integrating boundary and center correlation filters for visual tracking with aspect ratio variation, 2001–2009

  51. Wang N, Song Y, Ma C, Zhou W, Liu W, Li H (2019) Unsupervised deep tracking, 1308–1317

Download references

Author information

Author notes

  1. Heng Yuan and Huan Qi contributed equally to this work.

Authors and Affiliations

  1. School of Software, Liaoning Technical University, Huludao, 125105, China

    Heng Yuan & Huan Qi

Authors
  1. Heng Yuan
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Huan Qi
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Huan Qi.

Ethics declarations

Conflicts of interest

The authors declare that they have no known competing financial interests or personal relationships that could have influenced the work in this paper.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yuan, H., Qi, H. Robust Visual Tracking with Motion-Aware and Automatic Temporal Regularization. Neural Process Lett 55, 3471–3488 (2023). https://doi.org/10.1007/s11063-022-11018-x

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11063-022-11018-x

Keywords