Skip to main content
SpringerLink
Log in

A Detection and Tracking Combined Network for Long-Term Tracking

  • Conference paper
  • First Online:
Image and Graphics (ICIG 2021)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 12890))

Included in the following conference series:

  • 2256 Accesses

Abstract

Long-term tracking algorithms need to track targets stably in long videos. Compared with short-term tracking, long-term tracking faces more complex challenges. Such as the background brightness distributed in the entire gray level, wide range of target scale changes, more frequent motion blur and occlusion and other challenges. Existing long-term tracking algorithms cannot solve these challenges well, and easily cause tracking box drift, which significantly decrease the accuracy and robustness of the algorithms. In this paper, we design a detection and tracking combined network that can implement a global instance search for the tracked target. We integrate deformable convolution into the siamese network to solve the target deformation problem during long-term tracking. Besides, guided anchor is adopted in RPN to generate more sparse and accurate proposals, which can decrease the interference of the background. We design the cascaded RCNN with template information to filter out proposals and refine coordinates. And finally, select the highest confidence proposal as the final tracking box. Experiments show that our method has a stronger discriminative ability and can get more accurate tracking boxes compared with other advanced trackers. On several long-term tracking benchmarks, our method has achieved excellent performance.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 99.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 129.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Kalal, Z., Mikolajczyk, K., Matas, J.: Tracking-learning-detection. IEEE Trans. Pattern Anal. Mach. Intell. 34(7), 1409–1422 (2011)

    Article  Google Scholar 

  2. Ma, C., Yang, X., Zhang, C., et al.: Long-term correlation tracking. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 5388–5396 (2015)

    Google Scholar 

  3. Henriques, F., Caseiro, R., Martins, P., et al.: High-speed tracking with kernelized correlation filters. IEEE Trans. Pattern Anal. Mach. Intell. 37(3), 583–596 (2014)

    Article  Google Scholar 

  4. Danelljan, M., Bhat, G., Khan, S., et al.: Atom: accurate tracking by overlap maximization. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 4660–4669 (2019)

    Google Scholar 

  5. Bertinetto, L., Valmadre, J., Henriques, J.F., Vedaldi, A., Torr, P.H.S.: Fully-convolutional Siamese networks for object tracking. In: Hua, G., Jégou, H. (eds.) ECCV 2016. LNCS, vol. 9914, pp. 850–865. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-48881-3_56

    Chapter  Google Scholar 

  6. Li, B., Yan, J., Wu, W., et al.: High performance visual tracking with Siamese region proposal network. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 8971–8980 (2018)

    Google Scholar 

  7. Zhu, Z., Wang, Q., Li, B., et al.: Distractor-aware Siamese networks for visual object tracking. In: European Conference on Computer Vision (ECCV), pp. 101–117 (2018)

    Google Scholar 

  8. Li, B., Wu, W., Wang, Q., et al.: Siamrpn++: evolution of Siamese visual tracking with very deep networks. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 4282–4291 (2019)

    Google Scholar 

  9. Fan, H., Lin, L., Yang, F., et al.: Lasot: a high-quality benchmark for large-scale single object tracking. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 5374–5383 (2019)

    Google Scholar 

  10. Huang, L., Zhao, X., Huang, K.: GOT-10k: a large high-diversity benchmark for generic object tracking in the wild. arXiv preprint arXiv:1810.11981 (2018)

  11. Huang, L., Zhao, X., Huang, K.: Globaltrack: a simple and strong baseline for long-term tracking. In: AAAI Conference on Artificial Intelligence, pp. 11037–11044 (2020)

    Google Scholar 

  12. Ren, S., He, K., Girshick, R., et al.: Faster R-CNN: towards real-time object detection with region proposal networks. IEEE Trans. Pattern Anal. Mach. Intell. 39(6), 1137–1149 (2016)

    Article  Google Scholar 

  13. Dai, J., Qi, H., Xiong, Y., et al.: Deformable convolutional networks. In: IEEE International Conference on Computer Vision, pp. 764–773 (2017)

    Google Scholar 

  14. Wang, J., Chen, K., Yang, S., et al.: Region proposal by guided anchoring. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 2965–2974 (2019)

    Google Scholar 

  15. Lin, T.-Y., et al.: Microsoft COCO: common objects in context. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8693, pp. 740–755. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-10602-1_48

    Chapter  Google Scholar 

  16. Moudgil, A., Gandhi, V.: Long-term visual object tracking benchmark. arXiv preprint arXiv:1712.01358 (2017)

  17. Valmadre, J., Bertinetto, L., Henriques, J. F., et al.: Long-term tracking in the wild: a benchmark. In: European Conference on Computer Vision (ECCV), pp. 670–685 (2018)

    Google Scholar 

  18. Yan, B., Zhao, H., Wang, D., et al.: ‘Skimming-Perusal’ Tracking: a framework for real-time and robust long-term tracking. In: IEEE International Conference on Computer Vision, pp. 2385–2393 (2019)

    Google Scholar 

  19. Fan, H., Ling, H.: Siamese cascaded region proposal networks for real-time visual tracking. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 7952–7961 (2019)

    Google Scholar 

  20. Dai, K., Zhang, Y., Wang, D., et al.: High-performance long-term tracking with meta-updater. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 6298–6307 (2020)

    Google Scholar 

  21. Bhat, G., Danelljan, M., Gool, L.V., et al.: Learning discriminative model prediction for tracking. In: IEEE International Conference on Computer Vision, pp. 6182–6191 (2019)

    Google Scholar 

  22. Danelljan, M., Bhat, G., Shahbaz, Khan, F., et al.: Eco: efficient convolution operators for tracking. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 6638–6646 (2017)

    Google Scholar 

  23. Nam, H., Han, B.: Learning multi-domain convolutional neural networks for visual tracking. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 4293–4302 (2016)

    Google Scholar 

  24. Zhang, Y., Wang, D., Wang, L., et al.: Learning regression and verification networks for long-term visual tracking. arXiv preprint arXiv:1809.04320 (2018)

  25. Xu, Y., Wang, Z., Li, Z., et al.: Siamfc++: towards robust and accurate visual tracking with target estimation guidelines. In: AAAI Conference on Artificial Intelligence, pp. 12549–12556 (2020)

    Google Scholar 

  26. Lukezic, A., Matas, J., Kristan, M.: D3S-A discriminative single shot segmentation tracker. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 7133–7142 (2020)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. University of Electronic Science and Technology of China, Chengdu, 611731, China

    Hao Zeng, Zhengning Wang, Deming Zhao, Yijun Liu & Yi Zeng

Authors
  1. Hao Zeng
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Zhengning Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Deming Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yijun Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Yi Zeng
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zhengning Wang .

Editor information

Editors and Affiliations

  1. Peking University, Beijing, China

    Yuxin Peng

  2. Tsinghua University, Beijing, China

    Shi-Min Hu

  3. Tampere University, Tampere, Finland

    Moncef Gabbouj

  4. Zhejiang University, Hangzhou, China

    Kun Zhou

  5. Technion – Israel Institute of Technology, Haifa, Israel

    Michael Elad

  6. Tsinghua University, Beijing, China

    Kun Xu

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Zeng, H., Wang, Z., Zhao, D., Liu, Y., Zeng, Y. (2021). A Detection and Tracking Combined Network for Long-Term Tracking. In: Peng, Y., Hu, SM., Gabbouj, M., Zhou, K., Elad, M., Xu, K. (eds) Image and Graphics. ICIG 2021. Lecture Notes in Computer Science(), vol 12890. Springer, Cham. https://doi.org/10.1007/978-3-030-87361-5_47

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-87361-5_47

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-87360-8

  • Online ISBN: 978-3-030-87361-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation