Skip to main content

Robust Fusion of Trackers Using Online Drift Prediction

  • Conference paper
  • First Online:
Advanced Concepts for Intelligent Vision Systems (ACIVS 2015)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 9386))

Abstract

Visual object tracking is a standard function of computer vision that has been the source of numerous propositions. This diversity of approaches leads to the idea of trying to fuse them and take advantage of the strengths of each of them while controlling the noise they may introduce in some circumstances. The work presented here describes a generic framework for the combination of trackers, where fusion may occur at different levels of the processing chain. The fusion process is governed by the online detection of abnormal behavior either from specific features provided by each tracker, or from out of consensus detection.

The fusion of three trackers exploiting complementary designs and features is evaluated on 72 fusion schemes. Thorough experiments on 12 standard video sequences and on a new set of 13 videos addressing typical difficulties faced by vision systems used in the demanding context of driving assistance, show that using fusion improves greatly the performance of each individual tracker, and reduces by a factor two the probability of drifting.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Bailer, C., Pagani, A., Stricker, D.: A superior tracking approach: building a strong tracker through fusion. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014, Part VII. LNCS, vol. 8695, pp. 170–185. Springer, Heidelberg (2014)

    Google Scholar 

  2. Bar-Shalom, Y., Willett, P.K., Tian, X.: Tracking and data fusion: A Handbook of Algorithms. Yaakov Bar-Shalom (2011)

    Google Scholar 

  3. Brasnett, P., Mihaylova, L., Bull, D., Canagarajah, N.: Sequential monte carlo tracking by fusing multiple cues in video sequences. Image and Vision Computing 25(8), 1217–1227 (2007)

    Article  Google Scholar 

  4. Breitenstein, M.D., Reichlin, F., Leibe, B., Koller-Meier, E., Van Gool, L.: Online multiperson tracking-by-detection from a single, uncalibrated camera. IEEE Transactions on Pattern Analysis and Machine Intelligence 33(9), 1820–1833 (2011)

    Article  Google Scholar 

  5. Dubout, C., Fleuret, F.: Exact acceleration of linear object detectors. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012, Part III. LNCS, vol. 7574, pp. 301–311. Springer, Heidelberg (2012)

    Chapter  Google Scholar 

  6. Felzenszwalb, P.F., Girshick, R.B., McAllester, D., Ramanan, D.: Object detection with discriminatively trained part-based models. IEEE Transactions on Pattern Analysis and Machine Intelligence 32(9), 1627–1645 (2010)

    Article  Google Scholar 

  7. Geiger, A., Lenz, P., Urtasun, R.: Are we ready for autonomous driving? the kitti vision benchmark suite. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3354–3361. IEEE (2012)

    Google Scholar 

  8. Hare, S., Saffari, A., Torr, P.H.: Struck: structured output tracking with kernels. In: 2011 IEEE International Conference on Computer Vision (ICCV), pp. 263–270. IEEE (2011)

    Google Scholar 

  9. Henriques, J.F., Caseiro, R., Martins, P., Batista, J.: High-speed tracking with kernelized correlation filters. IEEE Transactions on Pattern Analysis and Machine Intelligence 37(3), 583–596 (2015)

    Article  Google Scholar 

  10. Kalal, Z., Mikolajczyk, K., Matas, J.: Tracking-learning-detection. IEEE Transactions on Pattern Analysis and Machine Intelligence 34(7), 1409–1422 (2012)

    Article  Google Scholar 

  11. Kalman, R.E.: A new approach to linear filtering and prediction problems. Journal of Fluids Engineering 82(1), 35–45 (1960)

    Google Scholar 

  12. Khan, M.H., Valstar, M.F., Pridmore, T.P.: A generalized search method for multiple competing hypotheses in visual tracking. In: 2014 22nd International Conference on Pattern Recognition (ICPR), pp. 2245–2250. IEEE (2014)

    Google Scholar 

  13. Kristan, M., Matas, J., Leonardis, A., Vojir, T., Pflugfelder, R., Fernandez, G., Nebehay, G., Porikli, F., Cehovin, L.: A Novel Performance Evaluation Methodology for Single-Target Trackers, March 2015. ArXiv e-prints

    Google Scholar 

  14. Kristan, M., Pflugfelder, R., Leonardis, A., Matas, J., Porikli, F., Cehovin, L., Nebehay, G., Fernandez, G., Vojir, T., Gatt, A., et al.: The visual object tracking vot2013 challenge results. In: 2013 IEEE International Conference on Computer Vision Workshops (ICCVW), pp. 98–111. IEEE (2013)

    Google Scholar 

  15. Kwon, J., Lee, K.M.: Tracking by sampling trackers. In: 2011 IEEE International Conference on Computer Vision (ICCV), pp. 1195–1202. IEEE (2011)

    Google Scholar 

  16. Santner, J., Leistner, C., Saffari, A., Pock, T., Bischof, H.: Prost: parallel robust online simple tracking. In: 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 723–730. IEEE (2010)

    Google Scholar 

  17. Siebel, N.T., Maybank, S.J.: Fusion of multiple tracking algorithms for robust people tracking. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002, Part IV. LNCS, vol. 2353, pp. 373–387. Springer, Heidelberg (2002)

    Chapter  Google Scholar 

  18. Vojir, T., Matas, J., Noskova, J.: Online adaptive hidden markov model for multi-tracker fusion (2015). arXiv preprint arXiv:1504.06103

  19. Wu, Y., Lim, J., Yang, M.H.: Online object tracking: a benchmark. In: 2013 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2411–2418. IEEE (2013)

    Google Scholar 

  20. Yoon, J.H., Kim, D.Y., Yoon, K.-J.: Visual tracking via adaptive tracker selection with multiple features. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012, Part IV. LNCS, vol. 7575, pp. 28–41. Springer, Heidelberg (2012)

    Chapter  Google Scholar 

  21. Zhang, J., Ma, S., Sclaroff, S.: MEEM: robust tracking via multiple experts using entropy minimization. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014, Part VI. LNCS, vol. 8694, pp. 188–203. Springer, Heidelberg (2014)

    Google Scholar 

  22. Zhang, K., Zhang, L., Yang, M.-H.: Real-time compressive tracking. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012, Part III. LNCS, vol. 7574, pp. 864–877. Springer, Heidelberg (2012)

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Isabelle Leang .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Leang, I., Herbin, S., Girard, B., Droulez, J. (2015). Robust Fusion of Trackers Using Online Drift Prediction. In: Battiato, S., Blanc-Talon, J., Gallo, G., Philips, W., Popescu, D., Scheunders, P. (eds) Advanced Concepts for Intelligent Vision Systems. ACIVS 2015. Lecture Notes in Computer Science(), vol 9386. Springer, Cham. https://doi.org/10.1007/978-3-319-25903-1_20

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-25903-1_20

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-25902-4

  • Online ISBN: 978-3-319-25903-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics