Skip to main content
SpringerLink
Log in

Bayesian tracking fusion framework with online classifier ensemble for immersive visual applications

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

During the last decade, the development of the immersive virtual reality (VR) has achieved a great progress in different application areas. For more advanced large-scale immersive VR environments or systems, one of the most challenge is to accurately track the position of the user’s body part such as head when he/she is immersived in the environment to feel the changes among the synthetic stereoscopic image sequences. Unfortunately, accurate tracking is not easy in the virtual reality scenarios due to the variety types of existing intrinsic and extrinsic changes when tracking is on-the-fly. Especially for the single tracker, a long time accurate tracking is usually not possible because of the model adaption problem in different environments. Recent trend of research in tracking is to incorporate multiple trackers into a compositive learning framework and utilize the advantages of different trackers for more effective tracking. Therefore, in this paper, we propose a novel Bayesian tracking fusion framework with online classifier ensemble strategy. The proposed tracking formulates a fusion framework for online learning of multiple trackers by modeling a cumulative loss minimization process. With an optimal pair-wise sampling scheme for the SVM classifier, the proposed fusion framework can achieve more accurate tracking performance when compared with the other state-of-art trackers. In addition, the experiments on the standard benchmark database also verify that the proposed tracking is able to handle the challenges in many immersive VR applications and environments.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Avidan S (2004) Support vector tracking. IEEE Trans Pattern Anal Mach Intell (T-PAMI) 26:1064–1072

    Article  Google Scholar 

  2. Babenko B, Yang M-H, Belongie S (2009) Visual tracking with online multiple instance learning. In: IEEE international conference on computer vision and pattern recognition (CVPR)

  3. Bai Q, Lam H, Sclaroff S (2014) A Bayesian framework for online classifier enemble. In: IEEE international conference on machine learning (ICML)

  4. Bailer C, Pagani A, Stricker D (2014) A superior tracking approach: building a strong tracker through fusion. In: European conference on computer vision (ECCV)

  5. Berclaz J, Fleuret F, Turetken E, Fua P (2011) Multiple object tracking using K-shortest paths optimization. IEEE Trans Pattern Anal Mach Intell (T-PAMI) 33(9):1806–1819

    Article  Google Scholar 

  6. Chen CF (1985) On asymptoric normality of limiting density functions with Bayesian implications. J R Stat Soc (JRSS) 540–546

  7. Chu CW, Nevatia R (2007) Real time body pose tracking in an immersive training environment. In: Lecture Notes in Computer Science, pp 146–156

  8. Comaniciu D, Ramesh V, Meer P (2003) Kernel-based object tracking. IEEE Trans Pattern Anal Mach Intell (T-PAMI) 25:564–577

    Article  Google Scholar 

  9. Dinh TB, Vo N, Medioni G (2011) Context tracker: exploring supporters and distracters in unconstrained environments. In: IEEE international conference on computer vision and pattern recognition (CVPR)

  10. Fan R, Chang K, Hsieh C, Wang X, Lin C (2008) A library for large linear classification. J Mach Learn Res (JMLR)

  11. Felzenszwalb P, Girshick R, McAllester D, Ramanan D (2010) Object detection with discriminatively trained part based models. IEEE Trans Pattern Anal Mach Intell (T-PAMI) 32(9):1627–1645

    Article  Google Scholar 

  12. Grabner H, Leistner C, Bischof H (2008) Semi-supervised on-line boosting for robust tracking. In: European conference on computer vision (ECCV)

  13. Gray RM (2006) Toeplitz and circulant matrices: a review. Now Publisher

  14. Gu S, Zheng Y, Tomasi C (2013) Linear time offline tracking and lower envelope algorithms. IEEE International Conference on Computer Vision(ICCV), pp 1840–1846

  15. Hare S, Saffari A, Torr PHS (2011) Struck: structured output tracking with kernels. In: IEEE international conference on computer vision (ICCV)

  16. Harzallah H, Jurie F, Schmid C (2009) Combining efficient object localization and image classification. In: IEEE international conference on computer vision (ICCV)

  17. Henriques F, Caseiro R, Martins P, Batista J (2012) Exploiting the circulant structure of tracking-by-detection with kernels. In: European conference on computer vision (ECCV)

  18. Hua Y, Alahari K, Schmid C (2014) Occlusion and motion reasoning for long-time tracking. In: European conference on computer vision (ECCV)

  19. Kalal Z, Matas J, Mikolajczyk K (2010) Tracking-learning-detection. IEEE Trans Pattern Anal Mach Intell (T-PAMI) 6(1):1409–1422

    Google Scholar 

  20. Kumar M, Packer B, Koller D (2010) Self-paced learning for latent variable models. In: Neural information processing systems (NIPS)

  21. Kwon J, Lee KM (2010) Visual tracking decomposition. In: IEEE international conference on computer vision and pattern recognition (CVPR)

  22. Kwon J, Lee KM (2011) Tracking by sampling trackers. In: IEEE international conference on computer vision (ICCV)

  23. Laptev I (2005) On space-time interest points. Int J Comput Vis (IJCV) 64:107–123

    Article  Google Scholar 

  24. Li FF, Perona P (2005) A Bayesian hierarchical model for learning natural scene categories. In: IEEE international conference on computer vision and pattern recognition (CVPR), pp 524–531

  25. Liu Y, Granier X (2012) Online tracking of outdoor lighting variations for augmented reality with moving cameras. IEEE Trans Vis Comput Graph (TVCG) 573–580

  26. Liu B, Huang J, Yang L, Kulikowsk C (2011) Robust tracking using local sparse appearance model and K-selection. In: IEEE international conference on computer vision and pattern recognition (CVPR)

  27. Manen S, Kwon J, Guillanumin M, Cool LV (2014) Appearances can be deceiving: learning visual tracking from few trajectory annotations. In: European conference on computer vision (ECCV)

  28. Mikolajczyk K, Schmid C (2004) Scale & affine invariant interest point detectors. Int J Comput Vis (IJCV) 60:63–86

    Article  Google Scholar 

  29. Niebles JC, Wang HC, Li FF (2008) Unsupervised learning of human action categories using spatial-temporal words. Int J Comput Vis (IJCV) 79:299–318

    Article  Google Scholar 

  30. Oron S, Bar-Hillel A, Levi D, Avidan S (2012) Locally orderless tracking. In: IEEE international conference on computer vision and pattern recognition (CVPR)

  31. Saffari A, Leistner C, Godec M, Bischof H (2010) Robust multi-view boosting with priors. In: European conference on computer vision (ECCV)

  32. Salti S, Cavallaro A, Stefano LD (2012) Adaptive appearance modeling for video tracking: survey and evaluation. IEEE Trans Image Process (T-IP) 12:4334–4348

    Article  MathSciNet  Google Scholar 

  33. Sevilla-Lara L, Learned-Miller E (2012) Distribution fields for tracking. In: IEEE international conference on computer vision and pattern recognition (CVPR)

  34. Shalev-Shwartz S, Singer Y, Srebro N (2007) Pegasos: Primal Estimated Subgradient solver for SVM. In: IEEE international conference on machine learning (ICML)

  35. Smeulders AWM, Dung MC, Cucchiara R, Calderara S, Dehghan A, Shah M (2014) Visual tracking: an experimental survey. IEEE Trans Pattern Anal Mach Intell (T-PAMI) 36:1442–1468

    Article  Google Scholar 

  36. Supancic JS III, Ramanan D (2013) Self-paced learning for long-term tracking. In: IEEE international conference on computer vision and pattern recognition (CVPR), pp 2379–2386

  37. Vapnik V (1995) The nature of statistical learning theory

  38. Viola P, Jones MJ (2004) Robust real-time face detection. Int J Comput Vis (IJCV) 57:137–154

    Article  Google Scholar 

  39. Wagner D, Reitmayr G, Mulloni A, Mendez E, Diaz S (2014) Mobile augmented reality 1 tracking, mapping and rendering. In: IEEE international symposium on mixed and augmented reality (ISMAR), p 383

  40. Wu Y, Lim J, Yang M-H (2015) Object tracking benchmark. IEEE Trans Pattern Anal Mach Intell (T-PAMI)

  41. Wu Y, Yang J, Lim MH (2013) Online object tracking: a benchmark. In: IEEE international conference on computer vision and pattern recognition (CVPR), pp 2411–2418

  42. Yang H, Shao L, Zheng F, Wang L, Song Z (2013) Recent advances and trends in visual tracking: a review. Neurocomputing. Elsevier

  43. Yao R, Shi Q, Shen C, Zhang Y, Hengel A (2008) Part-based visual tracking with online latent structural learning. In: IEEE conference on computer vision and pattern recognition (CVPR)

  44. Yilmaz A, Javed O, Shah M (2006) Object tracking: a survey. ACM Comput Surv 38:13–58

    Article  Google Scholar 

  45. Yoon JH, Kim DY, Yoon KJ (2012) Visual tracking via adaptive tracker selection with multiple features. In: European conference on computer vision (ECCV)

  46. Zamir AR, Dehghan A, Shah M (2012) GMCP-tracker: global multi-object tracking using generalized minimum clique graphs. In: European conference on computer vision (ECCV)

  47. Zhang L, Maaten L (2013) Structure preserving object tracker. In: IEEE international conference on computer vision and pattern recognition (CVPR), pp 1838–1845

  48. Zhang K, Zhang L, Yang M-H (2012) Real-time compressive tracking. In: European conference on computer vision (ECCV)

Download references

Acknowledgments

This research is supported by Research Fund for the Doctoral Program of Higher Education of China 20126102120055, National Natural Science Foundation of China 61301194 & 61231016, foundation grant from NWPU 3102014JSJ0014.

Author information

Authors and Affiliations

  1. School of Computer Science, Northwestern Polytechnical University, Xi’an, China

    Peng Zhang, Tao Zhuo, Yanning Zhang & Kangli Chen

  2. School of Aeronautics and Astronautics Engineering, Air Force Engineering University, Xi’an, China

    Hanqiao Huang

Authors
  1. Peng Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Tao Zhuo
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yanning Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Hanqiao Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Kangli Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to Peng Zhang or Tao Zhuo.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhang, P., Zhuo, T., Zhang, Y. et al. Bayesian tracking fusion framework with online classifier ensemble for immersive visual applications. Multimed Tools Appl 75, 5075–5092 (2016). https://doi.org/10.1007/s11042-015-2827-7

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-015-2827-7

Keywords

Search

Navigation