Skip to main content
Log in

Kernel-based object tracking using asymmetric kernels with adaptive scale and orientation selection

  • Original Paper
  • Published:
Machine Vision and Applications Aims and scope Submit manuscript

Abstract

Kernel-based object tracking refers to computing the translation of an isotropic object kernel from one video frame to the next. The kernel is commonly chosen as a primitive geometric shape and its translation is computed by maximizing the likelihood between the current and past object observations. In the case when the object does not have an isotropic shape, kernel includes non-object regions which biases the motion estimation and results in loss of the tracked object. In this paper, we propose to use an asymmetric object kernel for improving the tracking performance. An important advantage of an asymmetric kernel over an isotropic kernel is its precise representation of the object shape. This property enhances tracking performance due to discarding the non-object regions. The second contribution of our paper is the introduction of a new adaptive kernel scale and orientation selection method which is currently achieved by greedy algorithms. In our approach, the scale and orientation are introduced as additional dimensions to the spatial image coordinates, in which the mode seeking, hence tracking, is achieved simultaneously in all coordinates. Demonstrated in a set of experiments, the proposed method has better tracking performance with comparable execution time then kernel tracking methods used in practice.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Cacoullos T.: Estimation of a multivariate density. Ann. Inst. Stat. Math. 18, 179–189 (1966)

    Article  MATH  MathSciNet  Google Scholar 

  2. Cheng Y.: Mean shift, mode seeking, and clustering. IEEE Trans. Pattern Anal. Mach. Intell. 17, 790–799 (1995)

    Article  Google Scholar 

  3. Collins, R.: Mean-shift blob tracking through scale space. In: IEEE Conference on Computer Vision and Pattern Recognition (2003)

  4. Comaniciu D.: An algorithm for data-driven bandwidth selection. IEEE Trans. Pattern Anal. Mach. Intell. 25(2), 281–288 (2003)

    Article  Google Scholar 

  5. Comaniciu, D., Meer, P.: Mean shift analysis and applications. In: IEEE International Conference on Computer Vision, vol. 2, pp. 1197–1203 (1999)

  6. Comaniciu D., Meer P.: Mean shift: a robust approach toward feature space analysis. IEEE Trans. Pattern Anal. Mach. Intell. 24(5), 603–619 (2002)

    Article  Google Scholar 

  7. Comaniciu, D., Ramesh, V., Meer, P.: Real-time tracking of non-rigid objects using mean shift. In: IEEE Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 142–149 (2000)

  8. Comaniciu D., Ramesh V., Meer P.: Kernel-based object tracking. IEEE Trans. Pattern Anal. Mach. Intell. 25, 564–575 (2003)

    Article  Google Scholar 

  9. Fukunaga K., Hostetler L.D.: The estimation of the gradient of a density function, with applications in pattern recognition. IEEE IT 21(1), 32–40 (1975)

    Article  MATH  MathSciNet  Google Scholar 

  10. Devan, M., Hager, G.D., Stewart, C.V.: Multiple kernel tracking with SSD. In: CVPR, vol. 1, pp. 790–797 (2004)

  11. Georgescu B., Meer P.: Point matching under large image deformations and illumination changes. PAMI 26, 674–688 (2004)

    Google Scholar 

  12. Gorelick L., Galun M., Sharon E., Basri R., Brandt A.: Shape representation and classification using the poisson equation. IEEE Trans. Pattern Anal. Mach. Intell. 28(12), 1991–2005 (2006)

    Article  Google Scholar 

  13. Michels P.: Asymmetric kernel functions in non-parametric regression analysis and prediction. Statistician 41(4), 439–454 (1992)

    Article  Google Scholar 

  14. Parzen E.: On estimation of a probability density function and mode. Ann. Inst. Stat. Math. 33, 1065–1076 (1962)

    MATH  MathSciNet  Google Scholar 

  15. Wang, J., Thiesson, B., Xu, Y., Cohen, M.F.: Image and video segmentation by anisotropic mean shift. In: European Conference on Computer Vision (2004)

  16. Yilmaz A., Javed O., Shah M.: Object tracking: a survey. ACM Comput. Surv. 38(4), 13 (2006)

    Article  Google Scholar 

  17. Yilmaz A., Shafique K., Shah M.: Target tracking in airborne forward looking imagery. Elsevier J. Image Vis. Comput. 21(7), 623–635 (2003)

    Article  Google Scholar 

  18. Yilmaz, A.: Object tracking by asymmetric kernel mean shift with automatic scale and orientation selection. In: IEEE Conference on Computer Vision and Pattern Recognition (2007)

  19. Yilmaz A., Shah M.: Contour based object tracking with occlusion handling in video acquired using mobile cameras. IEEE Trans. Pattern Anal. Mach. Intell. 26(11), 1531–1536 (2004)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Alper Yilmaz.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Yilmaz, A. Kernel-based object tracking using asymmetric kernels with adaptive scale and orientation selection. Machine Vision and Applications 22, 255–268 (2011). https://doi.org/10.1007/s00138-009-0237-4

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00138-009-0237-4

Keywords

Navigation