Abstract
Kernel-based object tracking refers to computing the translation of an isotropic object kernel from one video frame to the next. The kernel is commonly chosen as a primitive geometric shape and its translation is computed by maximizing the likelihood between the current and past object observations. In the case when the object does not have an isotropic shape, kernel includes non-object regions which biases the motion estimation and results in loss of the tracked object. In this paper, we propose to use an asymmetric object kernel for improving the tracking performance. An important advantage of an asymmetric kernel over an isotropic kernel is its precise representation of the object shape. This property enhances tracking performance due to discarding the non-object regions. The second contribution of our paper is the introduction of a new adaptive kernel scale and orientation selection method which is currently achieved by greedy algorithms. In our approach, the scale and orientation are introduced as additional dimensions to the spatial image coordinates, in which the mode seeking, hence tracking, is achieved simultaneously in all coordinates. Demonstrated in a set of experiments, the proposed method has better tracking performance with comparable execution time then kernel tracking methods used in practice.
Similar content being viewed by others
References
Cacoullos T.: Estimation of a multivariate density. Ann. Inst. Stat. Math. 18, 179–189 (1966)
Cheng Y.: Mean shift, mode seeking, and clustering. IEEE Trans. Pattern Anal. Mach. Intell. 17, 790–799 (1995)
Collins, R.: Mean-shift blob tracking through scale space. In: IEEE Conference on Computer Vision and Pattern Recognition (2003)
Comaniciu D.: An algorithm for data-driven bandwidth selection. IEEE Trans. Pattern Anal. Mach. Intell. 25(2), 281–288 (2003)
Comaniciu, D., Meer, P.: Mean shift analysis and applications. In: IEEE International Conference on Computer Vision, vol. 2, pp. 1197–1203 (1999)
Comaniciu D., Meer P.: Mean shift: a robust approach toward feature space analysis. IEEE Trans. Pattern Anal. Mach. Intell. 24(5), 603–619 (2002)
Comaniciu, D., Ramesh, V., Meer, P.: Real-time tracking of non-rigid objects using mean shift. In: IEEE Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 142–149 (2000)
Comaniciu D., Ramesh V., Meer P.: Kernel-based object tracking. IEEE Trans. Pattern Anal. Mach. Intell. 25, 564–575 (2003)
Fukunaga K., Hostetler L.D.: The estimation of the gradient of a density function, with applications in pattern recognition. IEEE IT 21(1), 32–40 (1975)
Devan, M., Hager, G.D., Stewart, C.V.: Multiple kernel tracking with SSD. In: CVPR, vol. 1, pp. 790–797 (2004)
Georgescu B., Meer P.: Point matching under large image deformations and illumination changes. PAMI 26, 674–688 (2004)
Gorelick L., Galun M., Sharon E., Basri R., Brandt A.: Shape representation and classification using the poisson equation. IEEE Trans. Pattern Anal. Mach. Intell. 28(12), 1991–2005 (2006)
Michels P.: Asymmetric kernel functions in non-parametric regression analysis and prediction. Statistician 41(4), 439–454 (1992)
Parzen E.: On estimation of a probability density function and mode. Ann. Inst. Stat. Math. 33, 1065–1076 (1962)
Wang, J., Thiesson, B., Xu, Y., Cohen, M.F.: Image and video segmentation by anisotropic mean shift. In: European Conference on Computer Vision (2004)
Yilmaz A., Javed O., Shah M.: Object tracking: a survey. ACM Comput. Surv. 38(4), 13 (2006)
Yilmaz A., Shafique K., Shah M.: Target tracking in airborne forward looking imagery. Elsevier J. Image Vis. Comput. 21(7), 623–635 (2003)
Yilmaz, A.: Object tracking by asymmetric kernel mean shift with automatic scale and orientation selection. In: IEEE Conference on Computer Vision and Pattern Recognition (2007)
Yilmaz A., Shah M.: Contour based object tracking with occlusion handling in video acquired using mobile cameras. IEEE Trans. Pattern Anal. Mach. Intell. 26(11), 1531–1536 (2004)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Yilmaz, A. Kernel-based object tracking using asymmetric kernels with adaptive scale and orientation selection. Machine Vision and Applications 22, 255–268 (2011). https://doi.org/10.1007/s00138-009-0237-4
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00138-009-0237-4