Abstract
This paper discusses methods behind tracker evaluation, the aim being to evaluate how well a tracker is able to determine the position of a target object. Few metrics exist for positional tracker evaluation; here the fundamental issues of trajectory comparison are addressed, and metrics are presented which allow the key features to be described. Often little evaluation on how precisely a target is tracked is presented in the literature, with results detailing for what percentage of the time the target was tracked. This issue is now emerging as a key aspect of tracker performance evaluation.
The metrics developed are applied to real trajectories for positional tracker evaluation. Data obtained from a sports player tracker on video of a 5-a-side soccer game, and from a vehicle tracker, is analysed. These give quantitative positional evaluation of the performance of computer vision tracking systems, and provides a framework for comparison of different methods and systems on benchmark data sets.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
T. J. Ellis. Performance metrics and methods for tracking in surveillance. In 3rd IEEE Workshop on Performance Evaluation of Tracking and Surveillance, Copenhagen, Denmark, 2002.
M. Harville. Stereo person tracking with adaptive plan-view statistical templates. In Proc. ECCV Workshop on Statistical Methods in Video Processing, pages 67–72, Copenhagen, Denmark, 2002.
D. R. Magee. Tracking multiple vehicles using foreground, background and motion models. In Proc. ECCV Workshop on Statistical Methods in Video Processing, pages 7–12, Copenhagen, Denmark, 2002.
C. J. Needham and R. D. Boyle. Tracking multiple sports players through occlusion, congestion and scale. In Proc. British Machine Vision Conference, pages 93–102, Manchester, UK, 2001.
IEEE Workshop on Performance Evaluation of Tracking and Surveillance. http://visualsurveillance.org/PETS2000 Last accessed: 18/10/02.
H. Sakoe and S. Chiba. Dynamic Programming optimization for spoken word recognition. IEEE Trans. Acoustics, Speech and Signal Processing, 26(1):43–49, 1978.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Needham, C.J., Boyle, R.D. (2003). Performance Evaluation Metrics and Statistics for Positional Tracker Evaluation. In: Crowley, J.L., Piater, J.H., Vincze, M., Paletta, L. (eds) Computer Vision Systems. ICVS 2003. Lecture Notes in Computer Science, vol 2626. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-36592-3_27
Download citation
DOI: https://doi.org/10.1007/3-540-36592-3_27
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-00921-4
Online ISBN: 978-3-540-36592-1
eBook Packages: Springer Book Archive