Abstract
In registration-based motion tracking precise pose between a reference template and the current image is determined by warping image patches into the template coordinates and matching pixel-wise intensities. Efficient such algorithms are based on relating spatial and temporal derivatives using numerical optimization algorithms. We extend this approach from planar patches into a formulation where the 3D geometry of a scene is both estimated from uncalibrated video and used in the tracking of the same video sequence. Experimentally we compare convergence and accuracy of our uncalibrated 3D tracking to previous approaches. Notably, the 3D algorithm can successfully track over significantly larger pose changes than ones using only planar regions. It also detects occlusions and removes/inserts tracking regions as appropriate in response.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Lowe, D.: Fitting parameterized three-dimensional models to images. PAMI 13, 441–450 (1991)
Marchand, E., Bouthemy, P., Chaumette, F.: A 2d-3d model-based approach to real-time visual tracking. IVC 19, 941–955 (2001)
Drummond, T., Cipolla, R.: Real-time visual tracking of complex structures. PAMI 24, 932–946 (2002)
Armstrong, M., Zisserman, A.: Robust object tracking. In: Second Asian Conference on Computer Vision, pp. 58–62 (1995)
Toyama, K., Hager, G.: Incremental focus of attention for robust vision-based tracking. IJCV 35, 45–63 (1999)
Szeliski, R.: Video mosaics for virtual environments. IEEE Computer Graphics and Applications, 22–30 (1996)
Lucas, B., Kanade, T.: An iterative image registration technique with an application to stereo vision. In: Int. Joint Conf. on Artificial Intelligence (1981)
Hager, G., Belhumeur, P.: Efficient region tracking with parametric models of geometry and illumination. PAMI 20, 1025–1039 (1998)
Baker, S., Matthews, I.: Lucas-Kanade 20 Years On: A Unifying Framework. Technical Report CMU-RITR02-16 (2002)
Jurie, F., Dhome, M.: Hyperplane approximation for template matching. PAMI 24, 996–1000 (2002)
Gleicher, M.: Projective registration with difference decomposition. In: CVPR 1997, pp. 331–337 (1997)
Horn, B.: Computer Vision. MIT Press, Cambridge, Mass (1986)
Hartley, R.I., Zisserman, A.: Multiple View Geometry in Computer Vision. Cambridge University Press, Cambridge (2000)
Werner, T., Pajdla, T., Urban, M.: Practice of 3d reconstruction from multiple uncalibrated unorganized images. In: Czech Pattern Recognition Workshop (2000)
Triggs, W.: Auto-calibration and the absolute quadric. In: CVRP, pp. 609–614 (1997)
Cobzas, D., Jagersand, M.: A Comparison of Viewing Geometries for Augmented Reality. In: Bigun, J., Gustavsson, T. (eds.) SCIA 2003. LNCS, vol. 2749, pp. 501–508. Springer, Heidelberg (2003)
line mpeg movies of the experiments are available. See videoX at, http://www.cs.ualberta.ca/~dana/Movies
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Cobzas, D., Jagersand, M. (2006). 3D SSD Tracking from Uncalibrated Video. In: MacLean, W.J. (eds) Spatial Coherence for Visual Motion Analysis. SCVMA 2004. Lecture Notes in Computer Science, vol 3667. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11676959_3
Download citation
DOI: https://doi.org/10.1007/11676959_3
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-32533-8
Online ISBN: 978-3-540-32534-5
eBook Packages: Computer ScienceComputer Science (R0)