Abstract
Estimating geometric structure from uncalibrated images accurately enough for high quality rendering is difficult. We present a method where only coarse geometric structure is tracked and estimated from a moving camera. Instead a precise model of the intensity image variation is obtained by overlaying a dynamic, time varying texture on the structure. This captures small scale variations (e.g. non-planarity of the rendered surfaces, small camera geometry distortions and tracking errors). The dynamic texture is estimated and coded much like in movie compression, but parameterized in 6D pose instead of time, hence allowing the interpolation and extrapolation of new poses in the rendering and animation phase. We show experiments tracking and re-animating natural scenes as well as evaluating the geometric and image intensity accuracy on constructed special test scenes.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
M. Black, D. Fleet, and Y. Yacoob. Robustly estimating changes in image appearance. Computer Vision and Image Understanding, 78(1):8–31, 2000.
M. Black, Y. Yacoob, A. Jepson, and D. Fleet. Learning parameterized models of image motion. In Computer Vision and Pattern Recognition, pages 561–567, 1997.
D. Cobzas and M. Jagersand. A comparison of non-euclidean image-based rendering. In Proceedings of Graphics Interface, 2001.
P. E. Debevec, C. J. Taylor, and J. Malik. Modeling and rendering architecture from phtographs. In Computer Graphics (SIGGRAPH’96), 1996.
O. D. Faugeras. Three Dimensional Computer Vision: A Geometric Viewpoint. MIT Press, Boston, 1993.
S. J. Gortler, R. Grzeszczuk, and R. Szeliski. The lumigraph. In Computer Graphics (SIGGRAPH’96), pages 43–54, 1996.
G. D. Hager and P. N. Belhumeur. Efficient region tracking with parametric models of geometry and illumination. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(10):1025–1039, 1998.
M. Jagersand. Saliency maps and attention selection in scale and spatial coordinates: An information theoretic approach. In Fifth International Conference on Computer Vision, 1995.
M. Jagersand. Image based view synthesis of articulated agents. In Computer Vision and Pattern Recognition, 1997.
K. Kutulakos and S. Seitz. A theory of shape by shape carving. International Journal of Computer Vision, 38:197–216, 2000.
M. Levoy and P. Hanrahan. Light field rendering. In Computer Graphics (SIGGRAPH’96), pages 31–42, 1996.
L. McMillan and G. Bishop. Plenoptic modeling: Am image-based rendering system. In Computer Graphics (SIGGRAPH’95), pages 39–46, 1995.
H. Murase and S. Nayar. Visual learning and recognition of 3d objects from appearance. International Journal of Computer Vision, 14:5–24, 1995.
M. Pollyfeys. Tutorial on 3D Modeling from Images. Lecture Nores, Dublin, Ireland (in conjunction with ECCV 2000), 2000.
W. H. Press, B. Flannery, S. A. Teukolsky, and W. T. V. Tterling. Numerical Recipies in C: The Art of Scientific Computing. Cambridge University Press, Cambridge, England, 1992.
S. M. Seitz and C. R. Dyer. View morphing. In Computer Graphics (SIGGRAPH’96), pages 21–30, 1996.
A. Shashua. Geometry and Photometry in 3D Visual Recognition. PhD thesis, MIT, 1993.
I. Stamos and P. K. Allen. Integration of range and image sensing for photorealistic 3d modeling. In ICRA, 2000.
P. Sturm and B. Triggs. A factorization based algorithm for multi-image projective structure and motion. In ECCV(2), pages 709–720, 1996.
R. Szeliski. Video mosaics for virtual environments. IEEE Computer Graphics and Applications, pages 22–30, March 1996.
C. Tomasi and T. Kanade. Shape and motion from image streams under orthography: A factorization method. International Journal of Computer Vision, 9:137–154, 1992.
D. Weinshall and C. Tomasi. Linear and incremental aquisition of invariant shape models from image sequences. In Proc. of 4th Int. Conf. on Compute Vision, pages 675–682, 1993.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Cobzas, D., Jagersand, M. (2002). Tracking and Rendering Using Dynamic Textures on Geometric Structure from Motion. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds) Computer Vision — ECCV 2002. ECCV 2002. Lecture Notes in Computer Science, vol 2351. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-47967-8_28
Download citation
DOI: https://doi.org/10.1007/3-540-47967-8_28
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-43744-4
Online ISBN: 978-3-540-47967-3
eBook Packages: Springer Book Archive