Abstract
In principle, the recovery and reconstruction of a 3D object from its 2D view projections require the parameterisation of its shape structure and surface reflectance properties. Explicit representation and recovery of such 3D information is notoriously difficult to achieve. Alternatively, a linear combination of 2D views can be used which requires the establishment of dense correspondence between views. This in general, is difficult to compute and necessarily expensive. In this paper we examine the use of affine and local feature-based transformations in establishing correspondences between very large pose variations. In doing so, we utilise a generic-view template, a generic 3D surface model and Kernel PCA for modelling shape and texture nonlinearities across views. The abilities of both approaches to reconstruct and recover faces from any 2D image are evaluated and compared.
Chapter PDF
Similar content being viewed by others
Keywords
- Appearance Model
- Kernel Principal Component Analysis
- Landmark Point
- Active Appearance Model
- Active Shape Model
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
J. J. Atick, P. A. Griffin, and A. N. Redlich. Statistical approach to shape from shading: Reconstruction of three-dimensional face surfaces from single two-dimensional images. Neural Computation, 8(6):1321–1340, 1996.
D. Beymer. Feature correspondence by interleaving shape and texture computations. In cvpr, pages 921–928, 1996.
D. J. Beymer and T. Poggio. Image representations for visual learning. Science, 272:1905–1909, 28 June 1996.
T.F. Cootes, G.J. Edwards, and C.J. Taylor. Active appearance models. In ECCV98, pages 484–498, 1998.
T.F. Cootes and C.J. Taylor. A mixture model for representing shape variation. Image and Vision Computing, 17:567–573, 1999.
F. de la Torre, S. Gong, and S. J. McKenna. View-based adaptive affine tracking. In ECCV, pages 828–842, Freiburg, Germany, June 1998.
S. Gong, E. J. Ong, and S. McKenna. Learning to associate faces across views in vector space of similarities to prototypes. In BMVC, pages 54–63, 1998.
S. Mika, B. Schölkopf, A. Smola, G. Ratsch, K. Müller, M. Scholz, and G. Rätsch. Kernel pca and de-noising in feature spaces. In NIPSS, 1998.
A. Pentland, B. Moghaddam, and T. Starner. View-based and modular eigenspaces for face recognition. In CVPR, pages 84–91, Seattle, July 1994.
S. Romdhani, S. Gong, and A. Psarrou. Multi-view nonlinear active shape model using kernel pca. In BMVC, pages 483–492, September 1999.
S. Romdhani, A. Psarrou, and S. Gong. Learning a single active shape model for faces across views. In IEEE International Workshop on Real Time Face and Gesture Recognition, pages 31–38, September 1999.
B. Schölkopf, S. Mika, A. Smola, G. Rätsch, and K. Müller. Kernel pca pattern reconstruction via approximate pre-images. In ICANN. Springer Verlag, 1998.
B. Schölkopf, A. Smola, and K. Müller. Nonlinear component analysis as a kernel eigenvalue problem. Neural Computation, 10(5):1299–1319, 1998.
A. Shashua. Geometry and Photometry in 3D Visual Recognition. PhD thesis, MIT, AI Lab., 1992.
A. Shashua. Algebraic functions for recognition. A. I. Memo 1452 (C.B.C.L. Paper 90), MIT, January 1994.
M. Turk and A. Pentland. Eigenfaces for recognition. Journal of Cognitive Neuroscience, 3(1):71–86, 1991.
S. Ullman and R. Basri. Recognition by linear combinations of models. IEEE PAMI, 13(10):992–1006, October 1991.
V. Vapnik. The nature of statistical learning theory. Springer Verlag, 1995.
T. Vetter and T. Poggio. Linear object classes and image synthesis from a single example image. Technical Report 16, Max Planck Inst. fur Bio. Kybernetik, 1995.
Author information
Authors and Affiliations
Rights and permissions
Copyright information
© 2000 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Romdhani, S., Psarrou, A., Gong, S. (2000). On Utilising Template and Feature-based Correspondence in Multi-view Appearance Models. In: Computer Vision - ECCV 2000. ECCV 2000. Lecture Notes in Computer Science, vol 1842. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45054-8_52
Download citation
DOI: https://doi.org/10.1007/3-540-45054-8_52
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-67685-0
Online ISBN: 978-3-540-45054-2
eBook Packages: Springer Book Archive