Abstract
In this work we present an appearance-based 3-D Face Recognition approach that is able to recognize faces in video sequences, independent from face pose. For this we combine eigen light-fields with probabilistic propagation over time for evidence integration. Eigen light-fields allow us to build an appearance based 3-D model of an object; probabilistic methods for evidence integration are attractive in this context as they allow a systematic handling of uncertainty and an elegant way for fusing temporal information. Experiments demonstrate the effectiveness of our approach. We tested this approach successfully on more than 20 testing sequences, with 74 different individuals.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
E.H. Adelson and J. Bergen. The plenoptic function and elements of early vision. In Landy and Movshon, editors, Computational Models of Visual Processing. MIT Press, 1991.
A. Doucet, S. Godsill, and C. Andrieu. On sequential monte carlo sampling methods for bayesian filtering. Statistics and Computing, 10:197–209, 2000.
S. Gortler, R. Grzeszczuk, R. Szeliski, and M. Cohen. The lumigraph. In SIG-GRAPH, 1996.
R. Gross, I. Matthews, and S. Baker. Eigen light-fields and face recognition across pose. In Proc. Int. Conf. on Automatic Face and Gesture Recognition, Washington, DC, USA, May 21–22, 2002.
Ralph Gross and Jianbo Shi. The cmu motion of body (mobo) database. Technical Report CMU-RI-TR-01-18, Robotics Institute, Carnegie Mellon University, Pittsburgh, PA, June 2001.
M. Isard and A. Blake. Condensation — conditional density propagation for visual tracking. Int. J. of Computer Vision, 1998.
G. Kitagawa. Monta carlo filter and smoother for non-gaussian nonlinear state space models. J. Computational and Graphical Statistics, 5:1–25, 1996.
V. Krueger and S. Zhou. Exemplar-based face recognition from video. In Proc. European Conf. on Computer Vision, Copenhagen, Denmark, June 27–31, 2002.
A. Leonardis and H. Bischof. Dealing with occlusions in the eigenspace approach. In Proceedings of CVPR, 1996.
M. Levoy and M. Hanrahan. Light field rendering. In Proc. of SIGGRAPH, 1996.
J.S. Liu and R. Chen. Sequential monte carlo for dynamic systems. Journal of the American Statistical Association, 93:1031–1041, 1998.
B. Moghaddam and A. Pentland. Probabilistic visual learning for object detection. IEEE Trans. Pattern Analysis and Machine Intelligence, 17:696–710, 1997.
H. Murase and S.K. Nayar. Visual learning and recognition of 3-D objects from appearance. Int. J. of Computer Vision, 14:5–24, 1995.
S.K. Nayar and S. Narasimhan. Vision in bad weather. In Korfu, Greece, 1999.
P. Phillips, H. Moon, S. Rizvi, and P. Rauss. The feret evaluation methodology for face-recognition algorithms. IEEE Trans. Pattern Analysis and Machine Intelligence, 22:1090–1103, 2000.
T. Sim, S. Baker, and M. Bsat. The CMU Pose, Illumination, and Expression (pie) database. In Proc. Int. Conf. on Automatic Face and Gesture Recognition, Washington, DC, USA, May 21–22, 2002.
T. Sim, S. Baker, and M. Bsat. The CMU pose, illumination, and expression (PIE) database. In Proc. of the 5th IEEE International Conference on Automatic Face and Gesture Recognition, 2002.
K. Toyama and A. Blake. Probabilistic tracking in a metric space. In Proc. Int. Conf. on Computer Vision, volume 2, pages 50–59, Vancouver, Canada, 9–12 July, 2001.
M. Turk and A. Pentland. Face recognition using eigenfaces. In Proc. of CVPR, 1991.
T. Vetter and T. Poggio. Linear object classes and image synthesis from a single example image. IEEE Trans. on PAMI, 19(7):733–741, 1997.
L. Wiskott, J. M. Fellous, N. Krüger, and C. v. d. Malsburg. Face recognition and gender determination. In Proc. Int. Workshop on Automatic Face and Gesture Recognition, Zurich, Switzerland, June 26–28, 1995.
W. Zhao, R. Chellappa, and N. Nandhakumar. Discriminant analysis fo principal components for face recognition. In Nara, Japan, April 14–16, pages 336–341, 1998.
S. Zhou, V. Krüger, and R. Chellappa. Face recognition from video: A CONDENSATION approach. In Proc. Int. Conf. on Automatic Face and Gesture Recognition, Washington, DC, USA, May 21–22, 2002.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Krüger, V., Gross, R., Baker, S. (2002). Appearance-Based 3-D Face Recognition from Video. In: Van Gool, L. (eds) Pattern Recognition. DAGM 2002. Lecture Notes in Computer Science, vol 2449. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45783-6_68
Download citation
DOI: https://doi.org/10.1007/3-540-45783-6_68
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-44209-7
Online ISBN: 978-3-540-45783-1
eBook Packages: Springer Book Archive