Abstract
We present a novel iterative approach for recovering 3D shape and albedo from face images affected by non-uniform lighting and non-frontal pose. We fit a 3D active appearance model based on illumination, to a novel face image. In contrast to other works where an initial pose is required, we only need a simple initialization in translation and scale. Our optimization method improves the Jacobian each iteration by using the parameters of lighting estimated in previous iterations. Our fitting algorithm obtains a compact set of parameters of albedo, 3D shape, 3D pose and illumination which describe the appearance of the input image. We show that our method is able to accurately estimate the parameters of 3D shape and albedo, which are strongly related to identity. Experimental results show that our proposed approach can be easily extended to face recognition under non-uniform illumination and pose variations.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Ayala-Raggi, S., Altamirano-Robles, L., Cruz-Enriquez, J.: Towards an Illumination-Based 3D Active Appearance Model for Fast Face Alignment. In: Ruiz-Shulcloper, J., Kropatsch, W.G. (eds.) CIARP 2008. LNCS, vol. 5197, pp. 568–575. Springer, Heidelberg (2008)
Baker, S., Matthews, I.: Equivalence and Efficiency of Image Alignment Algorithms. In: CVPR 2001, pp. 1090–1097 (2001)
Buenaposada, J.M., Muñoz, E., Baumela, L.: Efficient Illumination Independent Appearance-Based Face Tracking. Image and Vision Computing 27, 560–578 (2009)
Blanz, V., Vetter, T.: A Morphable Model for the Synthesis of 3D Faces. In: Siggraph 1999, pp. 187–194 (1999)
Blanz, V., Vetter, T.: Face Recognition Based on Fitting a 3D Morphable Model. IEEE Transactions on Pattern Analysis and Machine Intelligence 25, 1063–1074 (2003)
Romdhani, S., Blanz, V., Vetter, T.: Face Identification by Fitting a 3D Morphable Model Using Linear Shape and Texture Error Functions. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002. LNCS, vol. 2353, pp. 3–19. Springer, Heidelberg (2002)
Romdhani, S., Pierrard, J.S., Vetter, T.: 3D Morphable Face Model, a Unified Approach for Analysis and Synthesis of Images. In: Face Processing: Advanced Modeling and Methods, Elsevier, Amsterdam (2005)
Romdhani, S., Ho, J., Vetter, T., Kriegman, D.J.: Face Recognition Using 3-D Models: Pose and Illumination. Proceedings of the IEEE 94, 1977–1999 (2006)
Cootes, T.F., Edwards, G.J., Taylor, C.J.: Active Appearance Models. IEEE Transactions on Pattern Analysis and Machine Intelligence 23, 681–685 (2001)
Xiao, J., Baker, S., Matthews, I., Kanade, T.: Real-Time Combined 2D+3D Active Appearance Models. In: CVPR 2004, vol. 2, pp. 535–542 (2004)
Matthews, I., Baker, S.: Active Appearance Models Revisited. International Journal on Computer Vision 60, 135–164 (2004)
Huang, Y., Lin, S., Li, S.Z., Lu, H., Shum, H.Y.: Face Alignment Under Variable Illumination. In: Proceedings of the FGR 2004, pp. 85–90 (2004)
Le Gallou, S., Breton, G., García, C., Séguier, R.: Distance Maps: A Robust Illumination Preprocessing for Active Appearance Models. In: VISAPP 2006, vol. 2, pp. 35–40 (2006)
Kahraman, F., Gökmen, M., Darkner, S., Larsen, R.: An Active Illumination and Appearance (AIA) Model for Face Alignment. In: CVPR (2007)
Dornaika, F., Ahlberg, J.: Fast And Reliable Active Appearance Model Search For 3d Face Tracking. In: Proceedings of Mirage 2003, pp. 10–11. INRIA Rocquencourt, France (2003)
Sattar, A., Aidarous, Y., Le Gallou, S., Séguier, R.: Face Alignment by 2.5D Active Appearance Model Optimized by Simplex. In: ICVS 2007, Bielefeld University, Germany (2007)
Basri, R., Jacobs, D.W.: Lambertian Reflectance and Linear Subspaces. IEEE Transactions on Pattern Analysis and Machine Intelligence 25, 218–233 (2003)
Lee, K.C., Ho, J., Kriegman, D.J.: Nine Points of Light: Acquiring Subspaces for Face Recognition under Variable Lighting. In: CVPR 2001, pp. 519–526 (2001)
Belhumeur, P., Kriegman, D.: What is the Set of Images of an Object Under all Possible Illumination Conditions. Int. J. Computer Vision 28, 245–260 (1998)
Georghiades, A.S., Belhumeur, P.N., Kriegman, D.J.: From Few to Many: Illumination Cone Models for Face Recognition Under Variable Lighting and Pose. IEEE Transactions on Pattern Analysis and Machine Intelligence 23, 643–660 (2001)
Ramamoorthi, R., Hanrahan, P.: An Efficient Representation for Irradiance Environment Maps. In: Proc. ACM SIGGRAPH, pp. 497–500 (2001)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Ayala-Raggi, S.E., Altamirano-Robles, L., Cruz-Enriquez, J. (2009). Recovering 3D Shape and Albedo from a Face Image under Arbitrary Lighting and Pose by Using a 3D Illumination-Based AAM Model. In: Kamel, M., Campilho, A. (eds) Image Analysis and Recognition. ICIAR 2009. Lecture Notes in Computer Science, vol 5627. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-02611-9_58
Download citation
DOI: https://doi.org/10.1007/978-3-642-02611-9_58
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-02610-2
Online ISBN: 978-3-642-02611-9
eBook Packages: Computer ScienceComputer Science (R0)