Abstract
We introduce a novel technique for face recognition by using 3D face data that has been reconstructed from a stereo camera system. The face data consists of a dense 3D mesh of vertices describing the facial shape and geometry as well as a 2D texture map describing the facial appearance of each subject. We propose a recognition algorithm based on two steps: The first step involves the cleaning of the facial surface followed by a registration and normalization to a standard template face. The second step involves the creation of a PCA model and the use of a reduced dimensionality face space for the calculation of facial similarity. We use this technique on 3D surface and texture data comprising 83 subjects. Our results demonstrate the wealth of 3D information on the face as well as the importance of standardization and noise elimination in the datasets.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Baylis, G.C., Rollis, E.T., Leonard, C.M.: Selectivity between faces in the response of a population of neurons in the cortex in the superior suculus of the monkey. Brain Res. 342, 91–102 (1985)
Haxby, J.V., Hoffman, E.A., Gobbini, M.I.: The distributed human neural system for face perception. Trends Cognitive Science 4, 223–233 (2000)
Chellapa, R., Wilson, C.L., Sirohey, S.: Human and Machine recognition of faces: A survey. Proceedings of the IEEE 83(5) (1995)
Toole, A.J.O., Price, T., Vetter, T., Bartlett, J.C., Blanz, V.: 3D shape and 2D surface textures of human faces: the role of averages in attractiveness and age. Image and Vision Computing 18, 9–19 (1999)
Hwang, B., Lee, S.: Reconstruction of Partially Damaged Face Images Based on a Morphable Face Model. IEEE Transcactions on pattern analysis and machine intelligence 24(3), 365–372 (2003)
Hill, H., Johnston, A.: Categorizing sex and identity from the biological motion of faces. Current Biology 11, 880–885 (2001)
Turk, M.A., Pentland, A.P.: Face Recognition Using Eigenfaces. Journal of Cognitive Neuroscience 3(1) (1991)
Blanz, V., Vetter, T.: A Morphable Model for the synthesis of 3D faces. In: Computer Graphics Proceedings, Siggraph, Los Angeles, pp. 187–194 (1999)
Beumier, C., Acheroy, M.: Automatic 3D face authentication. Image and Vision Computing 18, 315–321 (2000)
Bronstein, A.M., Bronstein, M.M., Kimmel, R.: Expression-Invariant 3D Face Recognition. In: Kittler, J., Nixon, M.S. (eds.) AVBPA 2003. LNCS, vol. 2688, pp. 62–69. Springer, Heidelberg (2003)
Beumier, C., Acheroy, M.: Face verification from 3D and grey level clues. Pattern Recognition Letters 22, 1321–1329 (2001)
Tsalakanidou, F., Tzocaras, D., Strintzis, M.: Use of depth and colour eigenfaces for face recognition. Pattern Recognition Letters 24, 1427–1435 (2003)
Chang, K., Bowyer, K., Flynn, P.: Face recognition using 2D and 3D facial data. In: 2003 Multimodal User Authentication Workshop, pp. 25–32 (2003)
Bronstein, A., Bronstein, M., Kimmel, R.: Expression-invariant 3D face recognition. In: Kittler, J., Nixon, M.S. (eds.) AVBPA 2003. LNCS, vol. 2688, pp. 62–69. Springer, Heidelberg (2003)
Zigelman, G., Kimmel, R., Kiryati, N.: Texture mapping using surface flattening via multidimensional scaling. IEEE Transactions in Visualization and Computer Graphics 8, 198–207 (2002)
Grossman, R., Kiryati, N., Kimmel, R.: Computational surface flattening: a voxel-based approach. IEEE Transactions PAMI 24, 433–441 (2002)
Smith, N., Meir, I., Hale, G., Howe, R., Johnson, L., Edwards, P., Hawkes, D., Bidmead, M., Landau, D.: Real-Time 3D Surface Imaging for Patient Positioning in Radiotherapy, awaiting publication in the ASTRO, proceedings (2003)
Besl, P.J., McKay, N.D.: A Method for Registration of 3-D Shapes. IEEE Transactions on Pattern Analysis and Machine Intelligence 14(2), 239–256 (1992)
Lee, S., Wolberg, G., Shin, S.Y.: Scattered data interpolation with multilevel b-splines. IEEE Transactions on Visualization and Computer Graphics 3(3) (1997)
Blanz, V., Vetter, T.: Face recognition based on fitting a 3D Morphable Model. IEEE transactions on pattern analysis and machine intelligence 25(9) (2003)
Szeliski, R., Lavallee, S.: Matching 3D Anatomical Surfaces with Non-Rigid Deformations using Octree-Splines. In: IEEE Workshop on Biomed. Image Anal., June 1994, pp. 144–153 (1994)
Chang, K., Bowyer, K., Flynn, P.: Face recognition using 2D and 3D facial data. In: 2003 Multimodal User Authentication Workshop, pp. 25–32 (2003)
Costen, N.P., Cootes, T.F., Edwards, G.J., Taylor, C.J.: Automatic extraction of the face identity-subspace. Image and Vision Computing 20, 319–329 (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Papatheodorou, T., Rueckert, D. (2005). Evaluation of 3D Face Recognition Using Registration and PCA. In: Kanade, T., Jain, A., Ratha, N.K. (eds) Audio- and Video-Based Biometric Person Authentication. AVBPA 2005. Lecture Notes in Computer Science, vol 3546. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11527923_104
Download citation
DOI: https://doi.org/10.1007/11527923_104
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-27887-0
Online ISBN: 978-3-540-31638-1
eBook Packages: Computer ScienceComputer Science (R0)