Abstract
3D2D face recognition is beginning to gain attention from the research community. It takes advantage of 3D facial geometry to normalize the head pose and registers it into a canonical 2D space. In this paper, we present a novel illumination normalization approach for 3D2D face recognition which does not require any training or prior knowledge on the type, number, and direction of the lighting sources. Estimated using an image-specific filtering technique in the frequency domain, a self-lighting ratio is employed to suppress illumination differences. Experimental results on the UHDB11 and FRGC databases indicate that the proposed approach improves the performance significantly for face images with large illumination variations.
Chapter PDF
References
Bowyer, K., Chang, K., Flynn, P.: A survey of approaches and challenges in 3D and multi-modal 3D+2D face recognition. Computer Vision and Image Understanding 101, 1–15 (2006)
Zhou, Z., Ganesh, A., Wright, J., Tsai, S.F., Ma, Y.: Nearest-subspace patch matching for face recognition under varying pose and illumination. In: Proc. 8th IEEE International Conference on Automatic Face Gesture Recognition, Amsterdam, The Netherlands, pp. 1–8 (2008)
Toderici, G., Passalis, G., Zafeiriou, S., Tzimiropoulos, G., Petrou, M., Theoharis, T., Kakadiaris, I.: Bidirectional relighting for 3D-aided 2D face recognition. In: Proc. IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Francisco, CA, pp. 2721–2728 (2010)
Al-Osaimi, F.R., Bennamoun, M., Mian, A.S.: Illumination normalization of facial images by reversing the process of image formation. Machine Vision and Applications 22, 899–911 (2011)
Shim, H., Luo, J., Chen, T.: A subspace model-based approach to face relighting under unknown lighting and poses. IEEE Transactions on Image Processing 17, 1331–1341 (2008)
Kumar, R., Jones, M., Marks, T.: Morphable reflectance fields for enhancing face recognition. In: IEEE Conference on Proc. Computer Vision and Pattern Recognition (CVPR), pp. 2606–2613 (2010)
Wang, Y., Zhang, L., Liu, Z., Hua, G., Wen, Z., Zhang, Z., Samaras, D.: Face relighting from a single image under arbitrary unknown lighting conditions. IEEE Transactions on Pattern Analysis and Machine Intelligence 31, 1968–1984 (2009)
Han, H., Shan, S., Chen, X., Gao, W.: Illumination transfer using homomorphic wavelet filtering and its application to light-insensitive face recognition. In: Proc. IEEE International Conference on Automatic Face and Gesture Recognition, Amsterdam (2008)
Chen, J., Su, G., He, J., Ben, S.: Face Image Relighting using Locally Constrained Global Optimization. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010, Part IV. LNCS, vol. 6314, pp. 44–57. Springer, Heidelberg (2010)
Chen, X., Chen, M., Jin, X., Zhao, Q.: Face illumination transfer through edge-preserving filters. In: Proc. IEEE Conference on Computer Vision and Pattern Recognition, Colorado Springs CA (2011)
Biswas, S., Aggarwal, G., Chellappa, R.: Robust estimation of albedo for illumination-invariant matching and shape recovery. IEEE Transactions on Pattern Analysis and Machine Intelligence 31, 884–899 (2009)
Zou, X., Kittler, J., Hamouz, M., Tena, J.: Robust albedo estimation from face image under unknown illumination. In: Proc. SPIE Biometric Technology for Human Identification, Orlando, FL, p. 69440A (2008)
Suh, S., Lee, M., Choi, C.H.: Robust albedo estimation from a facial image with cast shadow. In: Proc. 18th IEEE International Conference on Image Processing, Brussels, Belguim, pp. 873–876 (2011)
Vural, S., Mae, Y., Uvet, H., Arai, T.: Illumination normalization for outdoor face recognition by using ayofa-filters. Journal of Pattern Recognition Research 6, 1–18 (2011)
Zhang, L., Samaras, D.: Face recognition from a single training image under arbitrary unknown lighting using spherical harmonics. IEEE Transactions on Pattern Analysis and Machine Intelligence 28, 351–363 (2006)
Blanz, V., Vetter, T.: Face recognition based on fitting a 3D morphable model. IEEE Transactions on Pattern Analysis and Machine Intelligence 25, 1063–1074 (2003)
Shashua, A., Riklin-Raviv, T.: The quotient image: class-based re-rendering and recognition with varying illuminations. IEEE Transactions on Pattern Analysis and Machine Intelligence 23, 129–139 (2001)
Wang, H., Li, S., Wang, Y., Zhang, J.: Self quotient image for face recognition. In: Proc. IEEE International Conference on Image Processing, vol. 2, pp. 1397–1400 (2004)
Kakadiaris, I., Passalis, G., Toderici, G., Murtuza, M.N., Lu, Y., Karampatziakis, N., Theoharis, T.: Three-dimensional face recognition in the presence of facial expressions: An annotated deformable model approach. IEEE Transactions on Pattern Analysis and Machine Intelligence 29, 640–649 (2007)
Basri, R., Jacobs, D.: Lambertian reflectance and linear subspaces. IEEE Transactions on Pattern Analysis and Machine Intelligence 25, 218–233 (2003)
Nelder, J.A., Mead, R.: A simplex method for function minimization. Computer Journal 7, 308–313 (1965)
UH Computational Biomedicine Lab: UHDB11 face database (2009), http://cbl.uh.edu/URxD/datasets/
Phillips, P., Flynn, P., Scruggs, T., Bowyer, K., Chang, J., Hoffman, K., Marques, J., Min, J., Worek, W.: Overview of the face recognition grand challenge. In: Proc. IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Diego, CA, vol. 1, pp. 947–954 (2005)
Phillips, P.J., Scruggs, W.T., O’Toole, A.J., Flynn, P.J., Bowyer, K.W., Schott, C.L., Sharpe, M.: FRVT 2006 and ICE 2006 Large-Scale Experimental Results. IEEE Transactions on Pattern Analysis and Machine Intelligence 32, 831–846 (2010)
Biswas, S., Chellappa, R.: Pose-robust albedo estimation from a single image. In: Proc. IEEE Conference on Computer Vision and Pattern Recognition, San Francisco, CA, pp. 2683–2690 (2010)
Pittsburgh Pattern Recognition: PittPatt face tracking & recognition Software Development Kit 5.1 (2011)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zhao, X., Shah, S.K., Kakadiaris, I.A. (2012). Illumination Normalization Using Self-lighting Ratios for 3D2D Face Recognition. In: Fusiello, A., Murino, V., Cucchiara, R. (eds) Computer Vision – ECCV 2012. Workshops and Demonstrations. ECCV 2012. Lecture Notes in Computer Science, vol 7584. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-33868-7_22
Download citation
DOI: https://doi.org/10.1007/978-3-642-33868-7_22
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-33867-0
Online ISBN: 978-3-642-33868-7
eBook Packages: Computer ScienceComputer Science (R0)