skip to main content
10.1145/3330482.3330501acmotherconferencesArticle/Chapter ViewAbstractPublication PagesiccaiConference Proceedingsconference-collections
research-article

Robust Face Recognition with Assistance of Pose and Expression Normalized Albedo Images

Published: 19 April 2019 Publication History

Abstract

Facial albedo images are believed to be invariant to external factors of pose, illumination and expression that can greatly affect the appearance of face images and thus face recognition accuracy as well. Unlike most existing face recognition methods that address the impact of one or two of these external factors, we propose an end-to-end network, which consists of De-Light Network (DL-Net) and Normalization Network (N-Net), to generate normalized albedo images with neutral expression and frontal pose for input face images. DL-Net aims to eliminate the effects of illumination and reconstruct a posed albedo image that has the same pose and expression as the input image. N-Net attempts to generate a pose and expression normalized albedo image and extract identity features under the supervision of the normalized albedo images. Our experiments on the Multi-PIE database show that the extracted identity features can effectively assist conventional face recognition methods to improve face recognition accuracy under varying poses, illuminations and expressions.

References

[1]
Sun, Y., Chen, Y., Wang, X., & Tang, X. (2014). Deep learning face representation by joint identification-verification. In Advances in neural information processing systems (pp. 1988--1996).
[2]
Taigman, Y., Yang, M., Ranzato, M. A., & Wolf, L. (2014). Deepface: Closing the gap to human-level performance in face verification. In Computer Vision and Pattern Recognition (pp. 1701--1708).
[3]
Cao, Q., Shen, L., Xie, W., Parkhi, O. M., & Zisserman, A. (2018). Vggface2: A dataset for recognizing faces across pose and age. In Automatic Face & Gesture Recognition (FG) (pp. 67--74).
[4]
Guo, Y., Zhang, L., Hu, Y., He, X., & Gao, J. (2016). Ms-celeb-1m: A dataset and benchmark for large-scale face recognition. In European Conference on Computer Vision (pp. 87--102).
[5]
Blanz, V., & Vetter, T. (2003). Face recognition based on fitting a 3D morphable model. IEEE Transactions on pattern analysis and machine intelligence, 25(9), 1063--1074.
[6]
Blanz, V., Romdhani, S., & Vetter, T. (2002). Face identification across different poses and illuminations with a 3d morphable model. In Automatic Face and Gesture Recognition (FG) (pp. 202--207).
[7]
Blanz, V., & Vetter, T. (1999). A morphable model for the synthesis of 3D faces. In Computer graphics and interactive techniques (pp. 187--194).
[8]
Aldrian, O., & Smith, W. A. (2012). Inverse rendering of faces with a 3D morphable model. IEEE Transactions on pattern analysis and machine intelligence, 1080--1093.
[9]
Tewari, A., Zollhöfer, M., Kim, H., Garrido, P., Bernard, F., Pérez, P., & Theobalt, C. (2017). Mofa: Model-based deep convolutional face autoencoder for unsupervised monocular reconstruction. In The IEEE International Conference on Computer Vision (Vol. 2, No. 3, p. 5).
[10]
Kim, H., Zollhöfer, M., Tewari, A., Thies, J., Richardt, C., & Theobalt, C. (2018). InverseFaceNet: Deep Single-Shot Inverse Face Rendering From A Single Image. In Computer Vision and Pattern Recognition.
[11]
S Sengupta, S., Kanazawa, A., Castillo, C.D., & Jacobs, D.W. (2018). SfSNet: Learning Shape, Reflectance and Illuminance of Faces 'in the Wild'. In Computer Vision and Pattern Recognition.
[12]
Tran, A. T., Hassner, T., Masi, I., & Medioni, G. (2017). Regressing robust and discriminative 3D morphable models with a very deep neural network. In Computer Vision and Pattern Recognition (pp. 1493--1502).
[13]
Ramamoorthi, R., & Hanrahan, P. (2001). A signal-processing framework for inverse rendering. In Proceedings of the conference on Computer graphics and interactive techniques (pp. 117--128).
[14]
Zhu, X., Lei, Z., Yan, J., Yi, D., & Li, S. Z. (2015). High-fidelity pose and expression normalization for face recognition in the wild. In Computer Vision and Pattern Recognition (pp. 787--796).
[15]
Wu, X., He, R., & Sun, Z. (2015). A lightened cnn for deep face representation. In Computer Vision and Pattern Recognition (Vol. 4, p. 5).
[16]
Zhang, T., Fang, B., Yuan, Y., Tang, Y. Y., Shang, Z., Li, D., & Lang, F. (2009). Multiscale facial structure representation for face recognition under varying illumination. In Pattern Recognition, 42(2), 251--258.
[17]
Hu, Y., Wu, X., Yu, B., He, R., & Sun, Z. (2018). Pose-guided photorealistic face rotation. In Computer Vision and Pattern Recognition.
[18]
Wang, B., Li, W., Yang, W., & Liao, Q. (2011). Illumination normalization based on Weber's law with application to face recognition. In IEEE Signal Processing Letters, 18(8), 462--465.
[19]
Biswas, S., Aggarwal, G., & Chellappa, R. (2009). Robust estimation of albedo for illumination-invariant matching and shape recovery. IEEE Transactions on Pattern Analysis and Machine Intelligence, 884--899.
[20]
Biswas, S., & Chellappa, R. (2010, June). Pose-robust albedo estimation from a single image. In Computer Vision and Pattern Recognition (pp. 2683--2690).
[21]
Ronneberger, O., Fischer, P., & Brox, T. (2015). U-Net: Convolutional Networks for Biomedical Image Segmentation. In International Conference on Medical Image Computing & Computer-assisted Intervention.
[22]
Ahonen, T., Hadid, A., & Pietikinen, M. (2006). Face description with local binary patterns: application to face recognition. IEEE Transactions on Pattern Analysis & Machine Intelligence, 28(12), 2037--2041.
[23]
Dalal, N., & Triggs, B. (2005). Histograms of oriented gradients for human detection. In Computer Vision and Pattern Recognition (pp. 886--893).
[24]
Chen, D., Cao, X., Wen, F., & Sun, J. (2013). Blessing of dimensionality: High-dimensional feature and its efficient compression for face verification. In Computer Vision and Pattern Recognition (pp. 3025--3032).
[25]
Weinberger, K. Q., & Saul, L. K. (2009). Distance metric learning for large margin nearest neighbor classification. In Journal of Machine Learning Research (pp. 207--244).
[26]
Tran, L., Yin, X., & Liu, X. (2017). Disentangled representation learning gan for pose-invariant face recognition. In Computer Vision and Pattern Recognition (Vol. 3, No. 6, p. 7).
[27]
Huang, R., Zhang, S., Li, T., & He, R. (2017). Beyond Face Rotation: Global and Local Perception GAN for Photorealistic and Identity Preserving Frontal View Synthesis. In IEEE International Conference on Computer Vision, 2458--2467.
[28]
Hu, L., Kan, M., Shan, S., Song, X., & Chen, X. (2017). LDF-Net: Learning a displacement field network for face recognition across pose. In Automatic Face & Gesture Recognition (pp. 9--16).
[29]
Zhao, J., Cheng, Y., Xu, Y., Xiong, L., Li, J., Zhao, F., et al. (2018). Towards Pose Invariant Face Recognition in the Wild. In Computer Vision and Pattern Recognition (pp. 2207--2216).
[30]
Gross, R., Matthews, I., Cohn, J., Kanade, T., & Baker, S. (2007). The CMU multi-pose, illumination, and expression (Multi-PIE) face database. Robotics Inst., Carnegie Mellon Univ., Pittsburgh, PA, USA, Tech. Rep. TR-07-08.
[31]
Liang, J., Liu, F., Tu, H., Zhao, Q., & Jain, A. K. (2018). On Mugshot-based Arbitrary View Face Recognition. In International Conference on Pattern Recognition (pp. 3126--3131).
[32]
El Shafey, L., McCool, C., Wallace, R., & Marcel, S. (2013). A scalable formulation of probabilistic linear discriminant analysis: Applied to face recognition. IEEE transactions on pattern analysis and machine intelligence, 35(7), 1788--1794

Cited By

View all
  • (2023)Smart Home Security System Using Facial RecognitionProceedings of Third International Conference on Sustainable Expert Systems10.1007/978-981-19-7874-6_18(239-252)Online publication date: 23-Feb-2023
  • (2022)Automated Attendance System based on Facial Recognition using Adaboost Algorithm2022 International Conference on Power, Energy, Control and Transmission Systems (ICPECTS)10.1109/ICPECTS56089.2022.10046982(1-7)Online publication date: 8-Dec-2022
  • (2021)Analysis and Implementation of Optimization Techniques for Facial RecognitionApplied Computational Intelligence and Soft Computing10.1155/2021/66725782021Online publication date: 1-Jan-2021
  • Show More Cited By

Index Terms

  1. Robust Face Recognition with Assistance of Pose and Expression Normalized Albedo Images

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    ICCAI '19: Proceedings of the 2019 5th International Conference on Computing and Artificial Intelligence
    April 2019
    267 pages
    ISBN:9781450361064
    DOI:10.1145/3330482
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 19 April 2019

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Albedo image
    2. face recognition
    3. normalization

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    ICCAI '19

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)8
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 17 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2023)Smart Home Security System Using Facial RecognitionProceedings of Third International Conference on Sustainable Expert Systems10.1007/978-981-19-7874-6_18(239-252)Online publication date: 23-Feb-2023
    • (2022)Automated Attendance System based on Facial Recognition using Adaboost Algorithm2022 International Conference on Power, Energy, Control and Transmission Systems (ICPECTS)10.1109/ICPECTS56089.2022.10046982(1-7)Online publication date: 8-Dec-2022
    • (2021)Analysis and Implementation of Optimization Techniques for Facial RecognitionApplied Computational Intelligence and Soft Computing10.1155/2021/66725782021Online publication date: 1-Jan-2021
    • (2020)Improved Single Sample Per Person Face Recognition via Enriching Intra-Variation and Invariant FeaturesApplied Sciences10.3390/app1002060110:2(601)Online publication date: 14-Jan-2020
    • (2020)A Review of Face Recognition TechnologyIEEE Access10.1109/ACCESS.2020.30110288(139110-139120)Online publication date: 2020

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media