Skip to main content
Springer Nature Link
Log in

Deep Learning Models for Face Recognition: A Comparative Analysis

  • Chapter
  • First Online:
Deep Biometrics

Part of the book series: Unsupervised and Semi-Supervised Learning ((UNSESUL))

  • 1383 Accesses

Abstract

Deep learning networks have established themselves as a promising model for face recognition. Their success is attributed towards multiple processing layers in order to learn data representations with several feature extraction levels. Convolutional neural networks have been present as the deep learning tool in almost all face recognition systems. The significant breakthrough made by DeepIDs, DeepFace, Face++, FaceNet, and Baidu has changed the entire investigation scope. The deep face recognition techniques leverage hierarchical architecture in order to learn discriminative face representation. It has improved the system’s performance appreciably which has led to the growth of several successful applications. In this chapter, comparative analysis for important deep learning models towards face recognition is presented. A multi-stage strategy is used in order to prepare the experimental datasets. These datasets are developed from readily available web knowledge sources. The datasets are used for model training as well as evaluation. The experimental results are presented considering their comparative analysis against benchmark datasets. Several deep face recognition issues and other open questions in deep face recognition are also discussed with directions towards future research.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. M. Wang, W. Deng, Deep face recognition: a survey, arXiv:1804.06655v7 (2018)

    Google Scholar 

  2. K. Grm, V. Štruc, A. Artiges, M. Caron, H.K. Ekenel, Strengths and weaknesses of deep learning models for face recognition against image degradations, arXiv:1710.01494v1 (2017)

    Google Scholar 

  3. A. Chaudhuri, Some Investigations on Deep Face Recognition Using Artificially Created Datasets, Technical Report TH-1696 (Samsung R & D Institute Delhi, Noida, 2016)

    Google Scholar 

  4. O.M. Parkhi, A. Vedaldi, A. Zisserman, Deep face recognition, in Proceedings of British Machine Vision Conference, ed. by X. Xie, M. W. Jones, G. K. L. Tam, (BMVA Press, Surrey, 2015), pp. 41.1–41.12

    Google Scholar 

  5. K. Chatfield, K. Simonyan, A. Vedaldi, A. Zisserman, Return of the devil in the details: delving deep into convolutional nets. arXiv:1405.3531 (2014)

    Google Scholar 

  6. G. Hu, Y. Yang, D. Yi, J. Kittler, W. Christmas, S.Z. Li, T. Hospedales, When face recognition meets with deep learning: an evaluation of convolutional neural networks for face recognition, arXiv:1504.02351v1 (2015)

    Google Scholar 

  7. S. Zhou, S. Xiao, 3D face recognition: a survey. Hum. Centric Comput. Inf. Sci. 8(35), 19–45 (2018)

    Google Scholar 

  8. M. Chihaoui, A. Elkefi, W. Bellil, C.B. Amar, A survey of 2D face recognition techniques. Computers 5(4), 21 (2016)

    Article  Google Scholar 

  9. A. Chaudhuri, 2D and 3D Face Recognition Revisited Again, Technical Report TH-1486 (Samsung R & D Institute Delhi, Noida, 2014)

    Google Scholar 

  10. A. Chaudhuri, Studying Face Recognition Using Convolutional Neural Networks, Technical Report TH-1669 (Samsung R & D Institute Delhi, Noida, 2016)

    Google Scholar 

  11. A. Krizhevsky, I. Sutskever, G.E. Hinton, ImageNet classification with deep convolutional neural networks, in Proceedings of Neural Information Processing Systems, (MIT Press, Cambridge, 2012), pp. 1097–1105

    Google Scholar 

  12. Y. Taigman, M. Yang, M.A. Ranzato, L. Wolf, DeepFace: closing the gap to human level performance in face verification, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, (IEEE Computer Society Press, Los Alamitos, 2014), pp. 1701–1708

    Google Scholar 

  13. Y. LeCun, Y. Bengio, G. Hinton, Deep learning. Nature 521, 436–444 (2015)

    Article  Google Scholar 

  14. S. Chaib, H. Yao, Y. Gu, M. Amrani, Deep feature extraction and combination for remote sensing image classification based on pre-trained CNN models, in Proceedings of 9th International Conference on Digital Image Processing, (IEEE, Piscataway, 2017)

    Google Scholar 

  15. Y. Liu, Y. Li, X. Ma, R. Song, Facial expression recognition with fusion features extracted from salient facial areas. Sensors (Basel) 17(4), 712 (2017)

    Article  Google Scholar 

  16. J. Lu, G. Wang, J. Zhou, Simultaneous feature and dictionary learning for image set based face recognition. IEEE Trans. Image Process. 26(8), 4042–4054 (2017)

    Article  MathSciNet  MATH  Google Scholar 

  17. G. Hu, X. Peng, Y. Yang, T.M. Hospedales, J. Verbeek, Frankenstein: learning deep face representations using small data. IEEE Trans. Image Process. 27(1), 293–303 (2018)

    Article  MathSciNet  MATH  Google Scholar 

  18. M. Oquab, L. Bottou, I. Laptev, Learning and transferring mid-level image representations using convolutional neural networks, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, (IEEE Service Center, Piscataway, 2014), pp. 1717–1724

    Google Scholar 

  19. V. Campos, B. Jou, X. Giro-i-Nieto, From pixels to sentiment: fine-tuning CNNs for visual sentiment prediction. Image Vis. Comput. 65, 15–22 (2017)

    Article  Google Scholar 

  20. V. Nagori, Fine tuning the parameters of back propagation algorithm for optimum learning performance, in Proceedings of 2nd International Conference on Contemporary Computing and Informatics, (IEEE, Piscataway, 2016), pp. 7–12

    Google Scholar 

  21. M. Tzelepi, A. Tefas, Exploiting supervised learning for finetuning deep CNNs in content-based image retrieval, in Proceedings of 23rd International Conference on Pattern Recognition, (IEEE, Piscataway, 2016), pp. 2918–2923

    Google Scholar 

  22. Y. Li, W. Xie, H. Li, Hyperspectral image reconstruction by deep convolutional neural network for classification. Pattern Recogn. 63, 371–383 (2016)

    Article  Google Scholar 

  23. W. Rawat, Z. Wang, Deep convolutional neural networks for image classification: a comprehensive review. Neural Comput. 29(9), 2352–2449 (2017)

    Article  MathSciNet  MATH  Google Scholar 

  24. X. Glorot, Y. Bengio, Understanding the difficulty of training deep feedforward neural networks. J. Mach. Learn. Res. 9, 249–256 (2010)

    Google Scholar 

  25. W. Shang, K. Sohn, D. Almeida, H. Lee, Understanding and improving convolutional neural networks via concatenated rectified linear units, in Proceedings of International Conference on Machine Learning, (IEEE, Piscataway, 2016), pp. 2217–2225

    Google Scholar 

  26. Y. LeCun, L. Bottou, Y. Bengio, P. Haffner, Gradient-based learning applied to document recognition. Proc. IEEE 86(11), 2278–2324 (1998)

    Article  Google Scholar 

  27. S. Ioffe, C. Szegedy, Batch normalization: accelerating deep network training by reducing internal covariate shift, in Proceedings of International Conference on Machine Learning, (IEEE Service Center, Piscataway, 2015), pp. 448–456

    Google Scholar 

  28. J. Li, T. Qiu, C. Wen, K. Xie, F.Q. Wen, Robust face recognition using the deep C2D-CNN model based on decision level fusion. Sensors (Basel) 18(7), 2080 (2018)

    Article  Google Scholar 

  29. J.Y. Choi, Y.M. Ro, K.N. Plataniotis, Color local texture features for color face recognition. IEEE Trans. Image Process. 21(3), 1366–1380 (2012)

    Article  MathSciNet  MATH  Google Scholar 

  30. Z. Lu, X. Jiang, A. Kot, A novel LBP-based color descriptor for face recognition, in Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing, (IEEE Service Center, Piscataway, 2017), pp. 1857–1861

    Google Scholar 

  31. Z. Lu, X. Jiang, A. Kot, An effective color space for face recognition, in Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing, (IEEE Service Center, Piscataway, 2016), pp. 849–856

    Google Scholar 

  32. Z. Lu, X. Jiang, A. Kot, A color channel fusion approach for face recognition. IEEE Signal Process. Lett. 22(11), 1839–1843 (2015)

    Article  Google Scholar 

  33. K. He, X. Zhang, S. Ren, J. Sun, Deep residual learning for image recognition, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, (IEEE Service Center, Piscataway, 2016), pp. 770–778

    Google Scholar 

  34. Y. Sun, X. Wang, X. Tang, Deep learning face representation from predicting 10,000 classes, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, (IEEE Service Center, Piscataway, 2014), pp. 1891–1898

    Google Scholar 

  35. O. Tadmor, Y. Wexler, T. Rosenwein, S. Shalevshwartz, A. Shashua, Learning a metric embedding for face recognition using the multi batch method, in Proceedings of Neural Information Processing Systems, (MIT Press, Cambridge, 2016), pp. 1388–1389

    Google Scholar 

  36. Y. Wen, K. Zhang, Z. Li, Y. Qiao, A discriminative feature learning approach for deep face recognition, in Proceedings of European Conference on Computer Vision, (Springer Nature, Cham, 2016), pp. 499–515

    Google Scholar 

  37. Y. Zhang, K. Shang, J. Wang, N. Lia, M.M.Y. Zhang, Patch strategy for deep face recognition. IET Image Process. 12(5), 819–825 (2018)

    Article  Google Scholar 

  38. F. Schroff, D. Kalenichenko, J. Philbin, FaceNet: a unified embedding for face recognition and clustering, arXiv:1503.03832v3 (2015)

    Google Scholar 

  39. S. Dodge, L. Karam, Understanding how image quality affects deep neural networks, in Proceedings of 8th IEEE International Conference on Quality of Multimedia Experience, (IEEE Service Center, Piscataway, 2016), pp. 1–6

    Google Scholar 

  40. B.R. Webster, S.E. Anthony, W.J. Scheirer, PsyPhy: a psychophysics driven evaluation framework for visual recognition, arXiv:1611.06448 (2016)

    Google Scholar 

  41. A. Dosovitskiy, J.T. Springenberg, M. Riedmiller, T. Brox, Discriminative unsupervised feature learning with convolutional neural networks, in Proceedings of Neural Information Processing Systems, (MIT Press, Cambridge, 2014), pp. 766–774

    Google Scholar 

  42. M.D. Zeiler, R. Fergus, Visualizing and understanding convolutional networks, in Proceedings of European Conference on Computer Vision, (Springer International Publishing, Cham, 2014), pp. 818–833

    Google Scholar 

  43. K. Lenc, A. Vedaldi, Understanding image representations by measuring their equivariance and equivalence, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, (IEEE Computer Society, Los Alamitos, 2015), pp. 991–999

    Google Scholar 

  44. R. Ranjan, S. Sankaranarayanan, A. Bansal, N. Bodla, J.C. Chen, V.M. Patel, C.D. Castillo, R. Chellappa, Deep learning for understanding faces: machines may be just as good, or better than humans. IEEE Signal Process. Mag. 35(1), 66–83 (2018)

    Article  Google Scholar 

  45. J. Hu, L. Shen, G. Sun, Squeeze-and-excitation networks, arXiv:1709.01507 (2017)

    Google Scholar 

  46. A. Chaudhuri, Face Detection Using Deformable Parts Models, Technical Report, TH-1679 (Samsung R & D Institute Delhi, Noida, 2016)

    Google Scholar 

  47. H. Li, Z. Lin, X. Shen, J. Brandt, G. Hua, A convolutional neural network cascade for face detection, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, (IEEE Computer Society, Los Alamitos, 2015), pp. 5325–5334

    Google Scholar 

  48. Y. Sun, X. Wang, X. Tang, Deep convolutional network cascade for facial point detection, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, (IEEE Computer Society, Los Alamitos, 2013), pp. 3476–3483

    Google Scholar 

  49. X. Xiong, F.D.L. Torre, Supervised descent method and its applications to face alignment, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, (IEEE Computer Society, Los Alamitos, 2013), pp. 532–539

    Google Scholar 

  50. Y. Sun, Y. Chen, X. Wang, X. Tang, Deep learning face representation by joint identification-verification, in Proceedings of Neural Information Processing Systems, (MIT Press, London, 2014), pp. 1988–1996

    Google Scholar 

  51. Y. Sun, D. Liang, X. Wang, X. Tang, DeepID3: face recognition with very deep neural networks. arXiv:1502.00873v1 (2015)

    Google Scholar 

  52. E. Zhou, Z. Cao, Q. Yin, Naive-deep face recognition: touching the limit of LFW benchmark or not? arXiv:1501.04690v1 (2015)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Samsung R & D Institute Delhi, Noida, India

    Arindam Chaudhuri

Authors
  1. Arindam Chaudhuri
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. School of Computing and Communication, InfoLab21, Lancaster University, Lancaster, UK

    Richard Jiang

  2. School of Information Technology, Deakin University, Waurn Ponds, VIC, Australia

    Chang-Tsun Li

  3. Electrical Engineering and Computer Science, School of Electronics, Queen’s University Belfast, Belfast, UK

    Danny Crookes

  4. Technical University of Denmark, Kgs. Lyngby, Denmark

    Weizhi Meng

  5. GREYC research Lab, ENSICAEN, Caen, France

    Christophe Rosenberger

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Chaudhuri, A. (2020). Deep Learning Models for Face Recognition: A Comparative Analysis. In: Jiang, R., Li, CT., Crookes, D., Meng, W., Rosenberger, C. (eds) Deep Biometrics. Unsupervised and Semi-Supervised Learning. Springer, Cham. https://doi.org/10.1007/978-3-030-32583-1_6

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-32583-1_6

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-32582-4

  • Online ISBN: 978-3-030-32583-1

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics