Skip to main content

Advertisement

SpringerLink
Log in

Complement component face space for 3D face recognition from range images

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

This paper proposes a mathematical model for decomposing a range face image into four basic components (named ‘complement components’) in conjunction with a simple approach for data-level fusion to generate thirty-six additional hybrid components. These forty component faces composing a new face image space called the ‘complement component face space.’ The main challenge of this work was to extract relevant features from the vast face space. Features are extracted from the four basic components and four selected hybrid components using singular value decomposition. To introduce diversity, the extracted feature vectors are fused by applying the crossover operation of the genetic algorithm using a Hamming distance-based fitness measure. Particle swarm optimization-based feature selection is employed on the fused features to discard redundant feature values and to maximize the face recognition performance. The recognition performances of the proposed feature set with a support vector machine-based classifier on three accessible and well-known 3D face databases, namely, Frav3D, Bosphorus, and Texas3D, show significant improvements over those achieved by state-of-the-art methods. This work also studies the feasibility of utilizing the component images in the complement component face space for data augmentation in convolutional neural network (CNN)-based frameworks.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Ganguly S, Bhattacharjee D, Nasipuri M (2014) 2.5D face images: acquisition, processing, and application. In: International conference on communication and computing, pp 36–44

  2. Brunelli R, Poggio T (1993) Face recognition: features versus templates. IEEE Trans Pattern Anal Mach Intel 15(10):1042–1052

    Article  Google Scholar 

  3. Draper BA, Baek K, Bartlett MS, Beveridgea JR (2003) Recognizing faces with PCA and ICA. Computer Vision and Image Understanding 91:115–137

    Article  Google Scholar 

  4. Hesher C, Srivastava A, Erlebacher G (2003) A novel technique for face recognition using range imaging. Seventh International Symposium on Signal Processing and Its Applications, pp 201–204

  5. Dagher I, Bazzaz HA (2019) Improving the component-based face recognition using enhanced viola–jones and weighted voting technique. Modelling and Simulation in Engineering. https://doi.org/10.1155/2019/8234124

  6. Zhang W, Shan S, Gao W, Chang Y, Cao B (2004) Component-based cascade linear discriminant analysis for face recognition. Advances in Biometric Person Authentication 3338:288–295

    Article  Google Scholar 

  7. Heisele B, Serre T, Poggio T (2006) A component-based framework for face detection and identification. IEEE International Workshop on Analysis and Modelling of Faces and Gestures 74(2):167–181

    Google Scholar 

  8. Spreeuwers L (2011) Fast and accurate 3d face recognition using registration to an intrinsic coordinate system and fusion of multiple region classifiers. Int J Comput Vis 93(3):389–414

    Article  Google Scholar 

  9. Srinivas M, Patnaik LM (1994) Genetic algorithms: a survey. Computer 27(6):17–26

    Article  Google Scholar 

  10. Holland JH (1975) Adaptation in natural and artificial systems, Univ of Michigan Press

  11. Subban R, Mankame D, Nayeem S, Pasupathi P, Muthukumar S (2014) Genetic algorithm based human face recognition. In: International conference on advances in communication, network, and computing, CNC, pp 418–426

  12. Sukhija P, Behal S, Singh P (2016) Face recognition system using genetic algorithm. Procedia Computer Science 85:410–417

    Article  Google Scholar 

  13. Moussa M, Hmila M, Douik A (2018) A novel face recognition approach based on genetic algorithm optimization. Studies in Informatics and Control 27(1):127–134

    Article  Google Scholar 

  14. Emambakhsh M, Evans A (2017) Nasal patches and curves for expression-robust 3D face recognition. IEEE Trans Pattern Anal Mach Intel 39(5):995–1007

    Article  Google Scholar 

  15. Kennedy J, Eberhart R (1995) Particle swarm optimization. In: IEEE international conference on neural network, pp 1942–1948

  16. Shieh MY, Chiou JS, Hu YC, Wang KY (2014) Applications of pca and svm-pso based real-time face recognition system. Math Probl Eng, pp 1942–1948

  17. Valuvanathorn S, Nitsuwat S, Huang ML (2012) Multi-feature face recognition based on pso-svm. In: 10th international conference on ICT and knowledge engineering, pp 140–145

  18. Hasan HM, Jouhar WAA, Alwan MA (2012) 3-d face recognition using improved 3d mixed transform. International Journal of Biometrics and Bioinformatics 6(1):278–290

    Google Scholar 

  19. Zeiler MD, Fergus R (2014) Visualizing and understanding convolutional networks. In: Fleet D, Pajdla T, Schiele B, Tuytelaars T (eds) Computer Vision-ECCV 2014. Lecture Notes in Computer Science. Springer, Cham. https://doi.org/10.1007/978-3-319-10590-1_53

  20. Masi I, Wu Y, Hassner T, Natarajan P (2018) Deep Face Recognition: A Survey, 31st SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI). https://arxiv.org/pdf/1804.06655.pdf

  21. LeCun Y, Bottou L, Bengio Y, Haffner P (1998) Gradient-based learning applied to document recognition. Proc IEEE 86(11):2278–2324

    Article  Google Scholar 

  22. Jerry W (2019) AlexNet: The Architecture that Challenged CNNs. https://towardsdatascience.com/alexnet-the-architecture-that-challenged-cnns-e406d5297951

  23. Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A (2015) Going Deeper with Convolutions, IEEE Conference on Computer Vision and Pattern Recognition (CVPR)

  24. Schroff F, Kalenichenko D, Philbin J (2015) Facenet: a unified embedding for face recognition and clustering. In: IEEE conference on computer vision and pattern recognition (CVPR), pp 815–823

  25. Sun Y, Ding L, Wang X, Tang X (2015) Deepid3: Face recognition with very deep neural networks. https://arxiv.org/abs/1502.00873

  26. Kim D, Hernandez M, Choi J, Medioni G (2018) Deep 3D face identification. In: IEEE international joint conference on biometrics (IJCB). https://arxiv.org/pdf/1703.10714.pdf

  27. Cai Y, Lei Y, Yang M, You Z (2019) Shan s, a fast and robust 3D face recognition approach based on deeply learned face representation. Neurocomputing 363:375–397

    Article  Google Scholar 

  28. Olivetti EC, Ferretti J, Cirrincione G, Nonis F, Tomincasa S, Marcolin F (2020) Deep CNN for 3D face recognition. In: Rizzi C, Andrisano A, Leali F, Gherardini F, Pini F, Vergnano A (eds) Design tools and methods in industrial engineering. ADM 2019, Lecture notes in mechanical Engineering. Springer, pp 665–674

  29. Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y (2014) Generative adversarial nets, vol 27, pp 2672–2680

  30. Nalepa J, Myller M, Kawulok M (2019) Hyperspectral Data Augmentation. https://arxiv.org/pdf/1903.05580.pdf

  31. Kim W, Suh S, Hwang W, Han JJ (2014) SVD Face: Illumination-Invariant face representation. IEEE Signal Process Lett 21(11):1336–1340

    Article  Google Scholar 

  32. Hamming distance (2015) http://www.maths.manchester.ac.uk/pas/code/notes/part2.pdf

  33. Lin SW, Ying KC, Chen SC, Lee ZJ (2008) Particle swarm optimization for parameter determination and feature selection of support vector machines. Expert System Application 35(4):1817–1824

    Article  Google Scholar 

  34. Xue B, Zhang M, Browne WN (2013) Particle swarm optimization for feature selection in classification: a multi-objective approach. IEEE Trans Cybern 43(6):1656–1671

    Article  Google Scholar 

  35. Conde C, Cipolla R (2005) 3D facial feature location with spin images, In: IAPR conference on machine vision applications, pp 418–421

  36. Savran A, Alyuz N, Dibeklioglu H, Çeliktutan O, Gökberk B, Sankur B, Akarun L (2008) Bosphorus database for 3D face analysis, biometrics and identity management. Lect Notes Comput Sci, pp 47–56

  37. Gupta S, Castleman KR, Markey MN, Bovik AC (2009) Texas 3D face recognition database. IEEE Southwest Symposium on Image Analysis and Interpretation, pp 97–100

  38. Heisele B, Ho P, Poggio T (2001) Face recognition with support vector machines: Global versus component-based approach. Eighth IEEE International Conference on Computer Vision 4(2):688–694

    Article  Google Scholar 

  39. Bagchi P, Bhattacharjee D, Nasipuri M (2015) 3D Face Recognition using Surface Normals IEEE Region 10 Conference, TENCON - 2015. https://doi.org/10.1109/TENCON.2015.7372819

  40. Ganguly S, Bhattacharjee D, Nasipuri M (2015) Wavelet and decision fusion based 3d face recognition from range image. Int J Appl Pattern Recogn (IJAPR) 2(4):306–624

    Article  Google Scholar 

  41. Dutta K, Bhattacharjee D, Nasipuri M (2016) Expression and Occlusion invariant 3D face recognition based on region classifier. In: Proc 1st international conference on information technology, information systems and electrical engineering (ICITISEE), pp 99–104

  42. Sghaier S, Farhat W, Souani C (2018) Novel technique for 3D face recognition using anthropometric methodology. International Journal of Ambient Computing and Intelligence 9(1):60–77

    Article  Google Scholar 

  43. Dutta K, Bhattacharjee D, Nasipuri M (2019) 3D face recognition based on volumetric representation of range image. In: Chaki R, Cortesi A, Saeed K, Chaki N (eds) Advance computing and systems for security, advance in intelligent systems and computing, vol 883, pp 175–189

  44. Soltanpour S, Wu QMJ (2017) High-Order Local normal derivative pattern (LNDP) for 3D face recognition. In: International conference on image processing (ICIP), pp 2811–2815

  45. Lv C, Zhao J (2018) 3D Face Recognition based on Local Conformal Parameterization and Iso-Geodesic Stripes Analysis, Mathematical Problems in Engineering. https://doi.org/10.1155/2018/4707954

  46. Soltanpour S, Wu QMJ (2019) Weighted extreme sparse classifier and local derivative pattern for 3D face recognition. IEEE Trans Image Process 28(6):3020–3033

    Article  MathSciNet  Google Scholar 

  47. Hiremath PS, Hiremath M (2015) 3D face recognition using radon transform and symbolic PCA. International Journal of Electronics and Computer Science Engineering 1(4):2342–2349

    Google Scholar 

  48. Song D, Luo J, Zi C, Tian M (2016) 3D face recognition using anthropometric and curvelet features fusion, Journal of Sensors. https://doi.org/10.1155/2016/6859364

  49. Hiremath M, Hiremath PS (2017) 3D face recognition based on symbolic FDA using SVM classifier with similarity and dissimilarity distance measure. International Journal of Pattern Recognition and Artificial Intelligence 31(4):1756006

    Article  Google Scholar 

  50. Shi L, Wang X, Shen Y (2020) Research on 3D face recognition method based on LBP and SVM. Optik - International Journal for Light and Electron Optics 220:165157

    Article  Google Scholar 

Download references

Acknowledgements

The first author is grateful to the Ministry of Electronics and Information Technology (MeitY), Govt. of India, for the grant of the Visvesvaraya doctorate fellow-ship award. The authors are also thankful to CMATER laboratory of the Department of Computer Science and Engineering, Jadavpur University, Kolkata, India, for providing the necessary infrastructure for this work. The authors also acknowledge the contribution of Late Suranjan Ganguly, a researcher of CMATER Laboratory, who actively participated in this research work.

Author information

Authors and Affiliations

  1. Computer Science and Engineering, Jadavpur University, Kolkata, India

    Koushik Dutta, Debotosh Bhattacharjee & Mita Nasipuri

  2. Center for Basic and Applied Science, Faculty of Informatics and Management, University of Hradec Kralove, Hradec Kralove, Czech Republic

    Debotosh Bhattacharjee & Ondrej Krejcar

  3. Malaysia-Japan International Institute of Technology (MJIIT), Universiti Teknologi Malaysia, Kuala Lumpur, Malaysia

    Ondrej Krejcar

Authors
  1. Koushik Dutta
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Debotosh Bhattacharjee
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mita Nasipuri
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ondrej Krejcar
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Koushik Dutta.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Dutta, K., Bhattacharjee, D., Nasipuri, M. et al. Complement component face space for 3D face recognition from range images. Appl Intell 51, 2500–2517 (2021). https://doi.org/10.1007/s10489-020-02012-8

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-020-02012-8

Keywords

Search

Navigation