Skip to main content
SpringerLink
Log in

Hybrid descriptors and Weighted PCA-EFMNet for Face Verification in the Wild

  • Regular Paper
  • Published:
International Journal of Multimedia Information Retrieval Aims and scope Submit manuscript

Abstract

Unconstrained face recognition is a complex task because of the numerous intra-class changes caused by lighting, occlusion, facial expressions and poses changes. Such variations affect considerably the performance of facial recognition systems, particularly those based on 2D information. In this research work, an efficient feature extraction method, called Gabor Local Binarized Statistical Image Features, is introduced. A new deep learning network is also developed to extract features relying on data processing components: (1) Cascaded Weighted Principal Component Analysis (WPCA) with Enhanced Fisher Model (WPCA-EFM); (2) binary hashing; and (3) Block-wise Histograms. The suggested architecture (Weighted PCA-EFM) is employed to learn multistage filter banks. Simple block histogram and binary hashing are applied for indexing and pooling, which facilitate the design and learning of our architecture for Face Verification in the Wild. Classification is finally performed using distance measure Cosine and support vector machine. Our experiments are carried out in real-world dataset: Labeled Faces in the Wild. Experimental findings demonstrate that the developed technique achieved high accuracy of 95%.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. Cordea M, Ionescu B, Gadea C, Ionescu D (2019) DynFace: a multi-label, dynamic-margin-softmax face recognition model. In: Science and information conference. Springer, pp 535–550

  2. Zeng H, Wang X, Gu Y (2016) Center symmetric local multilevel pattern based descriptor and its application in image matching. Int J Opt 2016:1–9. https://doi.org/10.1155/2016/1584514

    Article  Google Scholar 

  3. Yadav SK, Singh DP, Choudhary J (2018) A survey: comparative analysis of different variants of local binary pattern. In: Second international conference on inventive communication and computational technologies (ICICCT). IEEE, pp 1878–1887

  4. Ning C, Liu W, Wang X (2018) Infrared object recognition based on monogenic features and multiple kernel learning. In: IEEE 3rd international conference on image, vision and computing (ICIVC). IEEE, pp 204–208

  5. Ouamane A, Bengherabi M, Hadid A, Cheriet M (2015) Side-information based exponential discriminant analysis for face verification in the wild. In: 11th IEEE international conference and workshops on automatic face and gesture recognition (FG). IEEE, pp 1–6

  6. Ameur B, Masmoudi S, Derbel AG, Hamida AB (2016) Fusing gabor and LBP feature sets for KNN and SRC-based face recognition. In: 2nd international conference on advanced technologies for signal and image Processing (ATSIP). IEEE, pp 453–458

  7. Ameur B, Belahcene M, Masmoudi S, Derbel AG, Hamida AB (2017) A new GLBSIF descriptor for face recognition in the uncontrolled environments. In: International conference on advanced technologies for signal and image processing (ATSIP). IEEE, pp 1–6

  8. Yu J, Liu H, Zheng X (2019) Two-dimensional joint local and nonlocal discriminant analysis-based 2D image feature extraction for deep learning. Neural Comput Appl. https://doi.org/10.1007/s00521-019-04085-0

    Google Scholar 

  9. Zhai Y, He D (2019) Video-based face recognition based on deep convolutional neural network. In: Proceedings of the international conference on image, video and signal processing. ACM, pp 23–27

  10. An F, Liu Z (2019) Facial expression recognition algorithm based on parameter adaptive initialization of CNN and LSTM. Vis Comput. https://doi.org/10.1007/s00371-019-01635-4

    Google Scholar 

  11. Arefin MMN (2019) Face reconstruction using non-negative matrix factorization and ℓ1 constrained optimization. In: International conference on robotics, electrical and signal processing techniques (ICREST). IEEE, pp 389–394

  12. Stricker M, Augereau O, Kise K, Iwata M (2018) Facial landmark detection for manga images. arXiv:181103214

  13. Dang L, Hassan S, Im S, Lee J, Lee S, Moon H (2018) Deep learning based computer generated face identification using convolutional neural network. Appl Sci 8(12):2610

    Article  Google Scholar 

  14. Chauhan NK, Singh K (2018) A review on conventional machine learning vs deep learning. In: International conference on computing, power and communication technologies (GUCON). IEEE, pp 347–352

  15. Anderson R, Gema AP, Isa SM (2018) Facial attractiveness classification using deep learning. In: Indonesian association for pattern recognition international conference (INAPR). IEEE, pp 34–38

  16. Sun X, Wu P, Hoi SC (2018) Face detection using deep learning: an improved faster RCNN approach. Neurocomputing 299:42–50

    Article  Google Scholar 

  17. Kazak N, Koc M (2018) Improved multi-spiral local binary pattern in texture recognition. In: Conference on computer science and information technologies. Springer, pp 28–37

  18. Wang Q, Ding Y-D (2018) A novel fine-grained method for vehicle type recognition based on the locally enhanced PCANet neural network. J Comput Sci Technol 33(2):335–350

    Article  MathSciNet  Google Scholar 

  19. Sun Z, Hu Z-P, Chiong R, Wang M, He W (2018) Combining the kernel collaboration representation and deep subspace learning for facial expression recognition. J Circuits Syst Comput 27(08):1850121

    Article  Google Scholar 

  20. Li Y-K, Wu X-J, Kittler J (2019) L1-2D 2 PCANet: a deep learning network for face recognition. J Electron Imaging 28(2):023016

    Google Scholar 

  21. Geng T, Yang M, You Z, Cai Y, Huang F (2018) Multiscale overlapping blocks binarized statistical image features descriptor with flip-free distance for face verification in the wild. Neural Comput Appl 30(10):3243–3252

    Article  Google Scholar 

  22. Aliradi R, Belkhir A, Ouamane A, Elmaghraby AS (2018) DIEDA: discriminative information based on exponential discriminant analysis combined with local features representation for face and kinship verification. Multimed Tools Appl. https://doi.org/10.1007/s11042-017-5572-2

    Google Scholar 

  23. Bessaoudi M, Ouamane A, Belahcene M, Chouchane A, Boutellaa E, Bourennane S (2019) Multilinear side-information based discriminant analysis for face and kinship verification in the wild. Neurocomputing 329:267–278

    Article  Google Scholar 

  24. Lu J, Hu J, Tan Y-P (2017) Discriminative deep metric learning for face and kinship verification. IEEE Trans Image Process 26(9):4269–4282

    Article  MathSciNet  MATH  Google Scholar 

  25. Chong S-C, Ong T-S, Teoh ABJ (2018) Discriminative kernel-based metric learning for face verification. J Vis Commun Image Represent 56:207–219

    Article  Google Scholar 

  26. Deng W, Hu J, Guo J (2019) Compressive binary patterns: designing a robust binary face descriptor with random-field eigenfilters. IEEE Trans Pattern Anal Mach Intell 41(3):758–767

    Article  Google Scholar 

  27. Mohammed NN, Khaleel MI, Latif M, Khalid Z (2018) Face recognition based on PCA with weighted and normalized Mahalanobis distance. In: International conference on intelligent informatics and biomedical sciences (ICIIBMS). IEEE, pp 267–267

  28. Zafaruddin GM, Fadewar HS (2019) Face recognition using eigenfaces. In: Iyer B, Nalbalwar S, Pathak N (eds) Computing, communication and signal processing. Springer, Singapore, pp 855–864

    Chapter  Google Scholar 

  29. Lal M, Kumar K, Arain RH, Maitlo A, Ruk SA, Shaikh H (2018) Study of face recognition techniques: a survey. Int J Adv Comput Sci Appl 9(6):42–49

    Google Scholar 

  30. Zheng L, Idrissi K, Garcia C, Duffner S, Baskurt A (2015) Triangular similarity metric learning for face verification. In: 11th IEEE international conference and workshops on automatic face and gesture recognition (FG). IEEE, pp 1–7

  31. Barkan O, Weill J, Wolf L, Aronowitz H (2013) Fast high dimensional vector multiplication face recognition. In: Proceedings of the IEEE international conference on computer vision, pp 1960–1967

  32. Huang GB, Jones MJ, Learned-Miller E (2008) LFW results using a combined Nowak plus MERL recognizer. In: Workshop on faces in ‘real-life’ images: detection, alignment, and recognition

  33. Guillaumin M, Verbeek J, Schmid C (2009) Is that you? Metric learning approaches for face identification. In: IEEE 12th international conference on computer vision. IEEE, pp 498–505

  34. Hussain SU, Napoléon T, Jurie F (2012) Face recognition using local quantized patterns. In: British machine vision conference. p 11

  35. Cox D, Pinto N (2011) Beyond simple features: a large-scale feature search approach to unconstrained face recognition. In: Face and gesture. IEEE, pp 8–15

  36. Ying Y, Li P (2012) Distance metric learning with eigenvalue optimization. J Mach Learn Res 13(Jan):1–26

    MathSciNet  MATH  Google Scholar 

  37. Huang GB, Lee H, Learned-Miller E (2012) Learning hierarchical representations for face verification with convolutional deep belief networks. In: IEEE conference on computer vision and pattern recognition. IEEE, pp 2518–2525

  38. Cui Z, Li W, Xu D, Shan S, Chen X (2013) Fusing robust face region descriptors via multiple metric learning for face recognition in the wild. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3554–3561

  39. Yi D, Lei Z, Li SZ (2013) Towards pose robust face recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3539–3545

  40. Cao Q, Ying Y, Li P (2013) Similarity metric learning for face recognition. In: Proceedings of the IEEE international conference on computer vision, pp 2408–2415

  41. Hu J, Lu J, Tan Y-P (2014) Discriminative deep metric learning for face verification in the wild. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1875–1882

  42. Hu J, Lu J, Yuan J, Tan Y-P (2014) Large margin multi-metric learning for face and kinship verification in the wild. In: Asian conference on computer vision. Springer, pp 252–267

  43. Hassner T, Harel S, Paz E, Enbar R (2015) Effective face frontalization in unconstrained images. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 4295–4304

  44. Zhu X, Lei Z, Yan J, Yi D, Li SZ (2015) High-fidelity pose and expression normalization for face recognition in the wild. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 787–796

  45. Juefei-Xu F, Luu K, Savvides M (2015) Spartans: single-sample periocular-based alignment-robust recognition technique applied to non-frontal scenarios. IEEE Trans Image Process 24(12):4780–4795

    Article  MathSciNet  MATH  Google Scholar 

  46. Ouamane A, Messaoud B, Guessoum A, Hadid A, Cheriet M (2014) Multi scale multi descriptor local binary features and exponential discriminant analysis for robust face authentication. In: IEEE international conference on image processing (ICIP). IEEE, pp 313–317

  47. Chengeta K, Viriri S (2019) A review of local, holistic and deep learning approaches in facial expressions Recognition. In: Conference on information communications technology and society (ICTAS). IEEE, pp 1–7

  48. Ameur B, Belahcene M, Masmoudi S, Hamida AB (2018) Weighted PCA-EFMNet: a deep learning network for face verification in the wild. In: 4th International conference on advanced technologies for signal and image processing (ATSIP). IEEE, pp 1–6

  49. Chan T-H, Jia K, Gao S, Lu J, Zeng Z, Ma Y (2015) PCANet: a simple deep learning baseline for image classification? IEEE Trans Image Process 24(12):5017–5032

    Article  MathSciNet  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. ATMS Advanced Technologies for Medicine and Signals, National Engineering School of Sfax (ENIS), Sfax University, Soukra Street, Km 3.5, B.P. 1173, 3038, Sfax, Tunisia

    Bilel Ameur, Sabeur Masmoudi & Ahmed Ben Hamida

  2. National Engineering School of Gabes (ENIG), Gabes University, Avenue Omar Ibn El Khattab Zrig, 6029, Gabes, Tunisia

    Bilel Ameur

  3. LI3C Laboratory of Identification, Command, Control and Communication, Faculty of Science and Technology, Mohamed Khider University Biskra, BP 145 RP, 07000, Biskra, Algeria

    Mebarka Belahcene

Authors
  1. Bilel Ameur
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mebarka Belahcene
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sabeur Masmoudi
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ahmed Ben Hamida
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Bilel Ameur.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ameur, B., Belahcene, M., Masmoudi, S. et al. Hybrid descriptors and Weighted PCA-EFMNet for Face Verification in the Wild. Int J Multimed Info Retr 8, 143–154 (2019). https://doi.org/10.1007/s13735-019-00175-w

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13735-019-00175-w

Keywords

Search

Navigation