Skip to main content
SpringerLink
Log in

Face recognition in a large dataset using a hierarchical classifier

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Face recognition is one of the most common authentication methods. Although much research has been conducted in this area, there are still many challenging issues to be addressed on face recognition, such as a large number of images in a dataset, with only one sample per person. The goal of this paper is to provide a robust face recognition method for a database having a large number of images with only one sample per person. The proposed method first uses a simple clustering approach to divide the images hierarchically into balanced clusters. Balanced clustering helps us to continue clustering in several hierarchies and finally reach very small clusters of equal size. Then, the face recognition task is performed within each cluster. A combination of the Non-negative Matrix Factorization (NMF) and the Fast Retina Key-point (FREAK) descriptors has been used to match the faces. The proposed method was evaluated on the FERET dataset that achieved an accuracy of 98.36%. Also, some other experiments have been done to validate the efficiency of the proposed method. The results of the experiments show that the proposed method can be applied to even larger datasets, while its complexity increases linearly.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

Notes

  1. Available on http://pics.stir.ac.uk.

  2. Available on https://cswww.essex.ac.uk/mv/allfaces/faces94.html.

References

  1. Ahonen T, Hadid A, Pietikäinen M (2004) Face recognition with local binary patterns. In: Computer vision - ECCV 2004, vol 3021. Springer Berlin Heidelberg, pp 469–481

  2. Al-Obaydy WNI, Suandi SA (2020) Open-set face recognition in video surveillance: a survey. In: Kasruddin Nasir AN, Ahmad MA, Najib MS, Abdul Wahab Y, Othman NA, Abd Ghani NM, Irawan A, Khatun S, Raja Ismail RMT, Saari MM, Daud MR, Mohd Faudzi AA (eds) InECCE2019. Springer Singapore, Singapore, pp 425–436

  3. Alahi A, Ortiz R, Vandergheynst P (2012) FREAK: fast retina keypoint. In: 2012 IEEE conference on computer vision and pattern recognition. IEEE, Providence, pp 510–517

  4. Annalakshmi M, Roomi SMM, Naveedh AS (2019) A hybrid technique for gender classification with SLBP and HOG features. Clust Comput 22 (S1):11–20

    Article  Google Scholar 

  5. Bai G, Zhu Y, Ding Z (2008) A hierarchical face recognition method based on local binary pattern. In: 2008 Congress on image and signal processing. IEEE, Sanya, pp 610–614

  6. Bartlett M, Movellan J, Sejnowski T (2002) Face recognition by independent component analysis. IEEE Trans Neural Netw 13(6):1450–1464

    Article  Google Scholar 

  7. Bastanfard A, Takahashi H, Nakajima M (2004) Toward e-appearance of human face and hair by age, expression and rejuvenation. In: 2004 International conference on cyberworlds. IEEE, Tokyo, pp 306–311

  8. Biglari M, Neycharan J, Mirzaei F, Soleimani A (2014) Robust feature extraction using gabor filter, lbp and lda for face recognition

  9. Chen Y, Zhao Y (2006) Face recognition using DCT and hierarchical RBF model. In: Hutchison D, Kanade T, Kittler J, Kleinberg JM, Mattern F, Mitchell JC, Naor M, Nierstrasz O, Pandu Rangan C, Steffen B, Sudan M, Terzopoulos D, Tygar D, Vardi MY, Weikum G, Corchado E, Yin H, Botti V, Fyfe C (eds) Intelligent data engineering and automated learning – IDEAL 2006, vol 4224. Springer Berlin, Heidelberg, Berlin, pp 355–362. Series title: lecture notes in computer science

  10. Chen S, Liu J, Zhou ZH (2004) Making FLDA applicable to face recognition with one sample per person. Pattern Recogn 37(7):1553–1555

    Article  Google Scholar 

  11. Cheng Z, Zhu X, Gong S (2020) Face re-identification challenge: are face recognition models good enough? Pattern Recogn 107:107422

    Article  Google Scholar 

  12. Choi SE, Lee YJ, Lee SJ, Park KR, Kim J (2011) Age estimation using a hierarchical classifier based on global and local facial features. Pattern Recogn 44(6):1262–1281

    Article  Google Scholar 

  13. Cover T, Hart P (1967) Nearest neighbor pattern classification. IEEE Trans Inf Theory 13(1):21–27

    Article  Google Scholar 

  14. Deng J, Guo J, Xue N, Zafeiriou S (2019) Arcface: additive angular margin loss for deep face recognition. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (CVPR)

  15. Du G, Su F, Cai A (2009) Face recognition using SURF features, p 749628. Yichang, China

  16. Duong VH, Bui MQ, Wang JC (2019) Matrix factorization on complex domain for face recognition. In: Luigi Mazzeo P, Ramakrishnan S, Spagnolo P (eds) Visual object tracking with deep neural networks. IntechOpen

  17. Gutta S, Wechsler H (1996) Face recognition using hybrid classifier systems. In: Proceedings of international conference on neural networks (ICNN’96), vol 2. IEEE, Washington, pp 1017–1022

  18. Hao L, Yu W (2019) Face image set recognition based on improved HOG-NMF and convolutional neural networks. Progress Hum Comput Interact 2(1)

  19. Harris C, Stephens M (1988) A combined corner and edge detector. In: Proceedings of the Alvey vision conference. Alvety Vision Club, pp 23.1–23.6

  20. Hassaballah M, Aly S (2015) Face recognition: challenges, achievements and future directions. IET Comput Vis 9(4):614–626

    Article  Google Scholar 

  21. Hassaballah M, Awad AI (2016) Detection and description of image features: an introduction. Series title: studies in computational intelligence, vol 630. Springer International Publishing, Cham, pp 1–8

    Google Scholar 

  22. Hassaballah M, Awad AI (eds) (2020) Deep learning in computer vision: principles and applications. Digital imaging and computer vision, 1st edn. CRC Press/Taylor and Francis, Boca Raton

  23. He K, Zhang X, Ren S, Sun J (2015) Deep residual learning for image recognition. arXiv:1512.03385

  24. Hu C, Lu X (2015) Single sample face recognition via lower-upper decomposition. In: 2015 10th asian control conference (ASCC). IEEE, Kota Kinabalu, pp 1–6

  25. Ji HK, Sun QS, Ji ZX, Yuan YH, Zhang GQ (2017) Collaborative probabilistic labels for face recognition from single sample per person. Pattern Recogn 62:125–134

    Article  Google Scholar 

  26. Kan M, Shan S, Su Y, Xu D, Chen X (2013) Adaptive discriminant learning for face recognition. Pattern Recogn 46(9):2497–2509

    Article  Google Scholar 

  27. Khan A, Sohail A, Zahoora U, Qureshi AS (2020) A survey of the recent architectures of deep convolutional neural networks. Artif Intell Rev. arXiv:1901.06032

  28. Kim J, Park H (2011) Fast nonnegative matrix factorization: an active-set-like method and comparisons. SIAM J Sci Comput 33(6):3261–3281

    Article  MathSciNet  Google Scholar 

  29. Kortli Y, Jridi M, Falou AA, Atri M (2020) Face recognition systems: a survey. Sensors 20(2):342

    Article  Google Scholar 

  30. Krizhevsky A, Sutskever I, Hinton GE (2017) Imagenet classification with deep convolutional neural networks. Commun ACM 60(6):84–90

    Article  Google Scholar 

  31. Lee DD, Seung HS (2000) Algorithms for non-negative matrix factorization. Neural Inf Proces Syst 13:7

    Google Scholar 

  32. Li SZ, Jain AK (eds) (2011) Handbook of face recognition. Springer, London

  33. Li H, Doermann D, Kia O (2000) Automatic text detection and tracking in digital video. IEEE Trans Image Process 9(1):147–156

    Article  Google Scholar 

  34. Li Y, Hu H, Zhu Z, Zhou G (2020) SCANet: sensor-based continuous authentication with two-stream convolutional neural networks. ACM Transactions on Sensor Networks 16(3):1–27

    Article  Google Scholar 

  35. Liu HH, Hsu SC, Huang CL (2014) Single-sample-per-person-based face recognition using fast discriminative multi-manifold analysis. In: Signal and information processing association annual summit and conference (APSIPA), 2014 Asia-Pacific. IEEE, Chiang Mai, pp 1–9

  36. Lu J, Plataniotis KN (2002) Boosting face recognition on a large-scale database. In: Proceedings. international conference on image processing, vol 2, pp II–II

  37. Lu J, Tan YP, Wang G (2013) Discriminative multi-manifold analysis for face recognition from a single training sample per person. IEEE Trans Pattern Anal Mach Intel 35(1):39–51

    Article  Google Scholar 

  38. Martinez A (2002) Recognizing imprecisely localized, partially occluded, and expression variant faces from a single sample per class. IEEE Trans Pattern Anal Mach Intell 24(6):748–763

    Article  Google Scholar 

  39. Milborrow S, Morkel J, Nicolls F (2010) The MUCT landmarked face database. Pattern Recognition Association of South Africa 201(0)

  40. Min R, Xu S, Cui Z (2019) Single-sample face recognition based on feature expansion. IEEE Access 7:45219–45229

    Article  Google Scholar 

  41. Moussa M, Hmila M, Douik A (2018) A novel face recognition approach based on genetic algorithm optimization. Studies in Informatics and Control 27(1)

  42. Nikan F, Hassanpour H (2020) Face recognition using non-negative matrix factorization with a single sample per person in a large database. Multimed Tools Appl 79:28265–28276

    Article  Google Scholar 

  43. Nikolaus R (2007) Learning the parts of objects using non-negative matrix factorization (nmf). MMer Team

  44. Otto C, Wang D, Jain AK (2016) Clustering millions of faces by identity. arXiv:1604.00989 [cs]

  45. Pan J, Wang XS, Cheng YH (2016) Single-sample face recognition based on LPP feature transfer. IEEE Access 4:2873–2884

    Article  Google Scholar 

  46. Perronnin F, Dugelay JL (2005) Clustering face images with application to image retrieval in large databases, p 256. Orlando, Florida, USA

  47. Phillips PJ, Moon H, Rizvi SA, Rauss PJ (1999) The FERET evaluation methodology for face-recognition algorithms. IEEE Trans Pattern Anal Mach Intel 22(10):1090–1104

    Article  Google Scholar 

  48. Qx G, Zhang L, Zhang D (2008) Face recognition using FLDA with single training image per person. Appl Math Comput 205(2):726–734

    MATH  Google Scholar 

  49. Reza AM (2004) Realization of the contrast limited adaptive histogram equalization (CLAHE) for real-time image enhancement. The Journal of VLSI Signal Processing-Systems for Signal, Image, and Video Technology 38(1):35–44

    Article  Google Scholar 

  50. Rosten E, Drummond T (2006) Machine learning for high-speed corner detection. In: Computer vision – ECCV 2006, vol 3951. Springer Berlin, Heidelberg, pp 430–443

  51. Schroff F, Kalenichenko D, Philbin J (2015) Facenet: a unified embedding for face recognition and clustering. In: 2015 IEEE conference on computer vision and pattern recognition (CVPR). IEEE, Boston, pp 815–823

  52. Shi J, Tomasi C (1994) Good features to track. In: Proceedings of IEEE conference on computer vision and pattern recognition CVPR-94. IEEE Comput. Soc. Press, Seattle, pp 593–600

  53. Simonyan K, Parkhi O, Vedaldi A, Zisserman A (2013) Fisher vector faces in the wild. In: Proceedings of the British machine vision conference 2013. British Machine Vision Association, Bristol, pp 8.1–8.11

  54. Sireesha V, Latha L, Anuradha A, Kumar NP (2019) Histogram equalization techniques in image enhancement. J Info Tech Softw Eng 09((01)):254

    Google Scholar 

  55. Sun Y, Wang X, Tang X (2014) Deep learning face representation from predicting 10,000 classes. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR)

  56. Sun L, Zhao C, Yan Z, Liu P, Duckett T, Stolkin R (2019) A novel weakly-supervised approach for RGB-D-based nuclear waste object detection. IEEE Sensors J 19(9):3487–3500

    Article  Google Scholar 

  57. Taigman Y, Yang M, Ranzato M, Wolf L (2014) Deepface: closing the gap to human-level performance in face verification. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR)

  58. Taskiran M, Kahraman N, Erdem CE (2020) Face recognition: past, present and future (a review). Digit Signal Process 106:102809

    Article  Google Scholar 

  59. Thomaz CE, Giraldi GA (2010) A new ranking method for principal components analysis and its application to face image analysis. Image Vis Comput 28 (6):902–913

    Article  Google Scholar 

  60. Tuncer T, Dogan S, Abdar M, Pławiak P (2020) A novel facial image recognition method based on perceptual hash using quintet triple binary pattern. Multimedia Tools and Applications

  61. Turk M, Pentland A (1991) Eigenfaces for recognition. J Cogn Neurosci 3(1):71–86

    Article  Google Scholar 

  62. Viola P, Jones M (2001) Rapid object detection using a boosted cascade of simple features. In: Proceedings of the 2001 IEEE computer society conference on computer vision and pattern recognition. CVPR 2001, vol 1. IEEE Comput. Soc, Kauai, pp I–511–I–518

  63. Wang H, Schmid C (2013) Action recognition with improved trajectories. In: 2013 IEEE international conference on computer vision. IEEE, Sydney, pp 3551–3558

  64. Wild S, Curry J, Dougherty A (2004) Improving non-negative matrix factorizations through structured initialization. Pattern Recogn 37 (11):2217–2232

    Article  Google Scholar 

  65. Wu B, Liu Z, Yuan Z, Sun G, Wu C (2017) Reducing overfitting in deep convolutional neural networks using redundancy regularizer. In: Lintas A, Rovetta S, Verschure PF, Villa AE (eds) Artificial neural networks and machine learning – ICANN 2017, vol 10614. Springer International Publishing, Cham, pp 49–55

  66. Xi M (2015) Local binary patter network: a deep learning approach for face recognition. In: 2016 IEEE international conference on Image processing (ICIP), pp 3224–3228

  67. Xin M, Zhou Y, Yan J (2015) Single sample face recognition using lgbp and locality preserving discriminant analysis. Applied Mathematics & Information Sciences 9:353–360

    Article  Google Scholar 

  68. Yang H, Wang XA (2016) Cascade classifier for face detection. J Algorithms Comput Tech 10(3):187–197

    Article  MathSciNet  Google Scholar 

  69. Yang M, Van L, Zhang L (2013) Sparse variation dictionary learning for face recognition with a single training sample per person. In: 2013 IEEE international conference on computer vision. IEEE, Sydney, pp 689–696

  70. Yang M, Wen W, Wang X, Shen L, Gao G (2020) Adaptive convolution local and global learning for class-level joint representation of facial recognition with a single sample per data subject. IEEE Trans Info Forensics Secur 15:2469–2484

    Article  Google Scholar 

  71. Zeng J, Zhao X, Gan J, Mai C, Zhai Y, Wang F (2018) Deep convolutional neural network used in single sample per person face recognition. Comput Intell Neurosci 2018:1–11

    Article  Google Scholar 

  72. Zhang D, Chen S, Zhou ZH (2005) A new face recognition method based on SVD perturbation for single example image per person. Appl Math Comput 163(2):895–907

    Article  MathSciNet  Google Scholar 

  73. Zhang K, Zhang Z, Li Z, Qiao Y (2016) Joint face detection and alignment using multitask cascaded convolutional networks. IEEE Signal Process Lett 23(10):1499–1503

    Article  Google Scholar 

  74. Zhong S, Ghosh J (2003) Model-based clustering with soft balancing. In: The 3rd IEEE international conference on data mining (ICDM), pp 459–466

  75. Zhou H, Yuan Y, Shi C (2009) Object tracking using SIFT features and mean shift. Comput Vis Image Underst 113(3):345–352

    Article  Google Scholar 

  76. Zhou E, Cao Z, Yin Q (2015) Naive-deep face recognition: touching the limit of LFW benchmark or not? arXiv:1501.04690

Download references

Author information

Authors and Affiliations

  1. Shahrood University of Technology, Shahrood, Semnan, Iran

    Navid Abbaspoor & Hamid Hassanpour

Authors
  1. Navid Abbaspoor
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hamid Hassanpour
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hamid Hassanpour.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Abbaspoor, N., Hassanpour, H. Face recognition in a large dataset using a hierarchical classifier. Multimed Tools Appl 81, 16477–16495 (2022). https://doi.org/10.1007/s11042-022-12382-5

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-022-12382-5

Keywords

Search

Navigation