Skip to main content

Advertisement

SpringerLink
Log in

Pose-invariant features and personalized correspondence learning for face recognition

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

In surveillance systems, face recognition plays an important role for human identification. In such systems, human faces are spatially unconstrained, which results in a significant change in pose, and face recognition becomes more challenging when only one frontal image of the face has been registered in the gallery. In this study, we attempt to solve the problem where only one frontal image of the face is registered in the gallery, and the probe faces are captured in unconstrained poses. The face likelihood is measured using pose-invariant features of scale-invariant feature transform (SIFT) and personalized correspondence learning method. A generic correspondence is first learned between the poses, and the pose-invariant SIFT is fulfilled by extracting the keypoints on virtual patches that are generated by a generic correspondence with the pose variation. The generic correspondence is further personalized to fit each subject, and the learning error of the personalized correspondence is combined with pose-invariant SIFT to measure the face likelihood. The experimental results indicated that our proposed algorithm achieved an average performance of 95% across poses within \(40^\circ\), which is better than other well-known algorithms.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  1. Ahonen T, Hadid A, Pietikainen M (2006) Face description with local binary patterns: application to face recognition. IEEE Trans Pattern Anal Mach Intell 28(12):2037–2041

    Article  MATH  Google Scholar 

  2. Arashloo SR, Kittler J (2011) Energy normalization for pose-invariant face recognition based on mrf model image matching. IEEE Trans Pattern Anal Mach Intell 33(6):1274–1280

    Article  Google Scholar 

  3. Ashraf AB, Lucey S, Chen T (2008) Learning patch correspondences for improved viewpoint invariant face recognition. In: IEEE Conference on computer vision and pattern recognition 2008. CVPR 2008. IEEE, pp 1–8

  4. Asthana A, Marks TK, Jones MJ, Tieu KH, Rohith M (2011) Fully automatic pose-invariant face recognition via 3d pose normalization. In: 2011 IEEE international conference on computer vision (ICCV). IEEE, pp 937–944

  5. Baker S, Matthews I (2004) Lucas–Kanade 20 years on: a unifying framework. Int J Comput Vis 56(3):221–255

    Article  Google Scholar 

  6. Blanz V, Vetter T (2003) Face recognition based on fitting a 3d morphable model. IEEE Trans Pattern Anal Mach Intell 25(9):1063–1074

    Article  Google Scholar 

  7. Chai X, Shan S, Chen X, Gao W (2007) Locally linear regression for pose-invariant face recognition. IEEE Trans Image Process 16(7):1716–1725

    Article  MathSciNet  Google Scholar 

  8. Chan CH, Tahir MA, Kittler J, Pietikainen M (2013) Multiscale local phase quantization for robust component-based face recognition using kernel fusion of multiple descriptors. IEEE Trans Pattern Anal Mach Intell 35(5):1164–1177

    Article  Google Scholar 

  9. Chen D, Cao X, Wen F, Sun J (2013) Blessing of dimensionality: High-dimensional feature and its efficient compression for face verification. In: 2013 IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 3025–3032

  10. Du H, Zhang X, Hu Q, Hou Y (2015) Sparse representation-based robust face recognition by graph regularized low-rank sparse representation recovery. Neurocomputing 164:220–229

    Article  Google Scholar 

  11. Gao S, Zhang Y, Jia K, Lu J, Zhang Y (2015) Single sample face recognition via learning deep supervised auto-encoders. IEEE Trans Inform Forensics Secur 10(10):2018–2118

    Article  Google Scholar 

  12. Gao Y, Lee HJ (2014) Pose unconstrained face recognition based on sift and alignment error. In: 2014 International conference on audio, language and image processing (ICALIP). IEEE, pp 277–281

  13. Gao Y, Lee HJ (2015) Cross-pose face recognition based on multiple virtual views and alignment error. Pattern Recogn Lett 65:170–176

    Article  Google Scholar 

  14. Gao Y, Leung M, Wang W, Hui SC (2001) Fast face identification under varying pose from a single 2-d model view. IEE Proc Vis Image Sign Process 148(4):248–253

    Article  Google Scholar 

  15. Ho HT, Chellappa R (2013) Pose-invariant face recognition using Markov random fields. IEEE Trans Image Process 22(4):1573–1584

    Article  MathSciNet  MATH  Google Scholar 

  16. Jiang D, Hu Y, Yan S, Zhang L, Zhang H, Gao W (2005) Efficient 3d reconstruction for face recognition. Pattern Recognit 38(6):787–798

    Article  Google Scholar 

  17. Kan M, Shan S, Chang H, Chen X (2014) Stacked progressive auto-encoders (spae) for face recognition across poses. In: 2014 IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 1883–1890

  18. Kan M, Shan S, Zhang H, Lao S, Chen X (2012) Multi-view discriminant analysis. In: Computer Vision–ECCV 2012. Springer, pp 808–821

  19. Li A, Shan S, Chen X, Gao W (2009) Maximizing intra-individual correlations for face recognition across pose differences. In: IEEE conference on computer vision and pattern recognition 2009. CVPR 2009. IEEE, pp 605–611

  20. Li A, Shan S, Gao W (2012) Coupled bias-variance tradeoff for cross-pose face recognition. IEEE Trans Image Process 21(1):305–315

    Article  MathSciNet  MATH  Google Scholar 

  21. Li S, Liu X, Chai X, Zhang H, Lao S, Shan S (2012) Morphable displacement field based image matching for face recognition across pose. In: Computer vision–ECCV 2012. Springer, pp 102–115

  22. Li S, Liu X, Chai X, Zhang H, Lao S, Shan S (2014) Maximal likelihood correspondence estimation for face recognition across pose. IEEE Trans Image Process 23(10):4587–4600

    Article  MathSciNet  MATH  Google Scholar 

  23. Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60(2):91–110

    Article  Google Scholar 

  24. Lu J, Liong VE, Wang G, Moulin P (2015) Joint feature learning for face recognition. IEEE Trans Inform Forensics Secur 10(7):1371–1383

    Article  Google Scholar 

  25. Mikolajczyk K, Schmid C (2004) Scale and affine invariant interest point detectors. Int J Comput Vis 60(1):63–86

    Article  Google Scholar 

  26. Mikolajczyk K, Tuytelaars T, Schmid C, Zisserman A, Matas J, Schaffalitzky F, Kadir T, Van Gool L (2005) A comparison of affine region detectors. Int J Comput Vis 65(1–2):43–72

    Article  Google Scholar 

  27. Morel JM, Yu G (2009) Asift: a new framework for fully affine invariant image comparison. SIAM J Imaging Sci 2(2):438–469

    Article  MathSciNet  MATH  Google Scholar 

  28. Phillips J (2009) Video challenge problem multiple biometric grand challenge preliminary: results of version 2. In: MBGC 3rd workshop

  29. Phillips PJ, Wechsler H, Huang J, Rauss PJ (1998) The FERET database and evaluation procedure for face-recognition algorithms. Image Vis Comput 16(5):295–306

    Article  Google Scholar 

  30. Prabhu U, Heo J, Savvides M (2011) Unconstrained pose-invariant face recognition using 3d generic elastic models. IEEE Trans Pattern Anal Mach Intell 33(10):1952–1961

    Article  Google Scholar 

  31. Prince SJ, Warrell J, Elder JH, Felisberti FM (2008) Tied factor analysis for face recognition across large pose differences. IEEE Trans Pattern Anal Mach Intell 30(6):970–984

    Article  Google Scholar 

  32. Sharma A, Al Haj M, Choi J, Davis LS, Jacobs DW (2012) Robust pose invariant face recognition using coupled latent space discriminant analysis. Comput Vis Image Underst 116(11):1095–1110

    Article  Google Scholar 

  33. Taigman Y, Yang M, Ranzato M, Wolf L (2014) Deepface: closing the gap to human-level performance in face verification. In: 2014 IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 1701–1708

  34. Vetter T, Poggio T (1997) Linear object classes and image synthesis from a single example image. IEEE Trans Pattern Anal Mach Intell 19(7):733–742

    Article  Google Scholar 

  35. Wolf L, Hassner T, Taigman Y (2011) Effective unconstrained face recognition by combining multiple descriptors and learned background statistics. IEEE Trans Pattern Anal Mach Intell 33(10):1978–1990

    Article  Google Scholar 

  36. Wright J, Yang AY, Ganesh A, Sastry SS, Ma Y (2009) Robust face recognition via sparse representation. IEEE Trans Pattern Anal Mach Intell 31(2):210–227

    Article  Google Scholar 

  37. Yang M, Zhang L, Shiu SCK, Zhang D (2013) Robust kernel representation with statistical local features for face recognition. IEEE Trans Neural Netw Learn Syst 24(6):900–912

    Article  Google Scholar 

  38. Zhang W, Shan S, Gao W, Chen X, Zhang H (2005) Local gabor binary pattern histogram sequence (lgbphs): a novel non-statistical model for face representation and recognition. In: Tenth IEEE international conference on computer vision, 2005. ICCV 2005, vol 1. IEEE, pp 786–791

Download references

Acknowledgements

This work was supported by the Brain Korea 21 PLUS Project, National Research Foundation of Korea. This research was supported by Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education (GR 2016R1D1A3B03931911). This research was also supported by the MSIP (Ministry of Science, ICT and Future Planning), Korea, under the ITRC (Information Technology Research Center) support program (IITP-2016-R0992-16-1023) supervised by the IITP (Institute for Information and communications Technology Promotion). This research was supported by Research Base Construction Fund Support Program funded by Chonbuk National University in 2016.

Author information

Authors and Affiliations

  1. Division of Computer Science and Engineering, Chonbuk National University, Jeonju, Republic of Korea

    Yongbin Gao

  2. Division of Computer Science and Engineering, Center for Advanced Image and Information Technology, Chonbuk National University, Jeonju, Republic of Korea

    Hyo Jong Lee

Authors
  1. Yongbin Gao
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hyo Jong Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hyo Jong Lee.

Ethics declarations

Conflicts of interest

The authors declare no conflict of interest. We declare that we do not have any commercial or associative interest that represents a conflict of interest in connection with the work entitled “Pose-invariant features and Personalized Correspondence Learning for Face Recognition”.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Gao, Y., Lee, H.J. Pose-invariant features and personalized correspondence learning for face recognition. Neural Comput & Applic 31 (Suppl 1), 607–616 (2019). https://doi.org/10.1007/s00521-017-3035-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-017-3035-3

Keywords

Search

Navigation