Skip to main content
SpringerLink
Log in

Kinship verification in multi-linear coherent spaces

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Discovering kinship relations from face images in the wild has become an interesting and important problem in multimedia and computer vision. Despite the rapid advances in face analysis in unconstrained environment, kinship verification still remains a challenging problem as the subtle kinship relation is difficult to discover and changes in pose and lighting condition further complicate this task. In this paper, we propose a kinship verification approach based on multi-linear coherent space learning. Local image patches at different scales are independently projected into their corresponding coherent spaces learned by robust canonical correlation analysis such that patch pairs with kinship relations have improved correlation. In addition, most discriminative patches for verification are selected via constrained linear programming. Experimental results on two widely used kinship verification datasets show that the proposed method can effectively identify different kinship relations in image pairs. Compared to state-of-the-art techniques, the proposed method achieves very competitive performance with the use of simple feature descriptors.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. Ahonen T, Hadid A, Pietikainen M (2006) Face description with local binary patterns: application to face recognition. IEEE Trans Pattern Anal Mach Intell 28(12):2037–2041

    Article  MATH  Google Scholar 

  2. Alvergne A, Oda R, Faurie C, Matsumoto-Oda A, Durand V, Raymond M (2009) Cross-cultural perceptions of facial resemblance between kin. J Vis 9(6)

  3. An L, Bhanu B (2014) Face image super-resolution using 2D CCA. Signal Process 103:184–194

    Article  Google Scholar 

  4. An L, Yang S, Bhanu B (2015) Person re-identification by robust canonical correlation analysis. IEEE Sign Process Lett 22(8):1103–1107

    Article  Google Scholar 

  5. Arashloo S, Kittler J (2014) Class-specific kernel fusion of multiple descriptors for face verification using multiscale binarised statistical image features. IEEE Trans Inf Forensic Secur 9(12):2100–2109

    Article  Google Scholar 

  6. Chan CH, Kittler J, Poh N, Ahonen T, Pietikainen M (2009) (multiscale) local phase quantisation histogram discriminant analysis with score normalisation for robust face recognition. In: IEEE 12th international conference on computer vision workshops (ICCV Workshops), pp 633–640

  7. Chang K, Chen C (2015) A learning framework for age rank estimation based on face images with scattering transform. IEEE Trans Image Process 24(3):785–798

    Article  MathSciNet  Google Scholar 

  8. Chen BC, Chen YY, Kuo YH, Hsu W (2013) Scalable face image retrieval using attribute-enhanced sparse codewords. IEEE Trans Multimed 15(5):1163–1173

    Article  Google Scholar 

  9. Chen X, An L, Bhanu B (2013) Improving large-scale face image retrieval using multi-level features. In: IEEE international conference on image processing (ICIP), pp 4367–4371

  10. Chen Y, Wiesel A, Eldar Y, Hero A (2010) Shrinkage algorithms for MMSE covariance estimation. IEEE Trans Signal Process 58(10):5016–5029

    Article  MathSciNet  Google Scholar 

  11. Dal Martello MF, Maloney LT (2006) Where are kin recognition signals in the human face? J Vis 6(12)

  12. Dal Martello MF, Maloney LT (2010) Lateralization of kin recognition signals in the human face. J Vis 10(8)

  13. Dèniz O, Bueno G, Salido J, la Torre FD (2011) Face recognition using histograms of oriented gradients. Pattern Recogn Lett 32(12):1598–1603

    Article  Google Scholar 

  14. Dibeklioglu H, Salah A, Gevers T (2013) Like father, like son: facial expression dynamics for kinship verification. In: IEEE international conference on computer vision (ICCV), pp 1497–1504

  15. Eleftheriadis S, Rudovic O, Pantic M (2015) Discriminative shared gaussian processes for multiview and view-invariant facial expression recognition. IEEE Trans Image Process 24(1):189–204

    Article  MathSciNet  Google Scholar 

  16. Gao Y, Ji R, Liu W, Dai Q, Hua G (2014) Weakly supervised visual dictionary learning by harnessing image attributes. IEEE Trans Image Process 23(12):5400–5411

    Article  MathSciNet  Google Scholar 

  17. Gao Y, Wang M, Zha ZJ, Shen J, Li X, Wu X (2013) Visual-textual joint relevance learning for tag-based social image search. IEEE Trans Image Process 22(1):363–376

    Article  MathSciNet  Google Scholar 

  18. Guo Y, Dibeklioglu H, Van Der Maaten L (2014) Graph-based kinship recognition. In: International Conference on Pattern Recognition (ICPR), pp 4287–4292

  19. He X, Yan S, Hu Y, Niyogi P, Zhang HJ (2005) Face recognition using laplacianfaces. IEEE Trans Pattern Anal Mach Intell 27(3):328–340

    Article  Google Scholar 

  20. Hotelling H (1936) Relations between two sets of variates. Biometrika 28 (3/4):321–377

    Article  MATH  Google Scholar 

  21. Hu J, Lu J, Yuan J, Tan YP (2014) Large margin multi-metric learning for face and kinship verification in the wild. In: Asian conference on computer vision (ACCV)

  22. Huang H, He H, Fan X, Zhang J (2010) Super-resolution of human face image using canonical correlation analysis. Pattern Recog 43(7):2532–2543

    Article  MATH  Google Scholar 

  23. Kafai M, An L, Bhanu B (2014) Reference face graph for face recognition. IEEE Trans Inf Forensic Secur 9(12):2132–2143

    Article  Google Scholar 

  24. Kafai M, Eshghi K, Bhanu B (2014) Discrete cosine transform locality-sensitive hashes for face retrieval. IEEE Trans Multimed 16(4):1090–1103

    Article  Google Scholar 

  25. Kaminski G, Dridi S, Graff C, Gentaz E (2009) Human ability to detect kinship in strangers’ faces: effects of the degree of relatedness. Proc R Soc Lond B Biol Sci 276(1670):3193–3200

    Article  Google Scholar 

  26. Ledoit O, Wolf M (2012) Nonlinear shrinkage estimation of large-dimensional covariance matrices. Ann Stat 40(2):1024–1060

    Article  MathSciNet  MATH  Google Scholar 

  27. Lei Z, Li SZ (2012) Fast multi-scale local phase quantization histogram for face recognition. Pattern Recogn Lett 33(13):1761–1767

    Article  Google Scholar 

  28. Lu J, Hu J, Liong VE, Zhou X, Bottino A, Islam IU, Vieira TF, Qin X, Tan X, Chen S, Mahpod S, Keller Y, Zheng L, Idrissi K, Garcia C, Duffner S, Baskurt A, Castrillon-Santana M, Lorenzo-Navarro J (2015) The FG 2015 kinship verification in the wild evaluation. In: IEEE international conference on automatic face and gesture recognition (FG)

  29. Lu J, Hu J, Zhou X, Shang Y, Tan YP, Wang G (2012) Neighborhood repulsed metric learning for kinship verification. In: IEEE conference on computer vision and pattern recognition (CVPR), pp 2594– 2601

  30. Lu J, Hu J, Zhou X, Zhou J, Castrillon-Santana M, Lorenzo-Navarro J, Kou L, Shang Y, Bottino A, Vieira TF (2014) Kinship verification in the wild: The first kinship verification competition. In: IEEE international joint conference on biometrics (IJCB), pp 1–6

  31. Lu J, Tan YP (2013) Ordinary preserving manifold analysis for human age and head pose estimation. IEEE Transactions on Human-Machine Systems 43(2):249–258

    Article  Google Scholar 

  32. Lu J, Zhou X, Tan YP, Shang Y, Zhou J (2014) Neighborhood repulsed metric learning for kinship verification. IEEE Trans Pattern Anal Mach Intell 36(2):331–345

    Article  Google Scholar 

  33. Meina Kan Shiguang Shan DX, Chen X (2011) Side-information based linear discriminant analysis for face recognition. In: British machine vision conference, pp 125.1–125.0

  34. Somanath G, Kambhamettu C (2012) Can faces verify blood-relations? In: IEEE international conference on biometrics: theory, applications and systems (BTAS), pp 105–112

  35. Taigman Y, Yang M, Ranzato M, Wolf L (2014) Deepface: closing the gap to human-level performance in face verification. In: IEEE conference on computer vision and pattern recognition (CVPR), pp 1701–1708

  36. Tao D, Jin L, Wang Y, Yuan Y, Li X (2013) Person re-identification by regularized smoothing KISS metric learning. IEEE Trans Circuits Syst Video Technol 23(10):1675–1685

    Article  Google Scholar 

  37. Wang H (2010) Local two-dimensional canonical correlation analysis. IEEE Signal Proc Lett 17(11):921–924

    Article  Google Scholar 

  38. Wilson D, Weisburd D, McClure D (2011) Use of dna testing in police investigative work for increasing offender identification, arrest, conviction and case clearance. Campbell Syst Rev 7

  39. Wu L, Jin R, Jain A (2013) Tag completion for image retrieval. IEEE Trans Pattern Anal Mach Intell 35(3):716–727

    Article  Google Scholar 

  40. Yan H, Lu J, Deng W, Zhou X (2014) Discriminative multimetric learning for kinship verification. IEEE Trans Inf Forensic Secur 9(7):1169–1178

    Article  Google Scholar 

  41. Yan H, Lu J, Zhou X (2014) Prototype-based discriminative feature learning for kinship verification. IEEE Trans Cybern PP(99):1–1

    Google Scholar 

  42. Yang S, Bhanu B (2012) Understanding discrete facial expressions in video using an emotion avatar image. IEEE Trans Syst Man Cybern B Cybern 42(4):980–992

    Article  Google Scholar 

  43. Yang W, Yi D, Lei Z, Sang J, Li S (2008) 2D-3D face matching using CCA. In: IEEE international conference on automatic face gesture recognition, pp 1–6

  44. Zhang K, Tao D, Gao X, Li X, Xiong Z (2015) Learning multiple linear mappings for efficient single image super-resolution. IEEE Trans Image Process 24(3):846–861

    Article  MathSciNet  Google Scholar 

  45. Zheng L, Idrissi K, Garcia C, Duffner S, Baskurt A (2015) Triangular similarity metric learning for face verification. In: IEEE international conference on automatic face and gesture recognition (FG)

  46. Zheng W, Zhou X, Zou C, Zhao L (2006) Facial expression recognition using kernel canonical correlation analysis (KCCA). IEEE Trans Neural Networks 17 17(1):233–238

  47. Zhou X, Hu J, Lu J, Shang Y, Guan Y (2011) Kinship verification from facial images under uncontrolled conditions. In: ACM international conference on multimedia, pp 953–956

  48. Zhou X, Lu J, Hu J, Shang Y (2012) Gabor-based gradient orientation pyramid for kinship verification under uncontrolled environments. In: ACM international conference on multimedia, pp 725– 728

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, University of California, Riverside, CA, 92521, USA

    Xiaojing Chen

  2. Department of Electrical and Computer Engineering, University of California, Riverside, CA, 92521, USA

    Le An

  3. College of Electronics and Information Engineering, Sichuan University, Chengdu, 610064, China

    Songfan Yang

  4. School of Electronic Information and Communications, Huazhong University of Science and Technology, Wuhan, 430074, China

    Weimin Wu

Authors
  1. Xiaojing Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Le An
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Songfan Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Weimin Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Weimin Wu.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chen, X., An, L., Yang, S. et al. Kinship verification in multi-linear coherent spaces. Multimed Tools Appl 76, 4105–4122 (2017). https://doi.org/10.1007/s11042-015-2930-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-015-2930-9

Keywords

Search

Navigation