Skip to main content
SpringerLink
Log in

Fusing structure and color features for cancelable face recognition

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Face-based biometric recognition is widely used nowadays, where substantial face images are commonly stored on third-party servers. Since the sensitive information of an individual is contained in facial image such as the age and health condition, it is necessary to protect its privacy and security. This paper investigates a cancelable color face template protection algorithm. To make full use of quaternion representation, the structural information including local variance and gradient is respectively served as the real part. To achieve revocability and ability to redistribute, the strategy of random permutation with binary matrix is adopted. Afterwards, the quaternion-based two-dimensional principal component analysis is employed to extract features. With them, the extreme learning machine can be trained and used for recognition. Experimental results performed on four different color face datasets have demonstrated that the fusion of structural information can greatly improve the accuracy. More importantly, the random permutation not only does not reduce the recognition accuracy, but also guarantees the security and revocation of face template.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  1. <Aberdeen face dataset> 2020 http://pics.stir.ac.uk/2D_face_sets.htm

  2. Bao S, Song X, Hu G, Yang X, Wang C (2019) Colour face recognition using fuzzy quaternion-based discriminant analysis. Int J Mach Learn & Cyber 10:385–395

    Article  Google Scholar 

  3. Barni M, Droandi G, Lazzeretti R (2015) Privacy protection in biometric-based recognition systems: a marriage between cryptography and signal processing. IEEE Signal Process Mag 32(5):66–76

    Article  Google Scholar 

  4. Dantcheva A, Chen C, Ross A (2012) Can facial cosmetics affect the matching accuracy of face recognition systems? In: 2012 IEEE Fifth Int Conf Biom: Theory, Appl Syst, 391-398.

  5. Dantcheva A, Elia P, Ross A (2016) What else does your biometric data reveal? A survey on soft biometrics. IEEE Trans Inf Foren Sec 11(3):441–467

    Article  Google Scholar 

  6. Ding SF, Zhao H, Zhang YN, Xu XZ, Nie R (2015) Extreme learning machine: algorithm, theory and applications. Artif Intell Rev 44(1):103–115

    Article  Google Scholar 

  7. Fan X, Xiang C, Chen C, Yang P, Gong L, Song X, Nanda P, He X (2020) BuildSenSys: reusing building sensing data for traffic prediction with cross-domain learning. IEEE Trans Mob Comput, https://doi.org/10.1109/TMC.2020.2976936

  8. <Georgia Tech face dataset > 2020 http://www.anefian.com/research/face_reco.htm

  9. Gomez-Barrero M, Maiorana E, Galbally J, Campisi P, Fierrez J (2017) Multi-biometric template protection based on homomorphic encryption. Pattern Recogn 67(C):149–163

    Article  Google Scholar 

  10. Hu GQ, Xiao D, Xiang T, Bai S, Zhang YS (2017) A compressive sensing based privacy preserving outsourcing of image storage and identity authentication service in cloud. Inf Sci 387:132–145

    Article  Google Scholar 

  11. Jiang R, Bouridane A, Crookes D, Celebi ME, Wei HL (2016) Privacy-protected facial biometric verification using fuzzy forest learning. IEEE Trans Fuzzy Syst 24(4):779–790

    Article  Google Scholar 

  12. Jiang R, Ho ATS, Cheheb I, Al-Maadeed N, Al-Maadeed S, Bouridane A (2017) Emotion recognition from scrambled facial images via many graph embedding. Pattern Recogn 67(C):245–251

    Article  Google Scholar 

  13. Kaur H, Khanna P (2017) Cancelable features using log-Gabor filters for biometric authentication. Multimed Tools Appl 76(4):4673–4694

    Article  Google Scholar 

  14. Kim Y, Teoh AB, Toh K (2010) A performance driven methodology for cancelable face templates generation. Pattern Recogn 43(7):2544–2559

    Article  Google Scholar 

  15. Kumar N, Rawat M (2020) RP-LPP: a random permutation based locality preserving projection for cancelable biometric recognition. Multimed Tools Appl 79:2363–2381

    Article  Google Scholar 

  16. Kumar N, Singh S, Kumar A (2018) Random permutation principal component analysis for cancelable biometric recognition. Appl Intell 48(9):2824–2836

    Article  Google Scholar 

  17. Lan RS, Zhou YC (2016) Quaternion-Michelson descriptor for color image classification. IEEE Trans Image Process 25(11):5281–5292

    Article  MathSciNet  Google Scholar 

  18. Lan RS, Zhou YC, Tang YY (2016) Quaternionic local ranking binary pattern: a local descriptor of color images. IEEE Trans Image Process 25(2):566–579

    Article  MathSciNet  Google Scholar 

  19. Leng L, Teoh ABJ (2015) Alignment-free row-co-occurrence cancelable palmprint fuzzy vault. Pattern Recogn 48(7):2290–2303

    Article  Google Scholar 

  20. Leng L, Zhang JS (2011) Dual-key-binding cancelable palmprint cryptosystem for palmprint protection and information security. J Netw Comput Appl 34:1979–1989

    Article  Google Scholar 

  21. Leng L, Zhang JS (2012) PalmHash Code for palmprint verification and protection. In: 2012 25th IEEE Canadian conference on electrical and computer engineering, https://doi.org/10.1109/CCECE.2012.6334853

  22. Leng L, Zhang JS (2013) PalmHash code vs. PalmPhasor Code Neurocomputing 108:1–12

    Article  Google Scholar 

  23. Leng L, Zhang JS, Khan MK, Chen X, Alghathbar K (2010) Dynamic weighted discrimination power analysis: a novel approach for face and palmprint recognition in DCT domain. International Journal of the Physical Sciences 5(17):2543–2554

    Google Scholar 

  24. Leng L, Zhang JS, Chen G, Khan MK, Alghathbar K (2011) Two-directional two-dimensional random projection and its variations for face and palmprint recognition. In: 2011 International Conference on Computational Science and Its Applications, pp. 458-470.

  25. Leng L, Zhang S, Bi X, Khan MK (2012) Two-dimensional cancelable biometric scheme. In: 2012 International conference on wavelet analysis and pattern recognition, https://doi.org/10.1109/ICWAPR.2012.6294772

  26. Leng L, Li M, Teoh AB (2013) Conjugate 2DPalmHash code for secure palm-print-vein verification. In: International congress on image and signal processing, pp.1705-1710.

  27. Leng L, Teoh ABJ, Li M, Khan MK (2014) Analysis of correlation of 2DPalmHash code and orientation range suitable for transposition. Neurocomputing 131:377–387

    Article  Google Scholar 

  28. Leng L, Teoh ABJ, Li M, Khan MK (2015) Orientation range of transposition for vertical correlation suppression of 2DPalmPhasor code. Multimed Tools Appl 74(24):11683–11701

    Article  Google Scholar 

  29. Leng L, Teoh ABJ, Li M, Khan MK (2015) A remote cancelable palmprint authentication protocol based on multi-directional two-dimensional PalmPhasor-fusion. Secur Commun Netw 7(11):1860–1871

    Article  Google Scholar 

  30. Leng L, Li M, Kim C, Bi X (2017) Dual-source discrimination power analysis for multi-instance contactless palmprint recognition. Multimed Tools Appl 76:333–354

    Article  Google Scholar 

  31. Leng L, Teoh AB, Li M (2017) Simplified 2DPalmHash code for secure palmprint verification. Multimed Tools Appl 76(6):8373–8398

    Article  Google Scholar 

  32. Li Y, Zou B, Deng S, Zhou G (2020) Using feature fusion strategies in continuous authentication on smartphones. IEEE Internet Comput 24(2):49–56

    Article  Google Scholar 

  33. Liu ZH, Qiu Y, Peng YL, Pu JX, Zhang XL (2017) Quaternion based maximum margin criterion method for color face recognition. Neural Process Lett 45(3):913–923

    Article  Google Scholar 

  34. Liu LC, Li ST, Chen CLP (2017) Quaternion locality-constrained coding for color face hallucination. IEEE Trans Cybernetics 48(5):1474–1485

    Article  Google Scholar 

  35. Mai GC, Lim MH, Yuen PC (2017) Binary feature fusion for discriminative and secure multi-biometric cryptosystems. Image Vis Comput 58:254–265

    Article  Google Scholar 

  36. Martin K, Lu HP, Bui F, Plataniotis KN (2009) A biometric encryption system for the self-exclusion scenario of face recognition. IEEE Syst J 3(4):440–450

    Article  Google Scholar 

  37. Natgunanathan I, Mehmood A, Xiang Y, Hua G, Li G, Bangay S (2018) An overview of protection of privacy in multibiometrics. Multimed Tools Appl 77(6):6753–6773

    Article  Google Scholar 

  38. <Near Infrared-Visible Light face dataset > 2020 http://biometrics.idealtest.org/

  39. Patel VM, Ratha NK, Chellappa R (2015) Cancelable biometrics: a review. IEEE Signal Process Mag 32(5):54–65

    Article  Google Scholar 

  40. Rahulamathavan Y, Phan RCW, Chambers JA, Parish DJ (2013) Facial expression recognition in the encrypted domain based on local fisher discriminant analysis. IEEE Trans Affect Comput 4(1):83–92

    Article  Google Scholar 

  41. Savvides M, Kumar BVKV, Khosla PK (2004) Cancelable biometric filters for face recognition. Proc Int Conf Pattern Recognition, In, pp 922–925

    Google Scholar 

  42. Soliman RF, El Banby GM, Algarni AD, Elsheikh M, Soliman NF, Amin M, Abd El-Samie FE (2018) Double random phase encoding for cancelable face and iris recognition. Appl Opt 57(35):10305–10316

    Article  Google Scholar 

  43. Sun YF, Chen SY, Yin BC (2011) Color face recognition based on quaternion matrix representation. Pattern Recogn Lett 32(4):597–605

    Article  Google Scholar 

  44. Taheri M, Mozaffari S, Keshavarzi P (2015) Cancelable face verification using optical encryption and authentication. J Opt Soc Am A 32(10):1772–1779

    Article  Google Scholar 

  45. Wang Y, Wang YQ, Gu HJ, Zhao XH (2014) Color image quality assessment method based on full quaternion structure similarity measure. Journal of Optoelectronics Laser 10:2033–2043

    Google Scholar 

  46. Xu Y (2012) Quaternion-based discriminant analysis method for color face recognition. PLoS One 7(8):e43493

    Article  Google Scholar 

  47. Yue J, Liu GJ, Fu H (2019) Color image quality assessment based on quaternion spectral residual. Laser & Optoelectronics Progress 56(3):031009

    Article  Google Scholar 

  48. Zangeneh E, Rahmati M, Mohsenzadeh Y (2020) Low resolution face recognition using a two-branch deep convolutional neural network architecture. Expert Syst Appl 139:112854

    Article  Google Scholar 

  49. Zou CM, Kou KI, Wang YL (2016) Quaternion collaborative and sparse representation with application to color face recognition. IEEE Trans Image Process 25(7):3287–3302

    Article  MathSciNet  Google Scholar 

Download references

Acknowledgements

This work was supported by the National Natural Science Foundation of China (61876112, 61601311, 61901537), Beijing Natural Science Foundation (L201022) Project of Beijing Excellent Talents (2016000020124G088) and Beijing Municipal Education Research Plan Project (SQKM201810028018).

Author information

Authors and Affiliations

  1. College of Information Engineering, Capital Normal University, Beijing, 100048, China

    Zihan Xu, Zhuhong Shao, Yuanyuan Shang, Hui Ding & Tie Liu

  2. Beijing Advanced Innovation Center for Imaging Technology, Beijing, 100048, China

    Yuanyuan Shang

  3. School of Electronic and Information Engineering, Zhongyuan University of Technology, Zhengzhou, 450007, China

    Bicao Li

Authors
  1. Zihan Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Zhuhong Shao
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yuanyuan Shang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Bicao Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Hui Ding
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Tie Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zhuhong Shao.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Xu, Z., Shao, Z., Shang, Y. et al. Fusing structure and color features for cancelable face recognition. Multimed Tools Appl 80, 14477–14494 (2021). https://doi.org/10.1007/s11042-020-10234-8

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-020-10234-8

Keywords

Search

Navigation