Skip to main content
SpringerLink
Log in

Face anti-spoofing with generated near-infrared images

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Reflection differences between live faces and spoof faces under near-infrared spectrum make near-infrared image based methods obtain superior performance for face anti-spoofing. However, for conventional face recognition systems, near-infrared image based methods need additional near-infrared equipment to capture the input near-infrared images. In this paper, we propose a novel face anti-spoofing method which exploits the clues in both visible light (VIS) images and near-infrared (NIR) images without utilizing any near-infrared equipment during testing. Specifically, we first propose a novel multiple categories image translation generative adversarial network (MCT-GAN) which generates corresponding NIR images for VIS live and spoof face images. Then we utilize convolution neural network to learn fusing features from both VIS images and corresponding generated NIR images for the goal of live and spoof face classification. Qualitative and quantitative experiments demonstrate that our method obtains excellent results compared to the state-of-the-art methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. Abadi M, Agarwal A, Barham P, Brevdo E, Chen Z, Citro C, Corrado GS, Davis A, Dean J, Devin M et al (2016) Tensorflow: Large-scale machine learning on heterogeneous distributed systems, arXiv:1603.04467

  2. Akhtar Z, Micheloni C, Foresti GL (2015) Biometric liveness detection: Challenges and research opportunities. IEEE Secur Priv 13(5):63–72

    Google Scholar 

  3. Akhtar Z, Foresti GL (2016) Face spoof attack recognition using discriminative image patches. Journal of Electrical and Computer Engineering 2016

  4. Antipov G, Baccouche M, Dugelay J-L (2017) Face aging with conditional generative adversarial networks. In: 2017 IEEE international conference on image processing (ICIP). IEEE, pp 2089–2093

  5. Atoum Y, Liu Y, Jourabloo A, Liu X (2017) Face anti-spoofing using patch and depth-based cnns. In: 2017 IEEE International Joint Conference on Biometrics. IEEE, pp 319–328

  6. Benlamoudi A, Aiadi KE, Ouafi A, Samai D, Oussalah M (2017) Face antispoofing based on frame difference and multilevel representation. J Electron Imaging 26(4),:043007

  7. Boulkenafet Z, Komulainen J, Hadid A (2015) Face anti-spoofing based on color texture analysis. In: 2015 IEEE international conference on image processing (ICIP). IEEE, pp 2636–2640

  8. Boulkenafet Z, Komulainen J, Hadid A (2016) Face spoofing detection using colour texture analysis. IEEE Trans Inf Forensic Secur 11(8):1818–1830

    Google Scholar 

  9. Chakraborty S, Das D (2014) An overview of face liveness detection. Int Jo Inf Theory 3(2):11–25

    Google Scholar 

  10. Chan PP, Liu W, Chen D, Yeung DS, Zhang F, Wang X, Hsu C-C (2018) Face liveness detection using a flash against 2d spoofing attack. IEEE Trans Inf Forensic Secur 13(2):521–534

    Google Scholar 

  11. Chingovska I, Anjos A, Marcel S (2012) On the effectiveness of local binary patterns in face anti-spoofing. In: Proceedings of the 11th International Conference of the Biometrics Special Interes Group, no. EPFL-CONF-192369

  12. Choi Y, Choi M, Kim M, Ha J-W, Kim S, Choo J (2018) Stargan: Unified generative adversarial networks for multi-domain image-to-image translation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 8789–8797

  13. de Freitas Pereira T, Anjos A, De Martino JM, Marcel S (2013) Can face anti-spoofing countermeasures work in a real world scenario?. In: 2013 International Conference on Biometrics (ICB). IEEE, pp 1–8

  14. de Freitas Pereira T, Komulainen J, Anjos A, De Martino JM, Hadid A, Pietikäinen M., Marcel S (2014) Face liveness detection using dynamic texture. EURASIP J Image Video Process 2014(1):2

    Google Scholar 

  15. Fan D-P, Zhang S, Wu Y-H, Liu Y, Cheng M-M, Ren B, Rosin PL, Ji R (2019) Scoot: A perceptual metric for facial sketches. In: Proceedings of the IEEE International Conference on Computer Vision, pp 5612–5622

  16. Feng L, Po L-M, Li Y, Xu X, Yuan F, Cheung TC-H, Cheung K-W (2016) Integration of image quality and motion cues for face anti-spoofing: a neural network approach. J Vis Commun Image Represent 38:451–460

    Google Scholar 

  17. Galbally J, Marcel S, Fierrez J (2014) Image quality assessment for fake biometric detection: Application to iris, fingerprint, and face recognition. IEEE Trans Image Process 23(2):710–724

    MathSciNet  MATH  Google Scholar 

  18. Gatys LA, Ecker AS, Bethge M (2015) A neural algorithm of artistic style. Computer Science

  19. Goodfellow IJ, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y (2014) Generative adversarial nets. In: International Conference on Neural Information Processing Systems, pp 2672–2680

  20. Gretton A, Sejdinovic D, Strathmann H, Balakrishnan S, Pontil M, Fukumizu K, Sriperumbudur BK (2012) Optimal kernel choice for large-scale two-sample tests. In:Advances in neural information processing systems, pp 1205–1213

  21. Hernandez-Ortega J, Fierrez J, Morales A, Tome P (2018) Time analysis of pulse-based face anti-spoofing in visible and nir. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp 544–552

  22. Isola P, Zhu J-Y, Zhou T, Efros AA (2017) Image-to-image translation with conditional adversarial networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1125–1134

  23. Jourabloo A, Liu Y, Liu X (2018) Face de-spoofing: Anti-spoofing via noise modeling. In: Proceedings of the European Conference on Computer Vision (ECCV), 2018, pp 290–306

  24. Kant C, Sharma N (2013) Fake face recognition using fusion of thermal imaging and skin elasticity. Int J Comput Sci Commun 4:65–72

    Google Scholar 

  25. Kim Y, Na J, Yoon S, Yi J (2009) Masked fake face detection using radiance measurements. J Opt Soc Am 26(4):760–766

    Google Scholar 

  26. Kim T, Cha M, Kim H, Lee JK, Kim J (2017) Learning to discover cross-domain relations with generative adversarial networks. In: Proceedings of the 34th International Conference on Machine Learning. JMLR. org, pp 1857–1865

  27. Kollreider K, Fronthaler H, Bigun J (2009) Non-intrusive liveness detection by face images. Image Vis Comput 27(3):233–244

    Google Scholar 

  28. Li L, Feng X, Boulkenafet Z, Xia Z, Li M, Hadid A (2016) An original face anti-spoofing approach using partial convolutional neural network. In: 2016 6th international conference on Image processing theory tools and applications. IEEE, pp 1–6

  29. Li H, He P, Wang S, Rocha A, Jiang X, Kot AC (2018) Learning generalized deep feature representation for face anti-spoofing. IEEE Trans Inf Forensic Secur 13(10):2639–2652

    Google Scholar 

  30. Li H, Li W, Cao H, Wang S, Huang F, Kot AC (2018) Unsupervised domain adaptation for face anti-spoofing. IEEE Trans Inf Forensic Secur 13(7):1794–1809

    Google Scholar 

  31. Li L, Feng X (2019) Face anti-spoofing via deep local binary pattern. In: Deep Learning in Object Detection and Recognition. Springer, pp 91–111

  32. Liu M-Y, Breuel T, Kautz J (2017) Unsupervised image-to-image translation networks. In: Advances in Neural Information Processing Systems, pp 700–708

  33. Liu S-Q, Lan X, Yuen PC (2018) Remote photoplethysmography correspondence feature for 3d mask face presentation attack detection. In: Proceedings of the European Conference on Computer Vision (ECCV), pp 558–573

  34. Liu Y, Jourabloo A, Liu X (2018) Learning deep models for face anti-spoofing: Binary or auxiliary supervision. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 389–398

  35. Määttä J, Hadid A, Pietikäinen M (2011) Face spoofing detection from single images using micro-texture analysis. In: 2011 international joint conference on Biometrics (IJCB). IEEE, pp 1–7

  36. Menotti D, Chiachia G, Pinto A, Schwartz WR, Pedrini H, Falcao AX, Rocha A (2017) Deep representations for iris, face, and fingerprint spoofing detection. IEEE Trans Inf Forensic Secur 10(4):864–879

    Google Scholar 

  37. Nowara EM, Sabharwal A, Veeraraghavan A (2017) Ppgsecure: Biometric presentation attack detection using photopletysmograms. In: 2017 12th IEEE International Conference on Automatic Face and Gesture Recognition. IEEE, pp 56–62

  38. Ojala T, Pietikainen M, Maenpaa T (2002) Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans Pattern Anal Mach Intell 24(7):971–987

    MATH  Google Scholar 

  39. Pan G, Sun L, Wu Z, Lao S (2007) Eyeblink-based anti-spoofing in face recognition from a generic webcamera. In: 11th International Conference on Computer Vision. IEEE, pp 1–8

  40. Poh M. -Z., McDuff DJ, Picard RW (2011) Advancements in noncontact, multiparameter physiological measurements using a webcam. IEEE Trans Biomed Eng 58(1):7–11

    Google Scholar 

  41. Raghavendra R, Raja KB, Busch C (2015) Presentation attack detection for face recognition using light field camera. IEEE Trans Image Process 24(3):1060–1075

    MathSciNet  MATH  Google Scholar 

  42. Raghavendra R, Raja KB, Venkatesh S, Busch C (2017) Face presentation attack detection by exploring spectral signatures. In: 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops. IEEE, pp 672–679

  43. Souza L, Pamplona M, Oliveira L, Papa J (2017) How far did we get in face spoofing detection? Engineering Applications of Artificial Intelligence 72:368–381

  44. Steiner H, Kolb A, Jung N (2016) Reliable face anti-spoofing using multispectral swir imaging. In: 2016 International Conference on Biometrics (ICB). IEEE, pp 1–8

  45. Sun X, Huang L, Liu C (2016) Context based face spoofing detection using active near-infrared images. In: 2016 23rd International Conference on Pattern Recognition (ICPR). IEEE, pp 4262–4267

  46. Tirunagari S, Poh N, Windridge D, Iorliam A, Suki N, Ho AT (2015) Detection of face spoofing using visual dynamics. IEEE Trans Inf Forensic Secur 10 (4):762–777

    Google Scholar 

  47. Tran L, Yin X, Liu X (2018) Representation learning by rotating your faces. IEEE Trans Pattern Anal Mach Intell 41(12):3007–3021

    Google Scholar 

  48. Tu X, Fang Y (2017) Ultra-deep neural network for face anti-spoofing. In: International Conference on Neural Information Processing. Springer, pp 686–695

  49. Wang S-Y, Yang S-H, Chen Y-P, Huang J-W (2017) Face liveness detection based on skin blood flow analysis. Symmetry 9(12):305

    Google Scholar 

  50. Wang Y, Nian F, Li T, Meng Z, Wang K (2017) Robust face anti-spoofing with depth information. J Vis Commun Image Represent 49:332–337

    Google Scholar 

  51. Wen D, Han H, Jain AK (2015) Face spoof detection with image distortion analysis. IEEE Trans Inf Forensic Secur 10(4):746–761

    Google Scholar 

  52. Yang J, Lei Z, Liao S, Li SZ (2013) Face liveness detection with component dependent descriptor. Int Conf Biom 1:2

    Google Scholar 

  53. Yang J, Lei Z, Li SZ (2014) Learn convolutional neural network for face anti-spoofing. Comput Sci 9218:373–384

    Google Scholar 

  54. Yi D, Lei Z, Zhang Z, Li SZ (2014) Face anti-spoofing: Multi-spectral approach. In: Handbook of Biometric Anti-Spoofing. Springer, pp 83–102

  55. Yi Z, Zhang HR, Tan P, Gong M (2017) Dualgan: Unsupervised dual learning for image-to-image translation. Inproceedings of the IEEE international conference on computer vision, pp 2868–2876

  56. Zhang S, Gao X, Wang N, Li J (2015) Robust face sketch style synthesis. IEEE Trans Image Process 25(1):220–232

    MathSciNet  MATH  Google Scholar 

  57. Zhang Z, Yi D, Lei Z, Li SZ (2011) Face liveness detection by learning multispectral reflectance distributions. In: 2011 IEEE International Conference on Automatic Face and Gesture Recognition and Workshops. IEEE, pp 436–441

  58. Zhang K, Zhang Z, Li Z, Qiao Y (2016) Joint face detection and alignment using multitask cascaded convolutional networks. IEEE Signal Process Lett 23(10):1499–1503

    Google Scholar 

  59. Zhang Z, Yan J, Liu S, Lei Z, Yi D, Li SZ (2012) A face antispoofing database with diverse attacks. In: 2012 5th IAPR international conference on Biometrics (ICB). IEEE, pp 26–31

  60. Zhu J-Y, Park T, Isola P, Efros AA (2017) Unpaired image-to-image translation using cycle-consistent adversarial networks. In: Proceedings of the IEEE international conference on computer vision, pp 2223–2232

Download references

Acknowledgments

This work is funded by National Key Research and Development Program of China(2018YFC0808300), National Natural Science Foundation of China (Grant No. 61806185, 61802361)

Author information

Authors and Affiliations

  1. Chongqing Institute of Green and Intelligent Technology, Chinese Academy of Sciences, Chongqing, 400714, China

    Fangling Jiang, Pengcheng Liu, Xiaohu Shao & Xiangdong Zhou

  2. University of Chinese Academy of Sciences, Beijing, 100049, China

    Fangling Jiang

Authors
  1. Fangling Jiang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Pengcheng Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Xiaohu Shao
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Xiangdong Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Fangling Jiang.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jiang, F., Liu, P., Shao, X. et al. Face anti-spoofing with generated near-infrared images. Multimed Tools Appl 79, 21299–21323 (2020). https://doi.org/10.1007/s11042-020-08952-0

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-020-08952-0

Keywords

Search

Navigation