Abstract
The rapid deployment of facial biometric system has raised attention about their vulnerability to presentation attacks (PAs). Currently, due to the feature extraction capability of convolution neural network (CNN), it has achieved excellent results in most multi-modal face anti-spoofing (FAS) algorithms. Similarly, we proposed multi-modal FAS using Channel Cross Fusion Network (CCFN) and Depth-wise Convolution (GDConv), FaceBagNets for short. The CCFN is utilized to cross-fuse multi-modal feature by using the pairwise cross approach before fusing multi-modal feature in the channel direction, and the GDConv replaces the global average pooling (GAP) to raise the performance. We also utilized the patch-based strategy to obtain richer feature, the random model feature erasing (RMFE) strategy to prevent the over-fitting and the squeeze-and-excitation network (SE-NET) to focus on key feature. Finally, we conducted extensive experiments on two multi-modal datasets, then verified the effectiveness of the CCFN and the GDConv. Much advanced results were acquired and outperformed most state-of-the-art methods.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Boulkenafet, Z., Komulainen, J., Hadid, A.: Face antispoofing using speeded-up robust features and fisher vector encoding. IEEE Signal Process. Lett. 24(2), 141–145 (2017)
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the Conference on Computer Vision and Pattern Recognition (CVPR), pp. 770–778 (2016)
Huang, G., Liu, Z., Laurens, V., Weinberger, K. Q.: Densely connected convolutional networks. In: Proceedings of the Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2261–2269 (2017)
Hu, J., Shen, L., Albanie, S., Sun, G., Wu, E.: Squeeze-and-excitation networks. IEEE Trans. Pattern Anal. Mach. Intell. 42(8), 2011–2023 (2020)
Zhang, S., et al.: CASIA-SURF: A large-scale multi-modal benchmark for face anti-spoofing. IEEE Trans. Biometrics, Behav. Identity Sci. 2(2), 182–193 (2020). https://doi.org/10.1109/TBIOM.2020.2973001
Liu, A., Tan, Z., Wan, J., Escalera, S., Guo, G., Li, S.Z.: CASIA-SURF CeFA: A benchmark for multi-modal cross-ethnicity face anti-spoofing. In: Proceedings of the Winter Conference on Applications of Computer Vision (WACV), pp. 1178–1186 (2021)
Chingovska, I., Anjos, A., Marcel, S.: On the effectiveness of local binary patterns in face anti-spoofing. In: Proceedings of the International Conference of the Biometrics Special Interest Group (BIOSIG), pp. 1–7 (2012)
Maatta, J., Hadid, A., Pietikainen, M.: Face spoofing detection from single images using micro-texture analysis. In: Proceedings of the International Joint Conference on Biometrics (IJCB), pp. 1–7 (2011)
Kose, N., Dugelay, J.L.: Reflectance analysis based countermeasure technique to detect face mask attacks. In: Proceedings of the International Conference on Digital Signal Processing (DSP), pp. 1–6 (2013)
Wen, D., Han, H., Jain, A.K.: Face spoof detection with image distortion analysis. IEEE Trans. Inf. Forensics Secur. 10(4), 746–761 (2015). https://doi.org/10.1109/TIFS.2015.2400395
Zhang, Z., Yan, J., Liu, S., Lei, Z., Yi, D., Li, S.Z.: A face antispoofing database with diverse attacks. In: Proceedings of the 2012 5th IAPR International Conference on Biometrics (ICB), pp.26–31. IEEE (2012)
de Freitas Pereira, T., Anjos, A., De Martino, J.M., Marcel, S.: LBP − TOP based countermeasure against face spoofing attacks. In: Proceedings of the Computer Vision Workshops- ACCV 2012, pp. 121–132 (2012)
Li, X., Komulainen, J., Zhao, G., Yuen, P., Pietikainen, M.: Generalized face anti-spoofing by detecting pulse from face videos. In: Proceedings of the 23rd International Conference on Pattern Recognition (ICPR), pp.4244–4249 (2016)
Boulkenafet, Z., Komulainen, J., Hadid, A.: Face spoofing detection using colour texture analysis. IEEE Trans. Inf. Forensics Secur. 11(8), 1818–1830 (2016). https://doi.org/10.1109/TIFS.2016.2555286
Atoum, Y., Liu, Y., Jourabloo, A., Liu, X.: Face anti-spoofing using patch and depth-based CNNs. In: Proceedings of the International Joint Conference on Biometrics (IJCB), pp.319–328 (2017)
Lucena, O., Junior, A., Moia, V., Souza, R., Valle, E., Lotufo, R.: Transfer learning using convolutional neural networks for face anti-spoofing. In: Proceedings of the International Conference Image Analysis and Recognition, pp. 27–34 (2017)
Chen, H., Hu, G., Lei, Z., Chen, Y., Robertson, N.M., Li, S.Z.: Attention-based two-stream convolutional networks for face spoofing detection. IEEE Trans. Inf. Forensics Secur. 15, 578–593 (2020). https://doi.org/10.1109/TIFS.2019.29-22241
Deb, D., Jain, A.K.: Look locally infer globally: A generalizable face anti-spoofing approach. IEEE Trans. Inf. Forensics Secur. 16, 1143–1157 (2021). https://doi.org/10.1109/TIFS.2020.3029879
Heusch, G., George, A., Geissbuhler, D., Mostaani, Z., Marcel, S.: Deep models and shortwave infrared information to detect face presentation attacks. IEEE Trans. Biometrics Behav. Identity Sci. 2(4), 399–409 (2020). https://doi.org/10.1109/TBIOM.2020.3010312
Ma, Y., Wu, L., Li, Z., Liu, F.: A novel face presentation attack detection scheme based on multi-regional convolutional neural networks. Pattern Recogn. Lett. 131, 261–267 (2020). https://doi.org/10.1016/j.patrec.2020.01.002
Hao, H., Pei, M., Zhao, M.: Face liveness detection based on client identity using siamese network. In: Lin, Z., Wang, L., Yang, J., Shi, G., Tan, T., Zheng, N., Chen, X., Zhang, Y. (eds.) PRCV 2019. LNCS, vol. 11857, pp. 172–180. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-31654-9_15
Almeida, W.R., et al.: Detecting face presentation attacks in mobile devices with a patch-based CNN and a sensor-aware loss function. PLoS ONE 15(9), e0238058–e0238058 (2020). https://doi.org/10.1371/journal.pone.0238058
Chen, B., Yang, W., Li, H., Wang, S., Kwong, S.: Camera invariant feature learning for generalized face anti-spoofing. IEEE Trans. Inf. Forensics Secur. 16, 2477–2492 (2021). https://doi.org/10.1109/TIFS.2021.3055018
Parkin, A., Grinchuk, O.: Recognizing multi-modal face spoofing with face recognition networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 1617–1623 (2019)
Shen, T., Huang, Y., Tong, Z.: FaceBagNet: Bag-of-local-features model for multi-modal face anti-spoofing. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 1611–1616 (2019)
Zhang, P., et al.: FeatherNets: Convolutional neural networks as light as feather for face anti-spoofing. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 1574–1583 (2019)
Li, H., Li, W., Cao, H., Wang, S., Huang, F., Kot, A.C.: Unsupervised domain adaptation for face anti-spoofing. IEEE Trans. Inf. Forensics Secur. 13(7), 1794–1809 (2018). https://doi.org/10.1109/TIFS.2018.2801312
Sanghvi, N., Singh, S.K., Agarwal, A., Vatsa, M., Singh, R.: MixNet for generalized face presentation attack detection. In: Proceedings of the 25th International Conference on Pattern Recognition (ICPR), pp. 5511–5518 (2021)
Liu, A., et al.: Face anti-spoofing via adversarial cross-modality translation. IEEE Trans. Inf. Forensics Secur. 16, 2759–2772 (2021). https://doi.org/10.1109/TIFS.2021.3065495
Zhang, S., et al.: A dataset and benchmark for large-scale multi-modal face anti-spoofing. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 919–928 (2019)
Shi, L., Zhou, Z., Guo, Z.: Face anti-spoofing using spatial pyramid pooling. In: Proceedings of the International Conference on Pattern Recognition (ICPR), pp. 2126–2133 (2021)
Li, Z., Li, H., Luo, X., Hu, Y., Lam, K., Kot, A.C.: Asymmetric modality translation for face presentation attack detection. IEEE Trans. Multimedia, 1–1 (2021). https-://doi.org/https://doi.org/10.1109/TMM.2021.3121140
Kuang, H., Ji, R., Liu, H., Zhang, S., Zhang, B.: Multi-modal multi-layer fusion network with average binary center loss for face anti-spoofing. In: Proceedings of the 27th ACM International Conference on Multimedia, pp. 48–56 (2019)
Wang, G., Lan, C., Han, H., Shan, S., Chen, X.: Multi-modal face presentation attack detection via spatial and channel attentions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 1584–1590 (2019)
Acknowledgment
Science and Technology to Boost the Economy 2020 Key Project (SQ2020YFF0410766), Scientific Research Foundation of Southwest University (SWU2008045) and Chongqing Technology Innovation and Application Development Project (cstc2020jscx-msxmX0147).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Zhou, Q., Yang, M., Chen, S., Tang, M., Wang, X. (2022). Multi-modal Face Anti-spoofing Using Channel Cross Fusion Network and Global Depth-Wise Convolution. In: Memmi, G., Yang, B., Kong, L., Zhang, T., Qiu, M. (eds) Knowledge Science, Engineering and Management. KSEM 2022. Lecture Notes in Computer Science(), vol 13369. Springer, Cham. https://doi.org/10.1007/978-3-031-10986-7_35
Download citation
DOI: https://doi.org/10.1007/978-3-031-10986-7_35
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-10985-0
Online ISBN: 978-3-031-10986-7
eBook Packages: Computer ScienceComputer Science (R0)