Skip to main content

FedSC: Federated Generalized Face Anti-Spoofing via Shuffled Codebook

  • Conference paper
  • First Online:
Pattern Recognition (ICPR 2024)

Abstract

Domain generalization methods for Face Anti-Spoofing (FAS) have drawn increasing research attention. However, existing domain generalization (DG) methods usually require sharing data from varying source distributions, without considering privacy concerns. In this work, we propose the Federated Shuffle Codebook (FedSC), a federated FAS domain generalization method. Instead of sharing raw data, FedSC facilitates access to multi-source distributions by exchanging information within codebooks, ensuring privacy. Specifically, we first separate the images into style and content features. Style information is embedded into the style codebook through vector quantization during the training stage. Then the style codebooks are uploaded, shuffled and downloaded to transmit style information across domains. Each domain’s source training data is diversified by the shuffled style codebook to achieve generalization. As the codebook represents the overall distribution rather than any specific image, FedSC offers both efficiency and privacy preservation. We have also devised a contrastive learning strategy to suppress the adverse effects of distribution differences on the liveness classification task. Theoretically, the established error boundaries of domain generalization provide robust support for our approach. Extensive experiments show that our proposed approach is effective and outperforms previous methods.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Albuquerque, I., Monteiro, J., Darvishi, M., Falk, T.H., Mitliagkas, I.: Generalizing to unseen domains via distribution matching. arXiv preprint arXiv:1911.00804 (2019)

  2. Atoum, Y., Liu, Y., Jourabloo, A., Liu, X.: Face anti-spoofing using patch and depth-based CNNs. In: 2017 IEEE International Joint Conference on Biometrics (IJCB), pp. 319–328. IEEE (2017)

    Google Scholar 

  3. Bengio, S., Mariéthoz, J.: A statistical significance test for person authentication. In: Proceedings of Odyssey 2004: The Speaker and Language Recognition Workshop, No. CONF (2004)

    Google Scholar 

  4. Boulkenafet, Z., Komulainen, J., Li, L., Feng, X., Hadid, A.: Oulu-npu: a mobile face presentation attack database with real-world variations. In: 2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017), pp. 612–618. IEEE (2017)

    Google Scholar 

  5. Chen, J., Jiang, M., Dou, Q., Chen, Q.: Federated domain generalization for image recognition via cross-client style transfer. In: Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pp. 361–370 (2023)

    Google Scholar 

  6. Chen, X., He, K.: Exploring simple siamese representation learning. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 15750–15758 (2021)

    Google Scholar 

  7. Chingovska, I., Anjos, A., Marcel, S.: On the effectiveness of local binary patterns in face anti-spoofing. In: 2012 BIOSIG-Proceedings of the International Conference of Biometrics Special Interest Group (BIOSIG), pp. 1–7. IEEE (2012)

    Google Scholar 

  8. David, S.B., Lu, T., Luu, T., Pál, D.: Impossibility theorems for domain adaptation. In: Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics, pp. 129–136. JMLR Workshop and Conference Proceedings (2010)

    Google Scholar 

  9. Deb, D., Jain, A.K.: Look locally infer globally: a generalizable face anti-spoofing approach. IEEE Trans. Inf. Forens. Secur. 16, 1143–1157 (2020)

    Article  Google Scholar 

  10. de Freitas Pereira, T., Anjos, A., De Martino, J.M., Marcel, S.: LBP- top based countermeasure against face spoofing attacks. In: Computer Vision-ACCV 2012 Workshops: ACCV 2012 International Workshops, Daejeon, 5–6 November 2012, Revised Selected Papers, Part I, vol. 11, pp. 121–132. Springer (2013)

    Google Scholar 

  11. Ganin, Y., Lempitsky, V.: Unsupervised domain adaptation by backpropagation. In: International Conference on Machine Learning, pp. 1180–1189. PMLR (2015)

    Google Scholar 

  12. He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)

    Google Scholar 

  13. Huang, X., Belongie, S.: Arbitrary style transfer in real-time with adaptive instance normalization. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 1501–1510 (2017)

    Google Scholar 

  14. Jia, Y., Zhang, J., Shan, S., Chen, X.: Single-side domain generalization for face anti-spoofing. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 8484–8493 (2020)

    Google Scholar 

  15. Konečnỳ, J., McMahan, H.B., Yu, F.X., Richtárik, P., Suresh, A.T., Bacon, D.: Federated learning: strategies for improving communication efficiency. arXiv preprint arXiv:1610.05492 (2016)

  16. Li, H., Pan, S.J., Wang, S., Kot, A.C.: Domain generalization with adversarial feature learning. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 5400–5409 (2018)

    Google Scholar 

  17. Li, H., Wang, Y., Wan, R., Wang, S., Li, T.Q., Kot, A.: Domain generalization for medical imaging classification with linear-dependency regularization. Adv. Neural. Inf. Process. Syst. 33, 3118–3129 (2020)

    Google Scholar 

  18. Lin, B., Li, X., Yu, Z., Zhao, G.: Face liveness detection by RPPG features and contextual patch-based CNN. In: Proceedings of the 2019 3rd International Conference on Biometric Engineering and Applications, pp. 61–68 (2019)

    Google Scholar 

  19. Liu, Q., Chen, C., Qin, J., Dou, Q., Heng, P.A.: Feddg: federated domain generalization on medical image segmentation via episodic learning in continuous frequency space. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 1013–1023 (2021)

    Google Scholar 

  20. Liu, S., et al.: Adaptive normalized representation learning for generalizable face anti-spoofing. In: Proceedings of the 29th ACM International Conference on Multimedia, pp. 1469–1477 (2021)

    Google Scholar 

  21. Van der Maaten, L., Hinton, G.: Visualizing data using t-sne. J. Mach. Learn. Res. 9(11) (2008)

    Google Scholar 

  22. McMahan, B., Moore, E., Ramage, D., Hampson, S., Arcas, B.A.: Communication-efficient learning of deep networks from decentralized data. In: Artificial Intelligence and Statistics, pp. 1273–1282. PMLR (2017)

    Google Scholar 

  23. Patel, K., Han, H., Jain, A.K.: Secure face unlock: spoof detection on smartphones. IEEE Trans. Inf. Forens. Secur. 11(10), 2268–2283 (2016)

    Article  Google Scholar 

  24. Qin, Y., et al.: Learning meta model for zero-and few-shot face anti-spoofing. Proc. AAAI Conf. Artif. Intell. 34, 11916–11923 (2020)

    Google Scholar 

  25. Shao, R., Lan, X., Li, J., Yuen, P.C.: Multi-adversarial discriminative deep domain generalization for face presentation attack detection. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 10023–10031 (2019)

    Google Scholar 

  26. Shao, R., Lan, X., Yuen, P.C.: Regularized fine-grained meta face anti-spoofing. Proc. AAAI Conf. Artif. Intell. 34, 11974–11981 (2020)

    Google Scholar 

  27. Shao, R., Perera, P., Yuen, P.C., Patel, V.M.: Federated generalized face presentation attack detection. IEEE Trans. Neural Netw. Learn. Syst. (2022)

    Google Scholar 

  28. Sun, Y., Liu, Y., Liu, X., Li, Y., Chu, W.S.: Rethinking domain generalization for face anti-spoofing: Separability and alignment. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 24563–24574 (2023)

    Google Scholar 

  29. Torralba, A., Efros, A.A.: Unbiased look at dataset bias. In: CVPR 2011, pp. 1521–1528. IEEE (2011)

    Google Scholar 

  30. Van Den Oord, A., Vinyals, O., et al.: Neural discrete representation learning. Adv. Neural Inf. Process. Syst. 30 (2017)

    Google Scholar 

  31. Wang, G., Han, H., Shan, S., Chen, X.: Cross-domain face presentation attack detection via multi-domain disentangled representation learning. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 6678–6687 (2020)

    Google Scholar 

  32. Wang, J., Zhang, J., Bian, Y., Cai, Y., Wang, C., Pu, S.: Self-domain adaptation for face anti-spoofing. Proc. AAAI Conf. Artif. Intell. 35, 2746–2754 (2021)

    Google Scholar 

  33. Wang, W., Liu, P., Zheng, H., Ying, R., Wen, F.: Domain generalization for face anti-spoofing via negative data augmentation. IEEE Trans. Inf. Forens. Secur. (2023)

    Google Scholar 

  34. Wang, Z., Wang, Q., Deng, W., Guo, G.: Learning multi-granularity temporal characteristics for face anti-spoofing. IEEE Trans. Inf. Forens. Secur. 17, 1254–1269 (2022)

    Article  Google Scholar 

  35. Wang, Z., et al.: Domain generalization via shuffled style assembly for face anti-spoofing. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 4123–4133 (2022)

    Google Scholar 

  36. Wen, D., Han, H., Jain, A.K.: Face spoof detection with image distortion analysis. IEEE Trans. Inf. Forens. Secur. 10(4), 746–761 (2015)

    Article  Google Scholar 

  37. Yu, Z., Li, X., Niu, X., Shi, J., Zhao, G.: Face anti-spoofing with human material perception. In: Computer Vision–ECCV 2020: 16th European Conference, Glasgow, 23–28 August 2020, Proceedings, Part VII, 16, pp. 557–575. Springer (2020)

    Google Scholar 

  38. Yu, Z., Qin, Y., Li, X., Zhao, C., Lei, Z., Zhao, G.: Deep learning for face anti-spoofing: a survey. IEEE Trans. Pattern Anal. Mach. Intell. 45(5), 5609–5631 (2022)

    Google Scholar 

  39. Yu, Z., et al.: Searching central difference convolutional networks for face anti-spoofing. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 5295–5305 (2020)

    Google Scholar 

  40. Zhang, K., Zhang, Z., Li, Z., Qiao, Y.: Joint face detection and alignment using multitask cascaded convolutional networks. IEEE Signal Process. Lett. 23(10), 1499–1503 (2016)

    Article  Google Scholar 

  41. Zhang, R., Xu, Q., Yao, J., Zhang, Y., Tian, Q., Wang, Y.: Federated domain generalization with generalization adjustment. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 3954–3963 (2023)

    Google Scholar 

  42. Zhang, Z., Yan, J., Liu, S., Lei, Z., Yi, D., Li, S.Z.: A face antispoofing database with diverse attacks. In: 2012 5th IAPR International Conference on Biometrics (ICB), pp. 26–31. IEEE (2012)

    Google Scholar 

  43. Zhou, K., Liu, Z., Qiao, Y., Xiang, T., Loy, C.C.: Domain generalization: a survey. IEEE Trans. Pattern Anal. Mach. Intell. (2022)

    Google Scholar 

  44. Zhou, L., Luo, J., Gao, X., Li, W., Lei, B., Leng, J.: Selective domain-invariant feature alignment network for face anti-spoofing. IEEE Trans. Inf. Forens. Secur. 16, 5352–5365 (2021)

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported in part by the National Natural Science Foundation of China under Grant No. 62276030 and No. 62306043.

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to Mei Wang or Jiani Hu .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2025 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Yang, S., Wang, M., Deng, W., Hu, J. (2025). FedSC: Federated Generalized Face Anti-Spoofing via Shuffled Codebook. In: Antonacopoulos, A., Chaudhuri, S., Chellappa, R., Liu, CL., Bhattacharya, S., Pal, U. (eds) Pattern Recognition. ICPR 2024. Lecture Notes in Computer Science, vol 15303. Springer, Cham. https://doi.org/10.1007/978-3-031-78122-3_15

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-78122-3_15

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-78121-6

  • Online ISBN: 978-3-031-78122-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics