short-paper

FaceX-Zoo: A PyTorch Toolbox for Face Recognition

Authors:

Tao MeiAuthors Info & Claims

MM '21: Proceedings of the 29th ACM International Conference on Multimedia

Pages 3779 - 3782

https://doi.org/10.1145/3474085.3478324

Published: 17 October 2021 Publication History

Abstract

Due to the remarkable progress in recent years, deep face recognition is in great need of public support for practical model production and further exploration. The demands are in three folds, including 1) modular training scheme, 2) standard and automatic evaluation, and 3) groundwork of deployment. To meet these demands, we present a novel open-source project, named FaceX-Zoo, which is constructed with modular and scalable design, and oriented to the academic and industrial community of face-related analysis. FaceX-Zoo provides 1) the training module with various choices of backbone and supervisory head; 2) the evaluation module that enables standard and automatic test on most popular benchmarks; 3) the module of simple yet fully functional face SDK for the validation and primary application of end-to-end face recognition; 4) the additional module that integrates a group of useful tools. Based on these easy-to-use modules, FaceX-Zoo can help the community to easily build stateof-the-art solutions for deep face recognition and, such like the newly-emerged challenge of masked face recognition caused by the worldwide COVID-19 pandemic. Besides, FaceX-Zoo can be easily upgraded and scaled up along with further exploration in face related fields. The source codes and models have been released and received over 900 stars at https://github.com/JDAI-CV/FaceX-Zoo.

References

[1]

2018. https://github.com/deepinsight/insightface.

[2]

2020. https://github.com/ZhaoJ9014/face.evoLVe.PyTorch.

[3]

Brandon Amos, Bartosz Ludwiczuk, and Mahadev Satyanarayanan. 2016. Open- Face: A general-purpose face recognition library with mobile applications. Technical Report.

[4]

Sheng Chen, Yang Liu, Xiang Gao, and Zhen Han. 2018. Mobilefacenets: Efficient cnns for accurate real-time face verification on mobile devices. In CCBR.

[5]

Jiankang Deng, Jia Guo, Niannan Xue, and Stefanos Zafeiriou. 2019. Arcface: Additive angular margin loss for deep face recognition. In CVPR.

[6]

Hang Du, Hailin Shi, Yuchi Liu, Jun Wang, Zhen Lei, Dan Zeng, and Tao Mei. 2020. Semi-Siamese Training for Shallow Face Learning. In ECCV.

[7]

Yao Feng, Fan Wu, Xiaohu Shao, Yanfeng Wang, and Xi Zhou. 2018. Joint 3d face reconstruction and dense alignment with position map regression network. In ECCV.

[8]

Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Deep residual learning for image recognition. In CVPR.

[9]

Yibo Hu, Xiang Wu, and Ran He. 2020. TF-NAS: Rethinking Three Search Freedoms of Latency-Constrained Differentiable Neural Architecture Search. In ECCV.

[10]

Gary B Huang, Marwan Mattar, Tamara Berg, and Eric Learned-Miller. 2008. Labeled faces in the wild: A database forstudying face recognition in unconstrained environments. In Workshop on Faces in 'Real-Life' Images: Detection, Alignment, and Recognition.

[11]

Ira Kemelmacher-Shlizerman, Steven M Seitz, Daniel Miller, and Evan Brossard. 2016. The megaface benchmark: 1 million faces for recognition at scale. In CVPR.

[12]

Yinglu Liu, Hailin Shi, Hao Shen, Yue Si, Xiaobo Wang, and Tao Mei. 2020. A New Dataset and Boundary-Attention Semantic Segmentation for Face Parsing. In AAAI.

[13]

Qiang Meng, Shichao Zhao, Zhida Huang, and Feng Zhou. 2021. Magface: A universal representation for face recognition and quality assessment. In CVPR.

[14]

Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, et al. 2019. Pytorch: An imperative style, high-performance deep learning library. In NIPS.

Digital Library

[15]

Yifan Sun, Changmao Cheng, Yuhan Zhang, Chi Zhang, Liang Zheng, Zhongdao Wang, and Yichen Wei. 2020. Circle loss: A unified perspective of pair similarity optimization. In CVPR.

[16]

Mingxing Tan and Quoc Le. 2019. Efficientnet: Rethinking model scaling for convolutional neural networks. In ICML.

[17]

Feng Wang, Jian Cheng, Weiyang Liu, and Haijun Liu. 2018. Additive margin softmax for face verification. ISPL (2018).

[18]

Fei Wang, Mengqing Jiang, Chen Qian, Shuo Yang, Cheng Li, Honggang Zhang, Xiaogang Wang, and Xiaoou Tang. 2017. Residual attention network for image classification. In CVPR.

[19]

Xiaobo Wang, Shifeng Zhang, Shuo Wang, Tianyu Fu, Hailin Shi, and Tao Mei. 2020. Mis-classified vector guided softmax loss for face recognition. In AAAI.

Cited By

Kim JNg TTeoh A(2025)Learnable Anchor Embedding for Asymmetric Face RecognitionElectronics10.3390/electronics1403045514:3(455)Online publication date: 23-Jan-2025
https://doi.org/10.3390/electronics14030455
Xie THan HShan SChen X(2025)Natural Adversarial Mask for Face Identity Protection in Physical WorldIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2024.352299447:3(2089-2106)Online publication date: Mar-2025
https://doi.org/10.1109/TPAMI.2024.3522994
Zhou FZhou QYin BZheng HLu XMa LLing HCai JKankanhalli MPrabhakaran BBoll SSubramanian RZheng LSingh VCesar PXie LXu D(2024)Rethinking Impersonation and Dodging Attacks on Face Recognition SystemsProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3681440(2487-2496)Online publication date: 28-Oct-2024
https://dl.acm.org/doi/10.1145/3664647.3681440
Show More Cited By

Index Terms

FaceX-Zoo: A PyTorch Toolbox for Face Recognition
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision representations
        Image representations
      2. Computer vision tasks
        Biometrics
2. Software and its engineering
  1. Software notations and tools
    1. Software libraries and repositories

Recommendations

The Elements of End-to-end Deep Face Recognition: A Survey of Recent Advances
Face recognition (FR) is one of the most popular and long-standing topics in computer vision. With the recent development of deep learning techniques and large-scale datasets, deep face recognition has made remarkable progress and has been widely used in ...
Deep face recognition using imperfect facial data
Abstract
Today, computer based face recognition is a mature and reliable mechanism which is being practically utilised for many access control scenarios. As such, face recognition or authentication is predominantly performed using ‘perfect’ ...
Highlights
- We show the performance of machine learning for face recognition using partial faces and other manipulations of the face such as rotation and zooming which ...
Face recognition: Sparse Representation vs. Deep Learning
ICGSP '18: Proceedings of the 2nd International Conference on Graphics and Signal Processing

The pose, illumination and facial expression discrepancies between two face images are the key challenges in face recognition. The deep Convolutional Neural Networks (CNNs) and the fast Sparse Representation-based Classification (SRC) have achieved ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MM '21: Proceedings of the 29th ACM International Conference on Multimedia

October 2021

5796 pages

ISBN:9781450386517

DOI:10.1145/3474085

General Chairs:
Heng Tao Shen
University of Electronic Science&Technology of China, China
,
Yueting Zhuang
Zhejiang University, China
,
John R. Smith
IBM, USA
,
Program Chairs:
Yang Yang
University of Electronic Science and Technology of China, China
,
Pablo Cesar
CWI&TU Delft, The Netherlands
,
Florian Metze
FACEBOOK, Inc., USA
,
Balakrishnan Prabhakaran
University of Texas at Dallas, USA

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMM: ACM Special Interest Group on Multimedia

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 October 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Funding Sources

the National Key R&D Program of China

Conference

MM '21

Sponsor:

SIGMM

MM '21: ACM Multimedia Conference

October 20 - 24, 2021

Virtual Event, China

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

71
Total Citations
View Citations
416
Total Downloads

Downloads (Last 12 months)85
Downloads (Last 6 weeks)11

Reflects downloads up to 18 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Kim JNg TTeoh A(2025)Learnable Anchor Embedding for Asymmetric Face RecognitionElectronics10.3390/electronics1403045514:3(455)Online publication date: 23-Jan-2025
https://doi.org/10.3390/electronics14030455
Xie THan HShan SChen X(2025)Natural Adversarial Mask for Face Identity Protection in Physical WorldIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2024.352299447:3(2089-2106)Online publication date: Mar-2025
https://doi.org/10.1109/TPAMI.2024.3522994
Zhou FZhou QYin BZheng HLu XMa LLing HCai JKankanhalli MPrabhakaran BBoll SSubramanian RZheng LSingh VCesar PXie LXu D(2024)Rethinking Impersonation and Dodging Attacks on Face Recognition SystemsProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3681440(2487-2496)Online publication date: 28-Oct-2024
https://dl.acm.org/doi/10.1145/3664647.3681440
Lindsay ARamírez-Duque APetrick RFoster M(2024)A Socially Assistive Robot using Automated Planning in a Paediatric Clinical SettingProceedings of the 2024 International Symposium on Technological Advances in Human-Robot Interaction10.1145/3648536.3648542(47-55)Online publication date: 9-Mar-2024
https://dl.acm.org/doi/10.1145/3648536.3648542
Zhang YLin WXu J(2024)Joint Audio-Visual Attention with Contrastive Learning for More General Deepfake DetectionACM Transactions on Multimedia Computing, Communications, and Applications10.1145/362510020:5(1-23)Online publication date: 22-Jan-2024
https://dl.acm.org/doi/10.1145/3625100
Melzi PTolosana RVera-Rodriguez RKim MRathgeb CLiu XDeAndres-Tame IMorales AFierrez JOrtega-Garcia JZhao WZhu XYan ZZhang XWu JLei ZTripathi SKothari MZama MDeb DBiesseck BVidal PGranada RFickel GFühr GMenotti DUnnervik AGeorge AEcabert CShahreza HRahimi PMarcel SSarridis IKoutlis CBaltsou GPapadopoulos SDiou CDi Domenico NBorghi GPellegrini LMas-Candela ESánchez-Pérez ÁAtzori AFenu GBoutros FMarras MDamer N(2024)FRCSyn Challenge at WACV 2024: Face Recognition Challenge in the Era of Synthetic Data2024 IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW)10.1109/WACVW60836.2024.00100(892-901)Online publication date: 1-Jan-2024
https://doi.org/10.1109/WACVW60836.2024.00100
Weng ZZhuang HLuo FLi HLin Z(2024)Few-Shot Contrastive Transfer Learning With Pretrained Model for Masked Face VerificationIEEE Transactions on Multimedia10.1109/TMM.2023.331692026(3871-3883)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1109/TMM.2023.3316920
Peng CKong ZLiu DWang NGao X(2024)Disguised Heterogeneous Face Generation With Iterative-Adversarial Style UnificationIEEE Transactions on Multimedia10.1109/TMM.2023.331497726(3741-3753)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1109/TMM.2023.3314977
Otroshi Shahreza HHahn VMarcel S(2024)Vulnerability of State-of-the-Art Face Recognition Models to Template Inversion AttackIEEE Transactions on Information Forensics and Security10.1109/TIFS.2024.338182019(4585-4600)Online publication date: 2024
https://doi.org/10.1109/TIFS.2024.3381820
Ng TChai JLow CBeng Jin Teoh A(2024)Self-Attentive Contrastive Learning for Conditioned Periocular and Face BiometricsIEEE Transactions on Information Forensics and Security10.1109/TIFS.2024.336121619(3251-3264)Online publication date: 2024
https://doi.org/10.1109/TIFS.2024.3361216
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten