skip to main content
10.1145/3528114.3528133acmotherconferencesArticle/Chapter ViewAbstractPublication PagesdsdeConference Proceedingsconference-collections
research-article

A Masked Facial Landmarks Localization Method Considering the Mask-Face Contact Characteristics

Published:24 June 2022Publication History

ABSTRACT

At present, it has become normal for people to travel with masks. In order to meet the challenge of face recognition caused by mask occlusion, a new method for landmark localization of masked face was proposed in this study. Correspondingly, a 68-point shape model including face and mask was designed and the distribution of the related landmarks was pre-positioned according to the fitting characteristics between the face and mask. To generate a regressor with function of accurate localization of facial landmarks, the masked face dataset marked by the shape model was constructed; Meanwhile, the regression tree integration algorithm was used to accurately locate the pre-positioned landmarks of the masked face. By means of the method established in this study, the tested value of IPN and ION is respectively equal to 5.68 and 3.65, being less than those of other classical algorithms. The experimental results indicate that this method can achieve an acceptable landmark localization effect and is likely to provide certain technical supports for the masked face recognition.

References

  1. XIN J, TAN X.Face alignment in-the-wild: A survey[J].Computer Vision Image Understanding, 2017, 162: 1-22.Google ScholarGoogle Scholar
  2. CHRYSOS G G, ANTONAKOS E, SNAPE P, A comprehensive performance evaluation of deformable face tracking ”in-the-wild”[J].International Journal of Computer Vision, 2016, 126 (2): 198-232.Google ScholarGoogle Scholar
  3. KHAN R A, MEYER A, KONIK H, Saliency based framework for facial expression recognition[J].Frontiers of Computer Science (electronic), 2019, (1): 183-198.Google ScholarGoogle Scholar
  4. CHI N D, LUU K, QUACH K G, Deep appearance models: A deep boltzmann machine approach for face modeling[J].International Journal of Computer Vision, 2019, 127(3): 437-455.Google ScholarGoogle Scholar
  5. Liu J, Cheng P, Wu B, Yang Z. Face characterization and 3D reconstruction based on self-supervised deep learning [J].Sensors and Microsystems, 2019,38 (9): 126-128,133.Google ScholarGoogle Scholar
  6. COOTES T.Active shape models-their training and application[J].Comput.Vis.Image Understand, 1995, 61(1): 38-59.Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. WANG J, YUAN Y, YU G.Face attention network: An effective face detector for the occluded faces[J].2020, https://blog.csdn.net/cdknight happy/article/details/105773331.Google ScholarGoogle Scholar
  8. CHEN Y, SONG L, RAN H.Masquer hunter: Adversarial occlusion-aware face detection : 2018 IEEE 9th International Conference on Biometrics Theory, Applications and Systems (BTAS)[C].Los Angeles: 2018 IEEE, 2018.Google ScholarGoogle Scholar
  9. Zou Baihan, Qin Yating, Yuan Xiaobing, Status study of mask face detection methods based on lightweight CNN [J].Software, 2020,41 (8): 186-188.Google ScholarGoogle Scholar
  10. Chen Jiali, Liu Kechun, Tang cong, A method to identify the key points of the face and forehead: China, CN201811493855.7 [P].2019-02-22.Google ScholarGoogle Scholar
  11. Li Yuan, Yang Yandan, Wang Jinwei.Identification of the eye key points and the training method and device of the detection model: China, 201910541988.5 [P].2020-04-03.Google ScholarGoogle Scholar
  12. KAZEMI V, SULLIVAN J.One millisecond face alignment with an ensemble of regression trees : 2014 IEEE Conference on Computer Vision Pattern Recognition [C]Columbus: 2014 IEEE, 2014..Google ScholarGoogle Scholar
  13. CABANI A, HAMMOUDI K, BENHABILES H, Maskedface-net a dataset of correctly/incorrectly masked face images in the context of covid-19[J].Smart Health(Amsterdam, Netherlands), 2020, 19: 100144.Google ScholarGoogle Scholar
  14. SAGONAS C, TZIMIROPOULOS G, ZAFEIRIOU S, 300 faces in-the-wild challenge: The first facial landmark localization challenge : Proceedings of the 2013 IEEE International Conference on Computer Vision Workshops [C].Sydney: 2013 IEEE, 2013.Google ScholarGoogle Scholar
  15. GUO X, LI S, ZHANG J, Pfld: A practical facial landmark detector[J].Computer Vision and Pattern Recognition, 2019(lasted revised 3 Mar 2019).Google ScholarGoogle Scholar
  16. Wu W , Qian C , Yang S , Look at Boundary: A Boundary-Aware Face Alignment Algorithm : 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition [C].Salt Lake City: 2018 IEEE, 2018.Google ScholarGoogle Scholar

Recommendations

Comments

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Sign in
  • Published in

    cover image ACM Other conferences
    DSDE '22: 2022 the 5th International Conference on Data Storage and Data Engineering
    February 2022
    124 pages
    ISBN:9781450395724
    DOI:10.1145/3528114

    Copyright © 2022 ACM

    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    • Published: 24 June 2022

    Permissions

    Request permissions about this article.

    Request Permissions

    Check for updates

    Qualifiers

    • research-article
    • Research
    • Refereed limited
  • Article Metrics

    • Downloads (Last 12 months)15
    • Downloads (Last 6 weeks)1

    Other Metrics

PDF Format

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format .

View HTML Format