22 April 2020 Coupled cascade regression from real and synthesized faces for simultaneous landmark detection and head pose estimation
Chao Gou, Qiang Ji
Author Affiliations +
Abstract

The existing approaches usually perform facial landmark detection and head pose estimation independently and sequentially, ignoring their coupled relations. We introduce a unified framework, named coupled cascade regression (CCR), for simultaneous facial landmark detection and head pose estimation. Based on the cascade regression framework, we propose to learn two separate regressors to update the landmark locations and three-dimensional (3D) face model parameters at each cascade level. To capture the coupled relations of the landmark locations and head pose, we further apply the 3D face projection model to refine the prediction results in each cascade iteration and make them consistent. CCR can leverage both the learning methods and the projection model to simultaneously perform facial landmark detection and pose estimation to enhance the performances of both tasks. We also propose to learn the cascade regressors from the combination of real and synthesized face images to solve the problem of limited variations in head pose for training. Experimental results on Helen, labeled face parts in the wild, 300-W, and Boston University datasets show that our proposed CCR method outperforms other conventional methods both for landmark detection and head pose estimation.

© 2020 SPIE and IS&T 1017-9909/2020/$28.00© 2020 SPIE and IS&T
Chao Gou and Qiang Ji "Coupled cascade regression from real and synthesized faces for simultaneous landmark detection and head pose estimation," Journal of Electronic Imaging 29(2), 023028 (22 April 2020). https://doi.org/10.1117/1.JEI.29.2.023028
Received: 3 December 2019; Accepted: 7 April 2020; Published: 22 April 2020
Lens.org Logo
CITATIONS
Cited by 4 scholarly publications.
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
3D modeling

Head

3D image processing

Performance modeling

Model-based design

Data modeling

Visual process modeling

RELATED CONTENT

Model-based head tracking and 3D pose estimation
Proceedings of SPIE (September 24 1998)
3D model-based still image object categorization
Proceedings of SPIE (September 09 2011)
Markerless 3D facial motion capture system
Proceedings of SPIE (February 08 2012)

Back to Top