Human Face Reconstruction under a HMD Occlusion | IEEE Conference Publication | IEEE Xplore

Human Face Reconstruction under a HMD Occlusion


Abstract:

With the help of existing augmented vision perception motion capture technologies, virtual reality (VR) can make users immerse in virtual environments. But users are diff...Show More

Abstract:

With the help of existing augmented vision perception motion capture technologies, virtual reality (VR) can make users immerse in virtual environments. But users are difficult to convey their actual emotions to others in virtual environments. Since the head-mounted displays (HMDs) significantly obstruct users face, it is hard to recover the full face directly with traditional techniques. In this paper, we introduce a novel method to address this problem by only using the RGB image of a person, without the need of any other sensors or devices. Firstly, we utilize the facial landmark points to estimate the face shape, expression and pose of the user. Then with the information of the Non occlusion face area, we could recover the face texture and the illumination of the current scene.
Date of Conference: 23-27 March 2019
Date Added to IEEE Xplore: 15 August 2019
ISBN Information:

ISSN Information:

Conference Location: Osaka, Japan

Contact IEEE to Subscribe

References

References is not available for this document.