MPEG-4 outer-inner lip FAP interpolation

Zhilin Wu; Aggelos K. Katsaggelos; Thrasyvoulos N. Pappas

doi:10.1117/12.596789

14 March 2005 MPEG-4 outer-inner lip FAP interpolation

Zhilin Wu, Aggelos K. Katsaggelos, Thrasyvoulos N. Pappas

Proceedings Volume 5685, Image and Video Communications and Processing 2005; (2005) https://doi.org/10.1117/12.596789
Event: Electronic Imaging 2005, 2005, San Jose, California, United States

Abstract

This paper presents a novel inner-outer lip facial animation parameters (FAPs) interpolation within the framework of the MPEG-4 standard to allow for interpolation and realistic animation that can be accomplished at very low bit rates. The proposed technique applies Maximum a posteriori (MAP) estimation to interpolate the inner lip FAPs given outer lip FAPs, or vice versa. The vectors of the lip FAPs along with the first order and the second order temporal derivatives over frames and the conditional probabilities of these vectors are modeled as Gaussian distributions. As a result, the MAP estimate of the inner lip FAPs can be obtained as a linear transformation of the outer lip FAPs, or vice versa. When data obtained from the training process are stored in the receiver, the inner (or outer) lip FAPs can be interpolated from the outer (or inner) lip FAPs, which are all that needs to be transmitted. Thus, without any increase in the amount of transmitted information, a more realistic talking animation that provides more visual information for speech reading can be achieved. Based on our experiments, the proposed technique reduces the Percentage Normalized Mean Error (PNME) error by half over the standard technique.

Citation Download Citation

Zhilin Wu, Aggelos K. Katsaggelos, and Thrasyvoulos N. Pappas "MPEG-4 outer-inner lip FAP interpolation", Proc. SPIE 5685, Image and Video Communications and Processing 2005, (14 March 2005); https://doi.org/10.1117/12.596789

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available