skip to main content
10.1145/2491599.2491612acmotherconferencesArticle/Chapter ViewAbstractPublication PagesfaaConference Proceedingsconference-collections
research-article

Estimation of FAPs and intensities of AUs based on real-time face tracking

Published: 21 September 2012 Publication History

Abstract

Imitation of natural facial behavior in real-time is still challenging when it comes to natural behavior such as laughter and nonverbal expressions. This paper explains our ongoing work on methodologies and tools for estimating Facial Animation Parameters (FAPs) and intensities of Action Units (AUs) in order to imitate lifelike facial expressions with an MPEG-4 complaint Embodied Conversational Agent (ECA) -- The GRETA agent (Bevacqua et al. 2007). Firstly, we investigate available open source tools for better facial landmark localization. Secondly, FAPs and intensities of AUs are estimated based on facial landmarks computed with an open source face tracker tool. Finally, the paper discusses our ongoing work to investigate better re-synthesis technology among FAP-based and AU-based synthesis technologies using perceptual studies on: (i) naturalness in synthesized facial expressions; (ii) similarity perceived by the subjects when compared to original user's behavior.

References

[1]
Saragih, J., Lucey, S., and Cohn, J. 2010. Deformable Model Fitting by Regularized Landmark Mean-Shifts, International Journal of Computer Vision (IJCV).
[2]
Milborrow, S., and Nicolls, F. 2008. Locating Facial Features with an Extended Active Shape Model, In proc. of European Conference on Computer Vision (ECCV).
[3]
E. Bevacqua, M. Mancini, R. Niewiadomski, C. Pelachaud. 2007. An expressive ECA showing complex emotions.AISB'07 Annual convention, workshop Language, Speech and Gesture for Expressive Characters, Newcastle UK, pp. 208--21
[4]
The SEMAIN Project, http://www.semaine-project.eu/

Cited By

View all
  • (2016)Laughter Research: A Review of the ILHAIRE ProjectToward Robotic Socially Believable Behaving Systems - Volume I10.1007/978-3-319-31056-5_9(147-181)Online publication date: 22-Mar-2016
  • (2015)The Effect of Wrinkles, Presentation Mode, and Intensity on the Perception of Facial Actions and Full-Face Expressions of LaughterACM Transactions on Applied Perception10.1145/269925512:1(1-21)Online publication date: 17-Feb-2015
  • (2014)Intense or malicious? The decoding of eyebrow-lowering frowning in laughter animations depends on the presentation modeFrontiers in Psychology10.3389/fpsyg.2014.013065Online publication date: 18-Nov-2014
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
FAA '12: Proceedings of the 3rd Symposium on Facial Analysis and Animation
September 2012
24 pages
ISBN:9781450317931
DOI:10.1145/2491599

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 September 2012

Permissions

Request permissions for this article.

Check for updates

Qualifiers

  • Research-article

Funding Sources

Conference

FAA '12
FAA '12: Facial Analysis and Animation 2012
September 21, 2012
Vienna, Austria

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 17 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2016)Laughter Research: A Review of the ILHAIRE ProjectToward Robotic Socially Believable Behaving Systems - Volume I10.1007/978-3-319-31056-5_9(147-181)Online publication date: 22-Mar-2016
  • (2015)The Effect of Wrinkles, Presentation Mode, and Intensity on the Perception of Facial Actions and Full-Face Expressions of LaughterACM Transactions on Applied Perception10.1145/269925512:1(1-21)Online publication date: 17-Feb-2015
  • (2014)Intense or malicious? The decoding of eyebrow-lowering frowning in laughter animations depends on the presentation modeFrontiers in Psychology10.3389/fpsyg.2014.013065Online publication date: 18-Nov-2014
  • (2014)Laugh When You’re WinningInnovative and Creative Developments in Multimodal Interaction Systems10.1007/978-3-642-55143-7_3(50-79)Online publication date: 2014

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media