Laura C. Trutoiu
Jeffrey F. Cohn
Abstract
Creating facial animations that convey an animator’s intent is a difficult task because animation techniques are necessarily an approximation of the subtle motion of the face. Some animation techniques may result in linearization of the motion of vertices in space (blendshapes, for example), and other, simpler techniques may result in linearization of the motion in time. In this article, we consider the problem of animating smiles and explore how these simplifications in space and time affect the perceived genuineness of smiles. We create realistic animations of spontaneous and posed smiles from high-resolution motion capture data for two computer-generated characters. The motion capture data is processed to linearize the spatial or temporal properties of the original animation. Through perceptual experiments, we evaluate the genuineness of the resulting smiles. Both space and time impact the perceived genuineness. We also investigate the effect of head motion in the perception of smiles and show similar results for the impact of linearization on animations with and without head motion. Our results indicate that spontaneous smiles are more heavily affected by linearizing the spatial and temporal properties than posed smiles. Moreover, the spontaneous smiles were more affected by temporal linearization than spatial linearization. Our results are in accordance with previous research on linearities in facial animation and allow us to conclude that a model of smiles must include a nonlinear model of velocities.
- Ijaz Akhter, Tomas Simon, Sohaib Khan, Iain Matthews, and Yaser Sheikh. 2012. Bilinear spatiotemporal basis models. ACM Transactions on Graphics 31, 2 (April 2012), 17:1--17:12. Google Scholar
Digital Library
- Zara Ambadar, Jeffrey F. Cohn, and L. I. Reed. 2009. All smiles are not created equal: Morphology and timing of smiles perceived as amused, polite, and embarrassed/nervous. Journal of Nonverbal Behavior 33, 1 (2009), 17--34.Google ScholarCross Ref
- Jeffrey F. Cohn and Karen L. Schmidt. 2004. The timing of facial motion in posed and spontaneous smiles. Journal of Wavelets, Multi-resolution and Information Processing 2 (2004), 1--12.Google ScholarCross Ref
- Darren Cosker, Eva Krumhuber, and Adrian Hilton. 2010. Perception of linear and nonlinear motion properties using a FACS validated 3D facial model. In Proceedings of the 7th Symposium on Applied Perception in Graphics and Visualization. ACM, 101--108. Google ScholarDigital Library
- Ian L. Dryden and Kanti V. Mardia. 2002. Statistical Shape Analysis. John Wiley and Sons.Google Scholar
- Paul Ekman. 2001. Telling Lies: Clues to Deceit in the Marketplace, Politics, and Marriage (Revised and Updated Edition) (2 rev sub ed.). W. W. Norton & Company.Google Scholar
- Paul Ekman, R. J. Davidson, and Wallace Friesen. 1990. The duchenne smile: Emotional expression and brain physiology. II. Journal of Personality and Social Psychology 58, 2 (Feb. 1990), 342--353.Google ScholarCross Ref
- Paul Ekman and Wallace Friesen. 1978. Facial Action Coding System: A Technique for the Measurement of Facial Movement. Consulting Psychologists Press, Palo Alto, CA.Google Scholar
- Paul Ekman and Wallace Friesen. 1982. Felt, false, and miserable smiles. Journal of Nonverbal Behavior 6, 4 (1982), 238--252.Google ScholarCross Ref
- Ursula Hess and Robert E. Kleck. 1994. The cues decoders use in attempting to differentiate emotion-elicited and posed facial expressions. European Journal of Social Psychology 24, 3 (1994), 367--381. DOI: http://dx.doi.org/10.1002/ejsp.2420240306Google ScholarCross Ref
- J. Hyde, E. J. Carter, S. Kiesler, and J. K. Hodgins. 2013. Perceptual effects of damped and exaggerated facial motion in animated characters. In Proceedings of the 10th IEEE International Conference on Automatic Face and Gesture Recognition. DOI: http://dx.doi.org/10.1109/FG.2013.6553775Google Scholar
- David J. Kalwick. 2006. Animating Facial Features and Expressions. Charles River Media. Google ScholarDigital Library
- Eva Krumhuber and Arvid Kappas. 2005. Moving smiles: The role of dynamic components for the perception of the genuineness of smiles. Journal of Nonverbal Behavior 29, 1 (April 2005), 3--24. DOI: http://dx.doi.org/10.1007/s10919-004-0887-xGoogle ScholarCross Ref
- Eva G. Krumhuber and Antony S. R. Manstead. 2009. Can duchenne smiles be feigned? New evidence on felt and false smiles. Emotion 9, 6 (2009), 807--820.Google ScholarCross Ref
- Xuecheng Liu, Shihong Xia, Yiwen Fan, and Zhaoqi Wang. 2011. Exploring non-linear relationship of blendshape facial animation. In Computer Graphics Forum, Vol. 30. Wiley Online Library, 1655--1666.Google ScholarDigital Library
- Rachel McDonnell, Martin Breidt, and Heinrich H. Bülthoff. 2012. Render me real?: Investigating the effect of render style on the perception of animated virtual humans. ACM Transactions on Graphics 31, 4, Article 91 (July 2012), 11 pages. DOI: http://dx.doi.org/10.1145/2185520.2185587 Google ScholarDigital Library
- Karen L. Schmidt, Yanxi Liu, and Jeffrey F. Cohn. 2006. The role of structural facial asymmetry in asymmetry of peak facial expressions. Laterality 11, 6 (Nov. 2006), 540--61. DOI: http://dx.doi.org/10.1080/13576500600832758Google ScholarCross Ref
- J. Rafael Tena, Fernando De la Torre, and Iain Matthews. 2011. Interactive region-based linear 3d face models. In ACM Transactions on Graphics (TOG), Vol. 30. ACM, 76. Google ScholarDigital Library
- Laura C. Trutoiu, Elizabeth J. Carter, Iain Matthews, and Jessica K. Hodgins. 2011. Modeling and animating eye blinks. ACM Transactions on Applied Perception 8, 3 (Aug. 2011), 1--17. Google ScholarDigital Library
- Laura C. Trutoiu, J. K. Hodgins, and Jeffrey F. Cohn. 2013. The temporal connection between smiles and blinks. In Proceedings of the 10th IEEE International Conference on Automatic Face and Gesture Recognition.Google Scholar
- Christian Wallraven, Martin Breidt, Douglas W. Cunningham, and Heinrich H. Bülthoff. 2008. Evaluating the perceptual realism of animated facial expressions. ACM Transactions on Applied Perception 4, 4 (Feb. 2008), Article 4, 20 pages. DOI: http://dx.doi.org/10.1145/1278760.1278764 Google ScholarDigital Library
Index Terms
- Spatial and Temporal Linearities in Posed and Spontaneous Smiles
Recommendations
Discriminating real and posed smiles: human and avatar smiles
OzCHI '17: Proceedings of the 29th Australian Conference on Computer-Human InteractionThis study addresses the question whether untrained and unaided observers can discriminate between real and posed smiles from different sets of smiling videos. Observers were shown smiling face videos, either in single or paired, to rate each of them on ...
Exploring Temporal Patterns in Classifying Frustrated and Delighted Smiles
We create two experimental situations to elicit two affective states: frustration, and delight. In the first experiment, participants were asked to recall situations while expressing either delight or frustration, while the second experiment tried to ...
Classifying posed and real smiles from observers' peripheral physiology
PervasiveHealth '17: Proceedings of the 11th EAI International Conference on Pervasive Computing Technologies for HealthcareSmiles are important signals in face-to-face communication that provides impressions / feelings to observers. For example, a speaker can be motivated from audience smiles. People can smile from feeling or by acting or posing the smile. We used observers'...
Comments