Christian Wallraven
ABSTRACT
The human face is capable of producing an astonishing variety of expressions---expressions for which sometimes the smallest difference changes the perceived meaning noticably. Producing realistic-looking facial animations that are able to transport this degree of complexity continues to be a challenging research topic in computer graphics. One important question that remains to be answered is: When are facial animations good enough? Here we present an integrated framework in which psychophysical experiments are used in a first step to systematically evaluate the perceptual quality of computer-generated animations with respect to real-world video sequences. The result of the first experiment is an evaluation of several animation techniques in which we expose specific animation parameters that are important for perceptual fidelity. In a second experiment we then use these benchmarked animations in the context of perceptual research in order to systematically investigate the spatio-temporal characteristics of expressions. Using such an integrated approach, we are able to provide insights into facial expressions for both the perceptual and computer graphics community.
- Adolphs, R. 2002. Recognizing emotions from facial expressions: Psychological and neurological mechanisms. Behavioral and Cognitive Neuroscience Reviews 1, 1, 21--61.Google Scholar
Cross Ref
- Blanz, V., and Vetter, T. 1999. A Morphable Model for the Synthesis of 3D Faces. In SIGGRAPH'99 Proceedings, 187--194. Google ScholarDigital Library
- Blanz, V., Basso, C., Poggio, T., and Vetter, T. 2003. Reanimating faces in images and video. In EUROGRAPHICS '03 Proceedings, 641--650.Google Scholar
- Breidt, M., Wallraven, C., Cunningham, D. W., and Bülthoff, H. H. 2003. Facial animation based on 3D scans and motion capture. SIGGRAPH '03 Sketches & Applications.Google Scholar
- Bull, P. 2001. State of the art: Nonverbal communication. The Psychologist 14, 644--647.Google Scholar
- Cosker, D., Paddock, S., Marshall, D., Rosin, P. L., and Rushton, S. 2004. Towards perceptually realistic talking heads: models, methods and McGurk. In APGV 2004 -- Symposium on Applied Perception in Graphics and Visualization, 151--157. Google ScholarDigital Library
- Cunningham, D. W., Breidt, M., Kleiner, M., Wall-Raven, C., and Bülthoff, H. H. 2003. How believable are real faces: Towards a perceptual basis for conversational animation. In Computer Animation and Social Agents 2003, 23--39. Google ScholarDigital Library
- Cunningham, D. W., Kleiner, M., Wallraven, C., and Bülthoff, H. H. 2004. The components of conversational facial expressions. In APGV 2004 -- Symposium on Applied Perception in Graphics and Visualization, ACM Press, 143--149. Google ScholarDigital Library
- Ekman, P. 1972. Universal and cultural differences in facial expressions of emotion. University of Nebraska Press, 207--283.Google Scholar
- Ezzat, T., Geiger, G., and Poggio, T. 2002. Trainable videorealistic speech animation. In SIGGRAPH '02 Proceedings, ACM Press, 388--398. Google ScholarDigital Library
- Fleming, R. W., Jensen, H. W., and Bülthoff, H. H. 2004. Perceiving translucent materials. In APGV '04: Proceedings of the 1st Symposium on Applied perception in graphics and visualization, ACM Press, New York, NY, USA, 127--134. Google ScholarDigital Library
- Guenter, B., Grimm, C., Wood, D., Malvar, H., and Pighin, F. 1998. Making faces. In SIGGRAPH '98 Proceedings, ACM Press, New York, NY, USA, 55--66. Google ScholarDigital Library
- Itti, L., Dhavale, N., and Pighin, F. 2004. Realistic avatar eye and head animation using a neurobiological model of visual attention. In Applications and Science of Neural Networks, Fuzzy Systems, and Evolutionary Computation VI, 64--78.Google Scholar
- Kajiya, J. T. 1986. The rendering equation. In SIGGRAPH '86 Proceedings, 143--150. Google ScholarDigital Library
- Knappmeyer, B., Thornton, I., and Bülthoff, H. 2003. The use of facial motion and facial form during the processing of identity. Vision Research 43, 2.Google ScholarCross Ref
- Köhler, K., Haber, J., Yamauchi, H., and Seidel, H. 2002. Head shop: generating animated head models with anatomical structure. In SCA '02: Proceedings of the 2002 ACM SIGGRAPH/Eurographics symposium on Computer animation, ACM Press, 55--63. Google ScholarDigital Library
- Langer, M., and Bülthoff, H. 2000. Measuring visual shape using computer graphics psychophysics. In Rendering Techniques 2000. Proceedings of the Eurographics Workshop Rendering Techniques, 1--9. Google ScholarDigital Library
- Lee, Y., Terzopoulos, D., and Walters, K. 1995. Realistic modeling for facial animation. In SIGGRAPH '95 Proceedings, 55--62. Google ScholarDigital Library
- Leopold, D. A., O'Toole, A. J., Vetter, T., and Blanz, V. 2001. Prototype-referenced shape encoding revealed by high-level aftereffects. Nat Neurosci 4, 1, 89--94.Google ScholarCross Ref
- Magnenat-Thalmann, N., Primeau, N., and Thalmann, D. 1988. Abstract muscle actions procedures for human face animation. Visual Computer 3, 5, 290--297.Google ScholarCross Ref
- O'Sullivan, C., Howlett, S., McDonnell, R., Morvan, Y., and O'Conor, K. 2004. Perceptually adaptive graphics. In Eurographics '04, State-of-the-art-Report 6.Google Scholar
- Parke, F. 1982. Parametrized models for facial animation. IEEE Computer Graphics and Applications 2, 9, 61--68.Google ScholarDigital Library
- Rizzo, A. A., Neumann, U., Enciso, R., Fidaleo, D., and Noh, J. Y. 2001. Performance-driven facial animation: Basic research on human judgments of emotional state in facial avitars. CyberPsychology and Behavior 4, 471--487.Google ScholarCross Ref
- Terzopoulus, D., and Waters, K. 1990. Physically-based facial modeling, analysis and animation. J. of Visualization and Computer Animation 1, 73--80.Google ScholarCross Ref
- Williams, L. 1990. Performance-driven facial animation. In SIGGRAPH '90 Proceedings, ACM Press, New York, NY, USA, 235--242. Google ScholarDigital Library
Index Terms
- Psychophysical evaluation of animated facial expressions
Recommendations
Evaluating the perceptual realism of animated facial expressions
The human face is capable of producing an astonishing variety of expressions—expressions for which sometimes the smallest difference changes the perceived meaning considerably. Producing realistic-looking facial animations that are able to transmit this ...
Psychophysical investigation of facial expressions using computer animated faces
APGV '07: Proceedings of the 4th symposium on Applied perception in graphics and visualizationThe human face is capable of producing a large variety of facial expressions that supply important information for communication. As was shown in previous studies using unmanipulated video sequences, movements of single regions like mouth, eyes, and ...
Evaluation of real-world and computer-generated stylized facial expressions
The goal of stylization is to provide an abstracted representation of an image that highlights specific types of visual information. Recent advances in computer graphics techniques have made it possible to render many varieties of stylized imagery ...
Comments