skip to main content
10.1145/1328202.1328225acmotherconferencesArticle/Chapter ViewAbstractPublication PagesfutureplayConference Proceedingsconference-collections
research-article

A framework for socially communicative faces for game and interactive learning applications

Published: 14 November 2007 Publication History

Abstract

In this paper, we describe a modular multi-dimensional parameter space for real-time face game-based animation. Faces are our most expressive communication tools. Therefore a synthetic facial creation and animation system should have its own tailored authoring environment rather than using general purpose tools from image, 2D and 3D animation. This environment would take advantage of a knowledge space of faces types, expressions, and behavior, encoding known facial knowledge and meaning into a comprehensive, intuitive facial language and set of user tools. Since faces and face expression work on so many cognitive levels, we propose a multi-dimension parameter space called FaceSpace as the basic face model, and a comprehensive authoring environment based on this model. We describe the underlying mechanisms of our environment, and also demonstrate its early game applications and content process.

References

[1]
Arya A, DiPaola S, 2004 Face as a Multimedia Object, 5th International Workshop on Image Analysis for Multimedia Interactive Services, Portugal.
[2]
Arya, A., and Hamidzadeh, B. 2003. ShowFace: A Framework for Personalized Face Animation. In Proceedings of RichMedia-2003, Lausanne, Switzerland, IEEE Press.
[3]
Battista, S., et al. 1999. MPEG-4: A Multimedia Standard for the Third Millennium, Multimedia, vol. 6, no. 4, IEEE Press.
[4]
Borkenau, P., and Liebler, A., 1992. Trait Inferences: Sources of Validity at Zero Acquaitance. In Journal of Personality and Social Psychology. Vol 62. no 4, pp 645--657.
[5]
Byun, M., and Badler, N. I., 2002. FacEMOTE: Qualitative Parametric Modifiers for Facial Animations. In Proceedings of ACM SIGGRAPH/ Eurographics symposium on Computer Animation, ACM Press.
[6]
Cassell, J., et al. 1994. Animated Conversation: Rule-based Generation of Facial Expression, Gesture and Spoken Intonation for Multiple Conversational Agents. In Proceedings of ACM SIGGRAPH, ACM Press.
[7]
Cassell, J., et al. 2001. BEAT: The Behavior Expression Animation Toolkit. In Proceedings of ACM SIGGRAPH, ACM Press.
[8]
Decarlo, D., et al. 2002. Making Discourse Visible: Coding and Animating Conversational Facial Displays. In Proceedings of Computer Animation Conference, IEEE Press.
[9]
DiPaola, S. 1991. Extending the Range of Facial Types. Visualization and Computer Animation, 2, 4, 129--131.
[10]
DiPaola, S. 2002. FaceSpace: A Facial Spatial-Domain Toolkit. In Proceedings of InfoViz 2002, 49--55.
[11]
DiPaola S, Arya A, Chan J. 2005. Simulating Face to Face Collaboration for Interactive Learning Systems, Proceeding from E-Learn.
[12]
Ekman, P., and FrieSEN, W. V. 1978. Facial Action Coding System, Consulting Psychologists Press Inc.
[13]
Ezzat, T. and Poggio, T. 1999. MikeTalk: A Talking Facial Display Based on Morphing Visemes. In Proceedings of Computer Animation Conference, IEEE Press.
[14]
Funge, J. et al. 1999. Cognitive Modeling. In Proceedings of ACM SIGGRAPH, ACM Press.
[15]
Gross, J., et al. 2000. The Dissociation of Emotion Expression from Emotion Experience: A Personality Perspective. In Personality and Social Psychology Bulletin, vol 26. no 6. pp 712--726.
[16]
Kahler, K. et al. 2002. Head Shop: Generating Animated Head Models with Anatomical Structure. In Proceedings of ACM SIGGRAPH/ Eurographics symposium on Computer animation, ACM Press.
[17]
Knutson, B. 1996. Facial Expressions of Emotion Influence Interpersonal Trait Inferences, Journal of Nonverbal Behavior, 20, 165--182.
[18]
Lee, Y., Terzopoulos, D., Waters, K., 1995. Realistic Modeling for Facial Animation. In Proceedings of ACM SIGGRAPH, ACM Press.
[19]
Parke, F. I. 1972. Computer Generated Animation of Faces. In Proceedings of ACM Annual Conference, ACM Press, 451--457.
[20]
Parke, F. I., and Waters, K. 2000. Computer Facial Animation. A. K. Peters.
[21]
Pasquariello, D., and Pelachaud, A., 2001. Greta: A Simple Facial Animation Engine. In 6th Online World Conference on Soft Computing in Industrial Applications.
[22]
Pelachaud, W. and Bilvi, M. 2003. Computational Model of Believable Conversational Agents. In Communication in MAS: Background, Current Trends and Future.
[23]
Rousseau, D., and Hayes-roth, B. 1997. Interacting with Personality-Rich Characters. Knowledge Systems Laboratory Report No. KSL 97--06, Stanford University.
[24]
Russell, J. A., 1980. A Circumplex Model of Affect. In Journal of Personality and Social Psychology, 39, 1161--1178.
[25]
Smid, K. et al. 2004. Autonomous Speaker Agent. In Proceedings of Computer Animation and Social Agents, Geneva, Switzerland.
[26]
Tiddeman, B. et al. 2001. Prototyping and Transforming Facial Textures for Perception Research. Computer Graphics and Applications, IEEE Press.
[27]
Turk, M. J., and Pentland, A. P. 1991. Face Recognition Using Eigenfaces. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR-91), IEEE Press, 586--591.
[28]
Valentine, T. 1999. Face-Space Models of Face Recognition. In Computational, geometric, and process perspectives on facial cognition: Contexts and challenges. Wenger, M. J. & Townsend, J. T. (Eds.), Lawrence Erlbaum Associates Inc.
[29]
Waters, K. 1987. A Muscle Model for Animating 3D Facial Expression. ACM Computer Graphics, ACM Press, 21, 4.
[30]
Wiggins, J. S. et al. 1988. Psychometric and Geometric Characteristics of the Revised Interpersonal Adjective Scale, Multivariate Behavioural Research, 23, 517--530.

Cited By

View all
  • (2010)An extensible framework for interactive facial animation with facial expressions, lip synchronization and eye behaviorComputers in Entertainment10.1145/1658866.16588777:4(1-20)Online publication date: 1-Jan-2010

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
Future Play '07: Proceedings of the 2007 conference on Future Play
November 2007
279 pages
ISBN:9781595939432
DOI:10.1145/1328202
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

  • Province of Ontario, Ministry of Economic Development and Trade
  • Arcademy Games Awards Festival Arcadia
  • Microsoft User Research Group
  • Government of Canada, FedNor
  • Sault Ste. Marie Innovation Centre
  • Garage Games
  • Visualization Design Institute, Sheridan Institute of Technology and Advanced Learning
  • Algoma University College
  • University of Ontario Institute of Technology
  • Bug-Tracker.Com
  • SchoolFinder

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 November 2007

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. communication systems
  2. facial animation
  3. gaming

Qualifiers

  • Research-article

Conference

Futureplay2007
Sponsor:
Futureplay2007: Futureplay 2007
November 14 - 17, 2007
Toronto, Canada

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 17 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2010)An extensible framework for interactive facial animation with facial expressions, lip synchronization and eye behaviorComputers in Entertainment10.1145/1658866.16588777:4(1-20)Online publication date: 1-Jan-2010

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media