research-article

Appraising emotional events during a real-time interactive game

Authors:

Matthieu Courgeon,

Céline Clavel,

Jean-Claude MartinAuthors Info & Claims

AFFINE '09: Proceedings of the International Workshop on Affective-Aware Virtual Agents and Social Robots

Article No.: 7, Pages 1 - 5

https://doi.org/10.1145/1655260.1655267

Published: 06 November 2009 Publication History

Abstract

Interactive virtual agents now commonly display facial expressions of emotions. Most of these expressions are triggered using a finite set of labeled emotions, e.g. the six basic emotions (a single expression being assigned to each emotion). However, theories of emotions suggest that emotion is a componential evaluation process, during which sequential facial expressions reflect various information about the ongoing evaluation. This paper presents an implementation of an event based facial animation system based on Scherer's Component Process Theory of emotions. Our application generates appraisal events during a real-time game interaction with a user. The MARC virtual character is used to displays sequential facial expressions reflecting the evaluation process of these game events in real-time.

References

[1]

Arnold, M. B. Emotions and Personality. Psychological Aspects, 1960).

[2]

Becker, C., Prendinger, H., Ishizuka, M. and Wachsmuth, I. Evaluating affective feedback of the 3d agent max in a competitive cards game. In Proceedings of the The First International Conference on Affective Computing and Intelligent Interaction (ACII-05) (Beijing, China, 2005)

Digital Library

[3]

Courgeon, M., Martin, J.-C. and Jacquemin, C. MARC: a Multimodal Affective and Reactive Charater. In Proceedings of the Workshop on Affective Interaction on Natural Environment (Chania, Greece, 2008)

[4]

Courgeon, M., Buisine, S. and Martin, J.-C. Impact of Expressive Wrinkles on Perception of a Virtual Character's Facial Expressions of Emotions. In Proceedings of the 9th International conference on Intelligent Virtual Agents (Amsterdam, The Netherlands, 2009). Springer LNCS

Digital Library

[5]

Ekman, P., Friesen, W. V. and Hager, J. C. Facial Action Coding System - The Manual. A Human Face, Salt Lake City, UT, 2002.

[6]

Grandjean, D. and Scherer, K. R. Unpacking the cognitive architecture of emotion processes. Emotion, 8, 3 (08/2008 2008), 341--351.

[7]

Kopp, S., Krenn, B., Marsella, S., Marshall, A. N., Pelachaud, C., H., P., K. R, T., Vilhjalmsson, H., N., B. and Johnstone, L.: http://www.mindmakers.org/projects/BML (2006)

[8]

Lanctôt, N. and Hess, U. The Timing of Appraisals. Emotion, 7, 1 2007), 2007--2212.

[9]

Lazarus, R. S. Emotions and Adaptation: Conceptual and Empirical relations. Nebraska Symposium on Motivation, 161968), 175--270.

[10]

Malatesta, L., Raouzaiou, A., Karpouzis, K. and Kollias, S. Towards modeling embodied conversational agent character profiles using appraisal theory predictions in expression synthesis Applied Intelligence, 2007), 58--64.

Digital Library

[11]

Marsella, S. and Gratch, J. EMA: A process model of appraisal dynamics. Cognitive Systems Research, 10(March 2009 2009).

Digital Library

[12]

Mehrabian, J. A. R. a. A. Evidence for a three-factor theory of emotions. Journal of Research on Personality, 1977), 273--294.

[13]

Noldus-Information-Technology: http://www.noldus.com/content/facereader (2009)

[14]

Paleari, M., Grizard, A. and Lisetti, C. Adapting Psychologically Grounded Facial Emotional Expressions to Different Anthropomorphic Embodiment Platforms. In Proceedings of the FLAIRS Conference 2007 (Key West, Florida, USA, 2007)

[15]

Scherer, K. R. On the Sequential Nature of Appraisal Processes: Indirect Evidence from a Recognition Task. Cognition&Emotion, 13, 6 1999), 763--793.

[16]

Scherer, K. R., Schorr, A. and Johnstone, T. Appraisal considered as a process of multilevel sequential checking. Oxford University Press US, 2001, City, 2001.

[17]

Scherer, K. R. and Grandjean, D. Facial expressions allow inference of both emotions and their components. Cognition&Emotion, 22, 5 2008), 789--801.

[18]

Schröder, M., Baggia, P., Felix Burkhardt, F., Martin, J.-C., Pelachaud, C., Peter, C., Schuller, B., Wilson, I. and Zovato, E.: http://www.w3.org/2005/Incubator/emotion/XGR-emotionml-20081120/ (2008)

[19]

Wang, N. and Marsella, S. Introducting EVG: An Emotion Evoking Game. City, 2006.

[20]

Wikipedia: http://en.wikipedia.org/wiki/Reversi (2009)

Cited By

Andrea RYusnita ADaud JKhoirunnita A(2023)Combination Probability in Finite State Machine Model for Intelligent Agent of Educational Game “I LOve Maratua”Advances in Intelligent Systems, Computer Science and Digital Economics IV10.1007/978-3-031-24475-9_22(252-265)Online publication date: 29-Jan-2023
https://doi.org/10.1007/978-3-031-24475-9_22
Aylett RRitter CLim MBroz FMcKenna PKeller IRajendran G(2021)An Architecture for Emotional Facial Expressions as Social SignalsIEEE Transactions on Affective Computing10.1109/TAFFC.2019.290620012:2(293-305)Online publication date: 1-Apr-2021
https://doi.org/10.1109/TAFFC.2019.2906200
Tisserand YAylett RMortillaro MRudrauf D(2020)Real-time simulation of virtual humans' emotional facial expressions, harnessing autonomic physiological and musculoskeletal controlProceedings of the 20th ACM International Conference on Intelligent Virtual Agents10.1145/3383652.3423904(1-8)Online publication date: 20-Oct-2020
https://dl.acm.org/doi/10.1145/3383652.3423904
Show More Cited By

Index Terms

Appraising emotional events during a real-time interactive game
1. Computing methodologies
  1. Artificial intelligence
    1. Knowledge representation and reasoning
      1. Cognitive robotics
    2. Philosophical/theoretical foundations of artificial intelligence
      1. Cognitive science
  2. Computer graphics
    1. Animation

Recommendations

Emotional responses to watching and touching 3d emotional face in a virtual environment
Abstract
Facial expressions play a crucial role in modulating the emotional responses in the viewers. Touch is an important factor in shaping human emotions and social communication. The objective of this study is to investigate the effects of viewing and ...
Person-independent estimation of emotional experiences from facial expressions
IUI '05: Proceedings of the 10th international conference on Intelligent user interfaces

The aim of this research was to develop methods for the automatic person-independent estimation of experienced emotions from facial expressions. Ten subjects watched series of emotionally arousing pictures and videos, while the electromyographic (EMG) ...
The funcanny valley: a study of positive emotional reactions to strangeness
AcademicMindTrek '15: Proceedings of the 19th International Academic Mindtrek Conference

The uncanny valley hypothesis states that an artificial character creates an unsettling impression if it resembles a real human too closely. In previous literature, uncanniness has usually been interpreted as a single feature that manifests itself in ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

AFFINE '09: Proceedings of the International Workshop on Affective-Aware Virtual Agents and Social Robots

November 2009

47 pages

ISBN:9781605586922

DOI:10.1145/1655260

Copyright © 2009 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 November 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ICMI-MLMI '09

Sponsor:

SIGCHI

ICMI-MLMI '09: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERFACES/WORKSHOP ON MACHINE LEARNING FOR MULTIMODAL INTERFACES

November 6, 2009

Massachusetts, Boston

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

14
Total Citations
View Citations
254
Total Downloads

Downloads (Last 12 months)7
Downloads (Last 6 weeks)0

Reflects downloads up to 03 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Andrea RYusnita ADaud JKhoirunnita A(2023)Combination Probability in Finite State Machine Model for Intelligent Agent of Educational Game “I LOve Maratua”Advances in Intelligent Systems, Computer Science and Digital Economics IV10.1007/978-3-031-24475-9_22(252-265)Online publication date: 29-Jan-2023
https://doi.org/10.1007/978-3-031-24475-9_22
Aylett RRitter CLim MBroz FMcKenna PKeller IRajendran G(2021)An Architecture for Emotional Facial Expressions as Social SignalsIEEE Transactions on Affective Computing10.1109/TAFFC.2019.290620012:2(293-305)Online publication date: 1-Apr-2021
https://doi.org/10.1109/TAFFC.2019.2906200
Tisserand YAylett RMortillaro MRudrauf D(2020)Real-time simulation of virtual humans' emotional facial expressions, harnessing autonomic physiological and musculoskeletal controlProceedings of the 20th ACM International Conference on Intelligent Virtual Agents10.1145/3383652.3423904(1-8)Online publication date: 20-Oct-2020
https://dl.acm.org/doi/10.1145/3383652.3423904
Helgadóttir HJónsdóttir SSigurdsson ASchiffel SVilhjálmsson H(2016)Virtual General Game Playing AgentIntelligent Virtual Agents10.1007/978-3-319-47665-0_56(464-469)Online publication date: 19-Oct-2016
https://doi.org/10.1007/978-3-319-47665-0_56
Niewiadomski RPelachaud C(2015)The Effect of Wrinkles, Presentation Mode, and Intensity on the Perception of Facial Actions and Full-Face Expressions of LaughterACM Transactions on Applied Perception10.1145/269925512:1(1-21)Online publication date: 17-Feb-2015
https://dl.acm.org/doi/10.1145/2699255
Gaffary YMartin JAmmi M(2015)Perception of congruent facial and kinesthetic expressions of emotionsProceedings of the 2015 International Conference on Affective Computing and Intelligent Interaction (ACII)10.1109/ACII.2015.7344697(993-998)Online publication date: 21-Sep-2015
https://dl.acm.org/doi/10.1109/ACII.2015.7344697
Gaffary YJauregui DMartin JAmmi M(2015)Gestural and Postural Reactions to Stressful EventProceedings of the 2015 International Conference on Affective Computing and Intelligent Interaction (ACII)10.1109/ACII.2015.7344696(988-992)Online publication date: 21-Sep-2015
https://dl.acm.org/doi/10.1109/ACII.2015.7344696
Gaffary YEyharabide VMartin JAmmi M(2014)The Impact of Combining Kinesthetic and Facial Expression Displays on Emotion Recognition by UsersInternational Journal of Human-Computer Interaction10.1080/10447318.2014.94127630:11(904-920)Online publication date: 30-Sep-2014
https://doi.org/10.1080/10447318.2014.941276
Arellano DPerales FVarona J(2014)Mood and Its Mapping onto Facial ExpressionsArticulated Motion and Deformable Objects10.1007/978-3-319-08849-5_4(31-40)Online publication date: 2014
https://doi.org/10.1007/978-3-319-08849-5_4
Gaffary YEyharabide VMartin JAmmi M(2013)Clustering approach to characterize haptic expressions of emotionsACM Transactions on Applied Perception10.1145/2536764.253676810:4(1-20)Online publication date: 1-Oct-2013
https://dl.acm.org/doi/10.1145/2536764.2536768
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten