Abstract
Several computational models of emotions have been proposed to enable artificial agents to generate emotions of their own. However, there are barriers that limit the full capabilities of these models. One issue is the need to enable emotion generation in autonomous agents in wide range of interaction situations instead of designing specific scenarios. Additionally, it is not practically easy task to ‘effectively’ integrate other human characteristics in emotion generation process of artificial agents, which is essential for variation in behavioural responses of such agents. Moreover, although theoretically it is believed that appraisal variables are associated with emotion intensities, existing emotion literature does not offer a generalisable mechanism to computationally achieve such a mapping—thereby leading to ad-hoc implementations. It is also important to note that emotions expressed by intelligent autonomous agents like robots can have deep impact on people and society, therefore, it is crucial to ensure ethical implications of emotional responses of such systems. In this paper, we endeavour to review the emotion models proposed in the last two decades based on the aspects discussed above and provide recommendations for the development of future computational models of emotion. Our review will mainly revolve around the emotion models that implement the concept of appraisal theory of emotion. Our finding suggests that none of the existing computational models of emotion using appraisal theory implement all the characteristics we identify thereby providing further research opportunities.













Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Notes
Appraisal variables are the criteria for evaluating the situation. Different appraisal theories offer different sets of (closely related) appraisal variables.
Researchers commonly use the term affect as a superset of mechanisms such as emotion, mood, feeling, etc. As such, we will also consider emotion as one type of affect in this review paper.
The dimension m represents the number of emotions modelled based on the theory used.
The notation for agreeableness will be used as \(\mathbb {A}\) to avoid ambiguity with arousal(A) dimension of PAD space.
References
Adam C, Herzig A, Longin D (2009) A logical formalization of the occ theory of emotions. Synthese 168(2):201–248
Alexander L, Moore M (2007) Deontological ethics. Stanford Encylopaedia of philosophy. https://stanford.library.sydney.edu.au/archives/win2012/entries/ethics-deontological/. Accessed July 2019
Alfonso B, Vivancos E, Botti V (2017) Toward formal modeling of affective agents in a bdi architecture. ACM Trans Internet Technol (TOIT) 17(1):5
Atkinson RC, Shiffrin RM (1968) Human memory: a proposed system and its control processes. Psychol Learn Motiv 2:89–195
Aylett R (2000) Emergent narrative, social immersion and “storification”. In: Proceedings of the 1st international workshop on narrative and interactive learning environments, pp 35–44
Aylett R, Louchart S, Dias J, Paiva A, Vala M (2005) Fearnot!—an experiment in emergent narrative. In: Panayiotopoulos T, Gratch J, Aylett R, Ballin D, Olivier P, Rist T (eds) Intelligent virtual agents. Springer, pp 305–316. https://link.springer.com/chapter/10.1007/11550617_26
Becker C (2008) Wasabi: affect simulation for agents with believable interactivity. Ph.D. thesis, Bielefeld University
Becker C, Wachsmuth I (2009) Affective computing with primary and secondary emotions in a virtual human. Auton Agents Multi-Agent Syst 20(1):219–257
Beedie C, Terry P, Lane A (2005) Distinctions between emotion and mood. Cognit Emot 19(6):847–878
Benet-Martínez V, Oishi S (2008) Culture and personality. Handbook Pers Theory Res 3:542–567
Bolles RC, Fanselow MS (1980) A perceptual-defensive-recuperative model of fear and pain. Behav Brain Sci 3:291–301
Bordini RH, Hübner JF (2010) Semantics for the jason variant of agentspeak (plan failure and some internal actions). In: ECAI, pp 635–640
Bouchard TJ Jr (2004) Genetic influence on human psychological traits: a survey. Curr Dir Psychol Sci 13(4):148–151
Breazeal C (2003) Toward sociable robots. Robot Auton Syst 42(3):167–175
Bui T, Heylen D, Poel M, Nijholt A (2002) ParleE: an adaptive plan based event appraisal model of emotions. In: KI 2002: Advances in artificial intelligence, pp 1–9
Callahan S (1988) The role of emotion in ethical decisionmaking. Hastings Center Report 18(3):9–14
Castellanos S, Rodríguez LF, Castro LA, Gutierrez-Garcia JO (2018) A computational model of emotion assessment influenced by cognition in autonomous agents. Biol Inspired Cognit Archit 25(2018):26–36
Cavazza M, Charles F, Mead SJ (2002) Character-based interactive storytelling. IEEE Intell Syst 17(4):17–24
Corr PJ (2008) The reinforcement sensitivity theory of personality. Cambridge University Press, Cambridge
Costa PT, McCrae RR (1988) Personality in adulthood: a six-year longitudinal study of self-reports and spouse ratings on the neo personality inventory. J Pers Soc Psychol 54(5):853
Dias J, Paiva A (2005) Feeling and reasoning: a computational model for emotional characters. In: EPIA, vol 3808. Springer, Berlin, pp 127–140
Dias J, Mascarenhas S, Paiva A (2014) FAtiMA modular: towards an agent architecture with a generic appraisal framework. In: Bosse T., Broekens J., Dias J., van der Zwaan J. (eds) Emotion modeling. Springer, pp 44–56. https://link.springer.com/chapter/10.1007/978-3-319-12973-0_3
Digman JM (1990) Personality structure: emergence of the five-factor model. Annu Rev Psychol 41(1):417–440
Durbin CE, Klein DN, Hayden EP, Buckley ME, Moerk KC (2005) Temperamental emotionality in preschoolers and parental mood disorders. Journal of abnormal Psychology 114(1):28
Dwivedi KN (1996) Culture and personality. In: Meeting the needs of ethnic minority children - including refugee, black and mixed parentage children: A Handbook for professionals. Philadelphia: J. Kingsley Publishers, London, pp 42–65. https://books.google.com.au/books?hl=en&lr=&id=S-ZABAAAQBAJ&oi=fnd&pg=PA42&dq=%22Culture+and+personality.+A+handbook+for+profe#v=onepage&q&f=false
Egges A, Kshirsagar S, Magnenat-Thalmann N (2003) A model for personality and emotion simulation. In: International conference on knowledge-based and intelligent information and engineering systems. Springer, pp 453–461
Egges A, Kshirsagar S, Magnenat-Thalmann N (2004) Generic personality and emotion simulation for conversational agents. Comput Anim Virtual Worlds 15(1):1–13
Ekman P (1992) An argument for basic emotions. Cognit Emot 6(3–4):169–200
Ekman P (1994) Moods, emotions, and traits. In: Ekman P, Davidson RJ (eds) The nature of emotion: fundamental questions, pp 56–58. https://psycnet.apa.org/record/1995-97541-000
El-Nasr MS, Yen J, Ioerger TR (2000) Flame-fuzzy logic adaptive model of emotions. Autonom Agents Multi-agent Syst 3(3):219–257
Elliot C (1992) The Affective Reasoner: a process model of emotions in a multi-agent system. Ph.D. thesis, Northwestern University, Institute for the Learning Sciences
Ellsworth PC (1991) Some implications of cognitive appraisal theories of emotion. Int Rev Stud Emot 1:143–161
Gadanho SC, Custódio L (2002) Asynchronous learning by emotions and cognition. In: Proceedings of the seventh international conference on simulation of adaptive behavior on From animals to animats. MIT Press, pp 224–225
Gaudine A, Thorne L (2001) Emotion and ethical decision-making in organizations. J Bus Ethics 31(2):175–187
Gebhard P (2005) Alma: a layered model of affect. In: Proceedings of the fourth international joint conference on Autonomous agents and multiagent systems. ACM, pp 29–36
Gluz J, Jaques PA (2017) A probabilistic formalization of the appraisal for the occ event-based emotions. J Artif Intell Res 58:627–664
Gratch J (2000) Emile: marshalling passions in training and education. In: Proceedings of the fourth international conference on Autonomous agents. ACM, pp 325–332
Gratch J, Marsella S (2004a) A domain-independent framework for modeling emotion. Cognit Syst Res 5(4):269–306
Gratch J, Marsella S (2004) Technical details of a domain-independent framework for modeling emotion. Technical report, University of Southern California Marina Del Rey Ca Inst for Creative Technologies
Gross JJ (1998a) Antecedent-and response-focused emotion regulation: divergent consequences for experience, expression, and physiology. J Pers Soc Psychol 74(1):224
Gross JJ (1998b) The emerging field of emotion regulation: an integrative review. Rev Gen Psychol 2(3):271
Gross JJ, Thompson RA (2007) Emotion regulation: conceptual foundations. Handbook of emotion regulation. https://www.researchgate.net/publication/303248970_Emotion_Regulation_Conceptual_Foundations. Accessed Jan 2017
Hatfield E, Cacioppo JT, Rapson RL (1994) Emotional contagion. Cambridge University Press, Cambridge
Heerink M, Kröse B, Evers V, Wielinga B (2010) Assessing acceptance of assistive social agent technology by older adults: the almere model. Int J Soc Robot 2(4):361–375
Hindriks KV (2009) Programming rational agents in goal. In: Multi-agent programming, pp 119–157. https://link.springer.com/chapter/10.1007/978-0-387-89299-3_4
Hogan R, Bond MH (2009) Culture and personality. https://psycnet.apa.org/record/2010-05179-033
Hooker J (1996) Three kinds of ethics. http://public.tepper.cmu.edu/ethics/three.pdf. Accessed 16 Aug 2018
Hudlicka E (2002) This time with feeling: integrated model of trait and state effects on cognition and behavior. Appl Artif Intell 16(7–8):611–641
Hudlicka E (2005) A computational model of emotion and personality: applications to psychotherapy research and practice. In: Proceedings of the 10th annual cybertherapy conference: a decade of virtual reality
Hudlicka E (2007) Reasons for emotions: modeling emotions in integrated cognitive systems. In: Integrated models of cognitive systems, pp 1–37. https://psycnet.apa.org/record/2007-08865-019
Hudlicka E (2008) Modeling the mechanisms of emotion effects on cognition. In: AAAI Fall symposium: biologically inspired cognitive architectures, pp 82–86
Isen AM, Means B (1983) The influence of positive affect on decision-making strategy. Soc Cognit 2(1):18–31
Izard CE (1993) Four systems for emotion activation: cognitive and noncognitive processes. Psychol Rev 100(1):68
Jain S, Asawa K (2015) Emia: emotion model for intelligent agent. J Intell Syst 24(4):449–465
Jain S, Asawa K (2016) Programming an expressive autonomous agent. Expert Syst Appl 43:131–141
Kaptein F, Broekens J, Hindriks KV, Neerincx M (2016) CAAF: a cognitive affective agent programming framework. In: International conference on intelligent virtual agents. Springer, Berlin, pp 317–330
Kowalczuk Z, Czubenko M (2016) Computational approaches to modeling artificial emotion-an overview of the proposed solutions. Front Robot AI 3:21
Kshirsagar S (2002) A multilayer personality model. In: Proceedings of the 2nd international symposium on Smart graphics. ACM, pp 107–115
Lazarus RS (1966) Psychological stress and the coping process. McGraw-Hill, London
Lazarus RS (1991) Emotion and adaptation. Oxford University Press on Demand, Oxford
LeDoux JE (1996) The emotional brain: the Mysterious Underpinnings of Emotional Life. Simon & Schuster, New York
LeVine RA (1963) Culture and personality. Bienn Rev Anthropol 3:107–145
Lim MY, Dias J, Aylett R, Paiva A (2012) Creating adaptive affective autonomous NPCs. Auton Agents Multi-Agent Syst 24(2):287–311
Lin J, Spraragen M, Zyda M (2012) Computational models of emotion and cognition. In: Advances in cognitive systems, Citeseer
Marinier III RP, Laird JE (2004) Toward a comprehensive computational model of emotions and feelings. In: ICCM, pp 172–177
Marinier III RP, Laird JE (2007) Computational modeling of mood and feeling from emotion. In: Proceedings of the cognitive science society, vol 29
Marinier RP III, Laird JE, Lewis RL (2009) A computational unification of cognitive behavior and emotion. Cognit Syst Res 10(1):48–69
Marsella S, Gratch J, Petta P et al (2010) Computational models of emotion. In: A Blueprint for Affective Computing-A sourcebook and manual, vol 11. Oxford University Press, New York, pp 21–46
Marsella SC (2003) Interactive pedagogical drama: Carmen’s bright ideas assessed. In: International workshop on intelligent virtual agents. Springer, Berlin, pp 1–4
Marsella SC, Gratch J (2009) EMA: a process model of appraisal dynamics. Cognit Syst Res 10(1):70–90
Mascarenhas S, Dias J, Prada R, Paiva A (2010) A dimensional model for cultural behavior in virtual agents. Appl Artif Intell 24(6):552–574
McCrae RR, John OP (1992) An introduction to the five-factor model and its applications. J Pers 60(2):175–215
Mehrabian A (1996a) Analysis of the big-five personality factors in terms of the pad temperament model. Aust J Psychol 48(2):86–92
Mehrabian A (1996b) Pleasure-arousal-dominance: a general framework for describing and measuring individual differences in temperament. Curr Psychol 14(4):261–292
Meyer JJC (2006) Reasoning about emotional agents. Int J Intell Syst 21(6):601–619
Mill JS (1901) Utilitarianism. Longmans, Green and Company, Harlow
Minsky M (1988) Society of mind. Simon and Schuster, New York
Mitsunaga N, Miyashita Z, Shinozawa K, Miyashita T, Ishiguro H, Hagita N (2008) What makes people accept a robot in a social environment-discussion from six-week study in an office. In: IEEE/RSJ international conference on intelligent robots and systems. IEEE, pp 3336–3343
Moffat D, Frijda N, Phaf R, et al (1993) Analysis of a model of emotions. In: Prospects for artificial intelligence: proceedings of AISB93, pp 219–228
Moors A (2009) Theories of emotion causation: a review. In: Hermans D, Houwer JD (eds) Cognition and emotion. Psychology Press, pp 625–662. https://www.uv.mx/rmipe/files/2017/12/cognition_and_emotion.pdf#page=12
Morris WN (1992) A functional analysis of the role of mood in affective systems. https://psycnet.apa.org/record/1992-97396-010
Moshkina L (2006) An integrative framework for affective agent behavior. In: International conference on intelligent systems and control
Moshkina L, Park S, Arkin RC, Lee JK, Jung H (2011) TAME: time-varying affective response for humanoid robots. Int J Soc Robot 3(3):207–221
Neumann R, Seibt B, Strack F (2001) The influence of mood on the intensity of emotional responses: disentangling feeling and knowing. Emot Cognit 15:725–747
Newell A (1994) Unified theories of cognition. Harvard University Press, Cambridge
Ojha S, Williams M (2017) Emotional appraisal: a computational perspective. In: Annual conference on advances in cognitive systems
Ojha S, Williams MA (2016) Ethically-guided emotional responses for social robots: should i be angry? In: International conference on social robotics. Springer, Berlin, pp 233–242
Ojha S, Gudi SLKC, Vitale J, Williams MA, Johnston B (2017) I remember what you did: A bheavioural guide-robot. In: International conference on robot intelligence technology and applications (RiTA)
Ojha S, Vitale J, Williams M (2017) A domain-independent approach of cognitive appraisal augmented by higher cognitive layer of ethical reasoning. In: Annual meeting of the cognitive science society
Ojha S, Vitale J, Ali Raza S, Billingsley R, Williams MA (2018) Implementing the dynamic role of mood and personality in emotion processing of cognitive agents. In: Annual conference on advances in cognitive systems (ACS)
Ojha S, Williams MA, Johnston B (2018b) The essence of ethical reasoning in robot-emotion processing. Int J Soc Robot (IJSR) 10:211–223
Ojha S, Vitale J, Ali Raza S, Billingsley R, Williams MA (2019) Integrating mood and personality with agent emotions. In: International conference on autonomous agents and multiagent systems (AAMAS)
Ortony A, Clore GL, Collins A (1990) The cognitive structure of emotions. Cambridge University Press, Cambridge
Parkinson B, Totterdell P, Briner RB, Reynolds S (1996) Changing moods: the psychology of mood and mood regulation. Longman, Harlow
Petta P (2003) The role of emotions in a tractable architecture for situated cognizers. In: Emotions in humans and artifacts, pp 251–288. https://psycnet.apa.org/record/2003-06128-008
Pettit P (1993) Consequentialism. https://www.jstor.org/stable/2254174?seq=1
Picard RW (1997) Affective computing, vol 252. MIT Press, Cambridge
Plutchik R (1980) A general psychoevolutionary theory of emotion. Theories of emotion 1. https://www.sciencedirect.com/science/article/pii/B9780125587013500077
Price DD, Barrell JE, Barrell JJ (1985) A quantitative-experiential analysis of human emotions. Motiv Emot 9(1):19–38
Rank S (2009) Behaviour coordination for models of affective behaviour. Ph.D. thesis, Vienna University of Technology
Rasool Z, Masuyama N, Islam MN, Loo CK (2015) Empathic interaction using the computational emotion model. In: IEEE symposium series on computational intelligence. IEEE, pp 109–116
Reilly SN (2006) Modeling what happens between emotional antecedents and emotional consequents. ACE 19:469–498
Reilly WS (1996) Believable social and emotional agents. Ph.D. thesis
Reilly WS, Bates J (1992) Building emotional agents. Technical Report CM UC S-92-143
Reisenzein R (2001) Appraisal processes conceptualized from a schema-theoretic perspective: contributions to a process analysis of emotions. In: Appraisal processes in emotion: theory, methods, research. Series in affective science. Oxford University Press, New York, pp 187–201
Revelle W (1995) Personality processes. Annu Rev Psychol 46(1):295–328
Revelle W, Scherer KR (2009) Personality and emotion. In: Oxford companion to emotion and the affective sciences, pp 304–306. https://global.oup.com/academic/product/oxford-companion-to-emotion-and-the-affective-sciences-9780198569633?cc=au&lang=en&
Roseman IJ (1996) Appraisal determinants of emotions: constructing a more accurate and comprehensive theory. Cognit Emot 10(3):241–278
Roseman IJ, Spindel MS, Jose PE (1990) Appraisals of emotion-eliciting events. J Pers Soc Psychol 59(5):899–915
Rousseau D, et al (1996) Personality in computer characters. In: Proceedings of the 1996 AAAI workshop on entertainment and AI/A-Life, pp 38–43
Russell JA, Mehrabian A (1977) Evidence for a three-factor theory of emotions. J Res Pers 11(3):273–294
Rusting CL (1998) Personality, mood, and cognitive processing of emotional information: three conceptual frameworks. Psychol Bull 124(2):165
Rusting CL (1999) Interactive effects of personality and mood on emotion-congruent memory and judgment. J Pers Soc Psychol 77(5):1073
Saunier J, Jones H (2014) Mixed agent/social dynamics for emotion computation. In: Proceedings of the 2014 international conference on Autonomous agents and multi-agent systems. International Foundation for Autonomous Agents and Multiagent Systems, pp 645–652
Scherer KR (2001) Appraisal considered as a process of multilevel sequential checking. Appraisal Processes Emot Theory Methods Res 92(120):57
Scherer KR, Wranik T, Sangsue J, Tran V, Scherer U (2004) Emotions in everyday life: probability of occurrence, risk factors, appraisal and reaction patterns. Soc Sci Inf 43(4):499–570
Schneider M, Adamy J (2014) Towards modelling affect and emotions in autonomous agents with recurrent fuzzy systems. In: International conference on systems, man and cybernetics. IEEE, pp 31–38
Si M, Marsella S, Pynadath D (2006) Thespian: modeling socially normative behavior in a decision-theoretic framework. In: Intelligent virtual agents. Springer, pp 369–382. https://link.springer.com/chapter/10.1007/11821830_30
Singh P, et al (2005) Em-one: an architecture for reflective commonsense thinking. Ph.D. thesis, Massachusetts Institute of Technology
Sloman A (2001) Varieties of affect and the cogaff architecture schema. In: Proceedings of the AISB’01 symposium on emotions, cognition, and affective computing, vol 58
Smith CA, Kirby LD (2001) Toward delivering on the promise of appraisal theory. In: Series in affective science. Appraisal processes in emotion: theory, methods, research. Oxford University Press, pp 121–138. https://psycnet.apa.org/record/2001-06810-006
Smith CA, Lazarus RS et al (1990) Emotion and adaptation. Theory and research, Handbook of personality, pp 609–637. https://psycnet.apa.org/record/1990-98135-023
Steunebrink BR, Dastani M, Meyer JJC, et al (2007) A logic of emotions for intelligent agents. In: Proceedings of the national conference on artificial intelligence. AAAI Press, Menlo Park; MIT Press, London; 1999, vol 22, p 142
Steunebrink BR, Meyer JJC, Dastani M (2008) A formal model of emotions: integrating qualitative and quantitative aspects. In: Dagstuhl seminar proceedings, Schloss Dagstuhl-Leibniz-Zentrum für Informatik. http://ebooks.iospress.nl/publication/4370
Sun R (2006) The clarion cognitive architecture: extending cognitive modeling to social simulation. Cognition and multi-agent interaction, pp 79–99
Sun R, Wilson N, Lynch M (2016) Emotion: a unified mechanistic interpretation from a cognitive architecture. Cognit Comput 8(1):1–14
Swagerman J (1987) The artificial concern realization system ACRES: A computer model of emotion. Ph.D. thesis
Tomkins S (1962) Affect imagery consciousness: Volume I: the positive affects. Springer, Berlin
van der Hoek W, van Linder B, Meyer JJC (1999) An integrated modal approach to rational agents. In: Foundations of rational agency. Springer, pp 133–167. https://link.springer.com/chapter/10.1007/978-94-015-9204-8_7
Velásquez J (1997) Modeling emotions and other motivations in synthetic agents. In: AAAI/IAAI, pp 10–15
Velásquez JD (1999) An emotion-based approach to robotics. In: International conference on intelligent robots and systems (IROS). IEEE, vol 1, pp 235–240
Velásquez JD, Maes P (1997) Cathexis: a computational model of emotions. In: Proceedings of the first international conference on Autonomous agents, ACM, pp 518–519.
Watson D, Clark LA (1997) Extraversion and its positive emotional core. https://psycnet.apa.org/record/1997-08808-029
Zadeh LA (1996) Fuzzy sets. Fuzzy sets, fuzzy logic, and fuzzy systems, Selected Papers by Lotfi A Zadeh. World Scientific, Singapore, pp 394–432
Acknowledgements
We would like to acknowledge that the content of this paper has been extracted from the doctoral dissertation of Suman Ojha submitted to the University of Technology Sydney (UTS), Australia.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Ojha, S., Vitale, J. & Williams, MA. Computational Emotion Models: A Thematic Review. Int J of Soc Robotics 13, 1253–1279 (2021). https://doi.org/10.1007/s12369-020-00713-1
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12369-020-00713-1