Abstract
In this paper we introduce a simple model based on probabilistic finite state automata to describe an emotional interaction between a robot and a human user, or between simulated agents. Based on the agent’s personality, attitude, and nature, and on the emotional inputs it receives, the model will determine the next emotional state displayed by the agent itself. The probabilistic and time-varying nature of the model yields rich and dynamic interactions, and an autonomous adaptation to the interlocutor. In addition, a reinforcement learning technique is applied to have one agent drive its partner’s behavior toward desired states. The model may also be used as a tool for behavior analysis, by extracting high probability patterns of interaction and by resorting to the ergodic properties of Markov chains.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Anderson K, McOwan P (2006) A real-time automated system for the recognition of human facial expressions. IEEE Trans Syst Man Cybern B Cybern 36(1): 96–105
André E, Klesen M, Gebhard P, Allen S, Rist T (1999) Integrating models of personality and emotions into lifelike characters. In: Proceedings of the workshop on affect in interactions—Towards a new Generation of Interfaces, pp 136–149
Argyle M (1975) Bodily communication. International Universities Press, Inc.
Campadelli P, Lanzarotti R (2002) Localization of facial features and fiducial points. In: Proceedings of the IASTED International Conference Visualisation, Imaging and image (VIIP2002)
Chernova S, Arkin RC (2007) From deliberative to routine behaviors: a cognitively inspired action-selection mechanism for routine behavior capture. Adapt Behav 15: 199–216
Chittaro L, Serra M (2004) Behavioral programming of autonomous characters based on probabilistic automata and personality: Research articles. Comput Anim Virtual Worlds 15(3–4): 319–326
Ciota Z (2005) Emotion recognition on the basis of human speech. In: The 18th International Conference on Applied Electromagnetics and Communications
Cormen TH, Leiserson CE, Rivest RL, Stein C (2001) Introduction to Algorithms, 2nd edn. The MIT Press, Cambridge
Damasio A (1994) Descartes’ error: emotion, reason, and the human brain. Avon Books
Doshi P, Gmytrasiewicz P (2004) Towards affect-based approximations to rational planning: a decision-theoretic perspective to emotions. In: Working Notes of the Spring Symposium on Architectures for Modeling Emotion: Cross-Disciplinary Foundations
Ekman P (1992) An argument for basic emotions. Cogn Emot 6(3–4): 169–200
Ekman P, Friesen WV (1978) Manual for the Facial Action Coding System. Consulting Psychologists Press, Palo Alto
Fabri M, Moore DJ, Hobbs DJ (1999) The emotional avatar: non-verbal communication between inhabitants of collaborative virtual environments. In: Proceedings of the International gesture workshop on gesture-based communication in human-computer interaction (GW ’99), pp 269–273
Häggström O (2002) Finite Markov Chains and Algorithmic Applications. Cambridge University Press, London
Hopcroft JE, Ullman JD (1979) Introduction to automata theory, languages and computation. Addison-Wesley, Reading
Inamura T, Inaba M, Inoue H (2004) Pexis: probabilistic experience representation based adaptive interaction system for personal robots. Syst Comput Jpn 35(6): 98–109
Iosifescu M (1980) Finite Markov processes and their applications. Wiley, NY
James W (1884) What is an emotion?. Mind 9: 188–205
Kopecek I (2003) Constructing personality model from observed communication. In: Proceedings of the 9th International Conference on user modeling; assessing and adapting to user attitides and effect: why, when and how? pp 28–30
Kuhnlenz K, Buss M (2004) Towards an emotion core based on a hidden markov model. In: Proceedings of the 13th IEEE international workshop on robot and human interactive communication (RO-MAN 2004)
Lester JC, Towns SG, Callaway CB, Voerman JL, FitzGerald PJ (2000) Deictic and emotive communication in animated pedagogical agents. In: Embodied conversational agents, MIT Press, Cambridge, pp 123–154
Magnenat-Thalmann N, Primeau E, Thalmann D (1988) Abstract muscle action procedures for human face animation. Vis Comput 3(5): 290–297
Nomura T (1996) Generation of relations between individuals based on a stochastic automaton and an analogy from social psychology. In: Proceedings of the ALIFE V Poster Presentations, pp 125–132
Ortony A, Clore GL, Collins A (1988) The cognitive structure of emotion. Cambridge University Press, Cambridge
Paz A (1971) Introduction to probabilistic automata. Academic Press, London
Picard RW (1997) Affective Computing. MIT Press, Cambridge
Picard RW, Vyzas E, Healey J (2001) Toward machine emotional intelligence: analysis of affective physiological state. IEEE Trans Pattern Anal Mach Intell 23(10): 1175–1191
Rabin MO (1963) Probabilistic automata. Inf Control 6(3): 230–245
Ryckman RM (2003) Theories of personality, 8th edn. Wadsworth Publishing, Belmont
Scherer KR (1984) On the nature and function of emotion: A component process approach. In: Approaches to emotion, Lawrence Erlbaum Associates, pp 293–317
Schlosberg H (1954) Three dimensions of emotion. Psychol Rev 61(2): 81–88
Schroeder M (2004) Speech and emotion research: an overview of research frameworks and a dimensional approach to emotional speech synthesis. Dissertation, Saarland University
Silva PRD, Bianchi-Berthouze N (2004) Measuring posture features saliency in expressing affective states. In: Proceedings of the 2004 IEEE international conference on intelligent robots and systems (IROS’04), pp 2003–2008
Silva PRD, Osano M, Marasinghe A, Madurapperuma AP (2006) Towards recognizing emotion with affective dimensions through body gestures. In: Proceedings of the 7th international conference on automatic face and gesture recognition (FGR06), pp 269–274
Sutton RS, Barto AG (1998) Reinforcement Learning: an Introduction (adaptive computation and machine learning). The MIT Press, Cambridge
Watkins C (1989) Learning from delayed rewards. Dissertation, University of Cambridge, England
Zanna M, Rempel JK (1988) Attitudes: a new look at an old concept. In: Bar-Tal D, Kruglanski A (eds) The social psychology of knowledge. Cambridge University Press, Cambridge 315, pp 315–334
Author information
Authors and Affiliations
Corresponding author
Additional information
An early stage part of this work was presented at the 11th International Conference on Knowledge-Based and Intelligent Information and Engineering Systems (KES 2007).
Rights and permissions
About this article
Cite this article
Cattinelli, I., Goldwurm, M. & Borghese, N.A. Interacting with an artificial partner: modeling the role of emotional aspects. Biol Cybern 99, 473–489 (2008). https://doi.org/10.1007/s00422-008-0254-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00422-008-0254-9