Abstract
Curtin University’s Talking Heads (TH) combine an MPEG-4 compliant Facial Animation Engine (FAE), a Text To Emotional Speech Synthesiser (TTES), and a multi-modal Dialogue Manager (DM), that accesses a Knowledge Base (KB) and outputs Virtual Human Markup Language (VHML) text which drives the TTES and FAE. A user enters a question and an animated TH responds with a believable and affective voice and actions. However, this response to the user is normally marked up in VHML by the KB developer to produce the required facial gestures and emotional display. A real person does not react by fixed rules but on personality, beliefs, good and bad previous experiences, and training. This paper reviews personality theories and models relevant to THs, and then discusses the research at Curtin over the last five years in implementing and evaluating personality models. Finally the paper proposes an active, adaptive personality model to unify that work.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Cassell, J., et al. (eds.): Embodied Conversational Agents, p. 430. MIT Press, Cambridge (2001)
Ruttkay, Z., Dormann, C., Noot, H.: Evaluating ECAs – What and how? In: AAMAS Workshop on Embodied conversational agents, Bologna, Italy (2002)
ISO/IEC, Text for ISO/IEC FDIS 14496-1 Systems. ISO/IEC (1998a), Online at http://www.cselt.it/mpeg/working_documents.htm
Pandzic, I.S., Forchheimer, R.: MPEG-4 Facial Animation - The standard, implementations and applications. John Wiley & sons, Chichester (2002)
Lavagetto, F., Pockaj, R.: The Facial Animation Engine: towards a high-level interface for the design of MPEG-4 compliant animated faces. IEEE Trans. on Circuits and Systems for Video Technology 9(2) (1999)
Stallo, J.: Simulating Emotional Speech for a Talking Head, in School of Computing. Curtin University of Technology, Perth (2000)
Marriott, A., et al.: The Face of the Future. Journal of Research and Practice in Information Technology 32(3/4), 231–245 (2001b)
Marriott, A.: A Facial Animation case study for HCI: the VHML-based Mentor System. In: Pandzic, I., Forchheimer, R. (eds.) MPEG-4 Facial Animation - The standard, implementations and applications. John Wiley, New York (2002)
Marriott, A., Shortland-Jones, B.: The Mentor System, in "Tutorial Dialogue Systems: With a View Towards the Classroom". In: Workshop Proceedings of 11th International Conference on Artificial Intelligence in Education, AIED 2003, Sydney, Australia, July 18 (2003)
Marriott, A., Beard, S.: gUI. Specifying Complete User Interaction, in Life-Like Characters. In: Prendinger, H., Ishizuka, M. (eds.) Tools, Affective Functions and Applications, pp. 111–134. Springer, Berlin (2004)
Marriott, A.: VHML in Special IST 5th Framework workshop on VHML, February 5-6. European Union IST, Bruxelles (2002)
Marriott, A., et al.: VHML - Directing a Talking Head. In: Liu, J., Yuen, P.C., Li, C.-H., Ng, J., Ishida, T. (eds.) AMT 2001. LNCS, vol. 2252, pp. 90–100. Springer, Heidelberg (2002)
Gustavsson, C., Strindlund, L., Wiknertz, E.: Verification, Validation and Evaluation of the Virtual Human Markup Language (VHML). In: Institutionen för Systemteknik. LIU, Linkoping (2002)
Beard, S., Reid, D.: MetaFace and VHML: A First Implementation of the Virtual Human Markup Language. In: AAMAS workshop on Embodied Conversational Agents - let’s specify and evaluate them!, AAMAS 2002, Bologna, Italy (2002)
Marriott, A., Beard, S.: VHML Standardisation. In: Special IST 5th Framework meeting on Representation Formats/Languages, July 18. European Union IST, Bologna (2002)
Barker, T.: The Illusion of Life Revisited. In: AAMAS 2003 Workshop on Embodied conversational characters as individuals, Melbourne, Australia (2003)
Breese, J., Ball, G.: Modeling Emotional State and Personality for Conversational Agents, in Technical Report, Microsoft Corporation (1998)
André, E., et al.: Integrating Models of Personality and Emotions into Lifelike Characters. In: Proceedings of the workshop on Affect in Interactions - Towards a new Generation of Interfaces in conjunction with the 3rd i3 Annual Conference, Siena, Italy (1999)
Bartneck, C.: Integrating the OCC Model of Emotions in Embodied Characters. In: Workshop on Virtual Conversational Characters: Applications, Methods, and Research Challenges, Melbourne (2002)
Kshirsagar, S.: A Multilayer Personality Model. In: Proceedings of 2nd International Symposium on Smart Graphics, Hawthorne, New York (2002)
Egges, A., Kshirsagar, S.: Generic Personality and Emotion Simulation for Conversational Agents. Computer Animation and Virtual Worlds 15(1), 1–13 (2004)
Wilson, I.: The Artificial Emotion Engine TM, Driving Emotional Behavior. In: The AAAI 2000 Spring Symposium on Artificial Intelligence and Interactive Entertainment. AAAI Press, Menlo Park (1999)
Moffat, D.: Personality Parameters and Programs. In: Creating Personalities for Synthetic Actors, pp. 120–165. Springer, New York (1997)
Bates, J.: The role of emotion in believable agents. Communications of the ACM 37(7), 122–125 (1994)
Vélasquez, J.D.: Modeling emotions and other motivations in synthetic agent. In: Proceedings of the AAAI Conference 1997. AAAI Press and the MIT Press (1997)
Reilly, W.S., Bates, J.: Building Emotional Agents, School of Computer Science. Carnegie Mellon University, Pittsburgh (1992)
Gratch, J.É.: Marshalling Passions in Training and Education. In: Proceedings of the 4th International Conference on Autonomous Agents, Barcelona, Spain (2000)
Prendinger, H., Descamps, S., Ishizuka, M.: Scripting the Bodies and Minds of Life-like Characters. In: The 7th Pacific Rim International Conference on Artificial Intelligence, Tokyo, Japan (2002)
Ortony, A., Clore, G., Collins, A.: The Cognitive Structure of Emotions. Cambridge University Press, Cambridge (1988)
Ekman, P., Friesen, W.V., Ellsworth, P.: Emotion in the Human Face. In: Goldstein, A.P. (ed.) Guidelines for Research and an Integration of Findings, p. 191. Pergamon Press Inc., New York (1972)
Rousseau, D., Hayes-Roth, B.: A Social-Psychological Model for Synthetic Actors, Knowledge Systems Laboratory, Stanford University (1997)
Pervin, L.A., John, O.P.: Personality: Theory and Research, p. 656. John Wiley & Sons, Inc., New York (2001)
Hewstone, M., Fincham, F.D., Foster, J. (eds.): Psychology. Blackwell, Oxford (2005)
Nass, C., et al.: Can Computer Personalities Be Human Personalities? International Journal of Human-Computer Studies 43(2), 223–239 (1995)
Rousseau, D.: Personality in Computer Characters. In: Proceedings of the 1996 AAAI Workshop on Entertainment and AI / A-Life, Portland (1996)
Myers, D.G.: Psychology, p. 741. Worth publishers, New York (2004)
Bandura, A.: Social Learning Theory. Prentice-Hall Inc., Englewood Cliffs (1977)
Eysenck, S.B.G., Eysenck, H.J.: The validity of questionnaire and rating assessments of extraversion and neuroticism, and their factorial stability. British Journal of Psychology 54(1), 51–62 (1963)
McCrae, R.R., John, O.P.: An introduction to the five-factor model and its applications. Journal of Personality 60, 175–215 (1992)
Acton, G.S.: Interpersonal Theory (1998)
Ghasem-Aghaee, N., Ören, T.I.: Towards Fuzzy Agents with Dynamic Personality for Human Behavior Simulation. In: Proceedings of the 2003 Summer Computer Simulation Conference, Montreal, PQ, Canada (2003)
Allport, G.W.: Personality: A psychological interpretation. Henry Holt, New York (1937)
Bui, T.D., et al.: ParleE: An adaptive plan-based event appraisal model of emotions. In: Proceedings KI 2002, 25th German Conference on Artificial Intelligence, Springer, Aachen (2002)
Byrne, D., Griffitt, W., Stefaniak, D.: Attraction and Similarity of Personality Characteristics. Journal of Personality and Social Psychology 5, 82–90 (1967)
Shepherdson, R.H.: The personality of a Talking Head. In: School of Computing. Curtin University of Technology, Perth (2000)
Gulland, E.K.: Psychological Modelling of an Asynchronous Idle-Time Personality for a Talking Head. In: School of Computing. Curtin University of Technology, Perth (2001)
Lester, J.C., Stone, B.A.: Increasing Believability in Animated Pedagogical Agents. In: First International Conference on Autonomous Agents. ACM, New York (1997)
Petta, P.: Principled generation of expressive behavior in an interactive exhibit. In: Workshop on Emotion-Based Agent Architectures, Seattle, USA (1999)
Dam, H., Souza, S.d.: Applying Talking Head Technology to a Web based Weather Service. In: Virtual Conversational Characters Workshop, Human Factors 2002, Melbourne (2002)
Beard, S., Reid, D., Shepherdson, R.: Believable and Interactive Talking Heads for Websites: MetaFace and MPEG-4. In: 6th International Computer Science Conference: Active Media Technology, Hong Kong (2001)
Beard, S.: MetaFace: A Virtual Face Framework and Metaphor. In: Department of Computer science. Curtin University of Technology, Perth (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Xiao, H., Reid, D., Marriott, A., Gulland, E.K. (2005). An Adaptive Personality Model for ECAs. In: Tao, J., Tan, T., Picard, R.W. (eds) Affective Computing and Intelligent Interaction. ACII 2005. Lecture Notes in Computer Science, vol 3784. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11573548_82
Download citation
DOI: https://doi.org/10.1007/11573548_82
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-29621-8
Online ISBN: 978-3-540-32273-3
eBook Packages: Computer ScienceComputer Science (R0)