Evaluating an ECA with a Cognitive-Affective Architecture
Article No.: 22, Pages 1 - 8
Abstract
In this paper, we present an embodied conversational agent (ECA) that includes a cognitive-affective architecture based on the Soar cognitive architecture, integrates an emotion model based on ALMA that uses a three-layered model of emotions, mood and personality, from the point of view of the user and the agent. These features allow to modify the behavior and personality of the agent to achieve a more realistic and believable interaction with the user. This ECA works as a virtual assistant to search information from Wikipedia and show personalized results to the user. It is only a prototipe, but can be used to show some of the possibilities of the system. A first evaluation was conducted to prove these possibilities, with satisfactory results that also give guidance for some future work that can be done with this ECA.
References
[1]
Adam, C. and Gaudou, B. (2016). Bdi agents in social simulations: a survey. The Knowledge Engineering Review, 31(3):207--238.
[2]
Allison, M. and Kendrick, L. M. (2013). Towards an expressive embodied conversational agent utilizing multi-ethnicity to augment solution focused therapy. In FLAIRS Conference.
[3]
Anderson, J. R., Bothell, D., Byrne, M. D., Douglass, S., Lebiere, C., and Qin, Y. (2004). An integrated theory of the mind. PSYCHOLOGICAL REVIEW, 111:1036--1060.
[4]
Becker, C., Kopp, S., and Wachsmuth, I. (2004). Simulating the emotion dynamics of a multimodal conversational agent. In Tutorial and Research Workshop on Affective Dialogue Systems, pages 154--165. Springer.
[5]
Becker-Asano, C., Meneses, E., Riesterer, N., HuÃl', J., Dornhege, C., and Nebel, B. (2014). The hybrid agent marco: A multimodal autonomous robotic chess opponent. In Proc. of the 2nd Intl. Conf. on Human-Agent Interaction.
[6]
Berners-Lee, T., Hendler, J., and Lassila, O. (2001). The Semantic Web. Scientific American, 284(5):34--43.
[7]
Bickmore, T. W., Vardoulakis, L. M. P., and Schulman, D. (2013). Tinker: a relational agent museum guide. Autonomous Agents and Multi-Agent Systems, 27(2):254--276.
[8]
Bizer, C., Lehmann, J., Kobilarov, G., Auer, S., Becker, C., Cyganiak, R., and Hellmann, S. (2009). DBpedia - A crystallization point for the Web of Data. Web Semantics: Science, Services and Agents on the World Wide Web, 7(3):154 - 165.
[9]
Bobed, C., Esteban, G., and Mena, E. (2013). Enabling keyword search on Linked Data repositories: An ontology-based approach. International Journal of Knowledge-based and Intelligent Engineering Systems, 17(1):67--77.
[10]
Boukricha, H. and Wachsmuth, I. (2011). Empathy-based emotional alignment for a virtual human: A three-step approach. KI - Künstliche Intelligenz, 25(3):195.
[11]
Bradley, M. and Lang, P. (1994). Measuring emotion: The self-assessment manikin and the semantic differential. Journal of Behavior Therapy and Experimental Psychiatry, 25(1):49--59.
[12]
Calvo, R. A., D'Mello, S., Gratch, J., and Kappas, A. (2014). The Oxford Handbook of Affective Computing. Oxford University Press, Oxford, UK, 1st edition.
[13]
Cassell, J., Sullivan, J., Prevost, S., and Churchill, E. F. (2000). Embodied Conversational Agents. MIT Press.
[14]
Damasio, A. R. (1994). Descartes' error: Emotion, Reason, and the Human Brain. Putnam Grosset Books, New York, 1 edition.
[15]
Dias, J., Mascarenhas, S., and Paiva, A. (2014). Fatima modular: Towards an agent architecture with a generic appraisal framework. In Emotion Modeling, pages 44--56. Springer.
[16]
El-Nasr, M. S., Yen, J., and Ioerger, T. R. (2000). Flame: Fuzzy logic adaptive model of emotions. Autonomous Agents and Multi-Agent Systems, 3(3):219--257.
[17]
Eysenck, H. J. (1991). Dimensions of Personality, pages 87--103. Springer US, Boston, MA.
[18]
Flavián-Blanco, C., Gurrea-Sarasa, R., and Orús-Sanclemente, C. (2011). Analyzing the emotional outcomes of the online search behavior with search engines. Comput. Hum. Behav., 27(1):540--551.
[19]
Gebhard, P. (2005). A layered model of affect. In 4th International Joint Conference of Autonomous Agents & Multi-Agent Systems (AAMAS'05), pages 29--36. ACM Press.
[20]
Helgadóttir, H. E., Jónsdóttir, S., Sigurdsson, A. M., Schiffel, S., and Vilhjálms-son, H. H. (2016). Virtual General Game Playing Agent, pages 464--469. Springer International Publishing, Cham.
[21]
Huang, H.-H., Ida, Y., Yamaguchi, K., and Kawagoe, K. (2016). Development of a Virtual Classroom for High School Teacher Training, pages 489--493. Springer International Publishing, Cham.
[22]
Hupont, I., Baldassarri, S., and Cerezo, E. (2013). Facial emotional classification: from a discrete perspective to a continuous emotional space. Pattern Analysis and Applications, 16(1):41--54.
[23]
Ivanovic, M., Budimac, Z., Radovanovic, M., Kurbalija, V., Dai, W., Badica, C., Colhon, M., Ninkovic, S., and Mitrovic, D. (2015). Emotional agents - state of the art and applications. Comput. Sci. Inf. Syst., 12(4):1121--1148.
[24]
Izard, C. E. (2010). The Many Meanings/Aspects of Emotion: Definitions, Functions, Activation, and Regulation. Emotion Review, 2(4):363--370.
[25]
Johnson, E., HervÃąs, R., de la Franca, C. G. L., MondÃl'jar, T., Ochoa, S. F., and Favela, J. (2016). Assessing empathy and managing emotions through interactions with an affective avatar. Health Informatics Journal, 0(0):1460458216661864.
[26]
Kaptein, F., Broekens, J., Hindriks, K. V., and Neerincx, M. (2016). CAAF: A Cognitive Affective Agent Programming Framework, pages 317--330. Springer International Publishing, Cham.
[27]
Kipp, M., Dackweiler, T., and Gebhard, P. (2011). Designing emotions. KI - KÃ ÿnstliche Intelligenz, 25(3).
[28]
Kopp, S., Gesellensetter, L., Krämer, N. C., and Wachsmuth, I. (2005). Lecture notes in computer science. chapter A Conversational Agent As Museum Guide: Design and Evaluation of a Real-world Application, pages 329--343. Springer-Verlag, London, UK, UK.
[29]
Laird, J. E. (2012). The Soar Cognitive Architecture. The MIT Press.
[30]
Lane, R. D., Nadel, L., Allen, J. J. B., and Kaszniak, A. W. (2000). The study of emotion from the perspective of cognitive neuroscience. In Lane, R. D. and Nadel, L., editors, Cognitive Neuroscience of Emotion. Oxford University Press, New York.
[31]
Langley, P., Laird, J. E., and Rogers, S. (2009). Cognitive architectures: Research issues and challenges. Cogn. Syst. Res., 10(2):141--160.
[32]
Lazarus, R. and Folkman, S. (1984). Stress, Appraisal, and Coping. Springer Publishing Company.
[33]
Malekzadeh, M., Mustafa, M. B., and Lahsasna, A. (2015). A review of emotion regulation in intelligent tutoring systems. Educational Technology & Society, 18(4):435--445.
[34]
Marinier, R. P. and Laird, J. E. (2007). Computational Modeling of Mood and Feeling from Emotion. In Proceedings of the 29th Annual Conference of the Cognitive Science Society. Cognitive Science Society, pages 461--466.
[35]
Marsella, S. C. and Gratch, J. (2009). EMA: A process model of appraisal dynamics. Journal of Cognitive Systems Research, 10(1):70--90.
[36]
McCrae, R. R. and John, O. P. (1992). An introduction to the five-factor model and its applications. Journal of Personality, 60(2):175--215.
[37]
Mehrabian, A. (1996). Pleasure-arousal-dominance: A general framework for describing and measuring individual differences in temperament. Current Psychology, 14(4):261--292.
[38]
Mori, M. (1970). Bukimi no tani {The uncanny valley}. Energy, 7(4):33--35.
[39]
Ochs, M., Devooght, K., Sadek, D., and Pelachaud, C. (2006). A computational model of capability-based emotion elicitation for rational agent. In Proceedings of the 1st workshop on Emotion and Computing-Current Research and Future Impact, Bremen, Germany.
[40]
Ortony, A., Collins, A., and Clore, G. L. (1988). The cognitive structure of emotions. Cambridge University Press Cambridge {England}; New York, pbk. ed. edition.
[41]
Pérez, J., Cerezo, E., Serón, F. J., and Rodríguez, L.-F. (2016). A cognitive-affective architecture for ECAs. Biologically Inspired Cognitive Architectures, 18:33 - 40.
[42]
Picard, R. W. (1997). Affective computing. MIT Press, Cambridge, MA, USA.
[43]
Poggi, I., Pelachaud, C., de Rosis, F., Carofiglio, V., and De Carolis, B. (2005). Greta. A Believable Embodied Conversational Agent, pages 3--25. Springer Netherlands, Dordrecht.
[44]
Rao, A. S. and Georgeff, M. P. (1995). Bdi agents: From theory to practice. In IN PROCEEDINGS OF THE FIRST INTERNATIONAL CONFERENCE ON MULTI-AGENT SYSTEMS (ICMAS-95, pages 312--319.
[45]
Reisenzein, R., Hudlicka, E., Dastani, M., Gratch, J., Hindriks, K., Lorini, E., and Meyer, J.-J. C. (2013). Computational modeling of emotion: Toward improving the inter-and intradisciplinary exchange. Affective Computing, IEEE Transactions on, 4(3):246--266.
[46]
Reithinger, N., Gebhard, P., Löckelt, M., Ndiaye, A., Pfleger, N., and Klesen, M. (2006). Virtualhuman: dialogic and affective interaction with virtual characters. In ICMI '06: Proceedings of the 8th international conference on Multimodal interfaces, pages 51--58, New York, NY, USA.
[47]
Roseman, I. J. (1996). Appraisal determinants of emotions: Constructing a more accurate and comprehensive theory. Cognition & Emotion, 10(3):241--278.
[48]
Rosenbloom, P. S., Demski, A., and Ustun, V. (2016). The Sigma Cognitive Architecture and System: Towards Functionally Elegant Grand Unification. Journal of Artificial General Intelligence.
[49]
Sansonnet, J.-P., Leray, D., and Martin, J.-C. (2006). Architecture of a Framework for Generic Assisting Conversational Agents, pages 145--156. Springer Berlin Heidelberg, Berlin, Heidelberg.
[50]
Scherer, K. R. (2001). Appraisal considered as a process of multi-level sequential checking., pages 92--120. New York and Oxford: Oxford University Press.
[51]
Scherer, K. R., Bänziger, T., and Roesch, E. (2010). A Blueprint for Affective Computing: A sourcebook and manual. Oxford University Press.
[52]
Velásquez, J. D. (1997). Modeling emotions and other motivations in synthetic agents. In Proceedings of the fourteenth national conference on artificial intelligence and ninth conference on Innovative applications of artificial intelligence, pages 10--15, Providence, Rhode Island. AAAI Press.
[53]
Wong, W., Cavedon, L., Thangarajah, J., and Padgham, L. (2012). Flexible conversation management using a bdi agent approach. In Nakano, Y., Neff, M., Paiva, A., and Walker, M., editors, Intelligent Virtual Agents, volume 7502 of Lecture Notes in Computer Science, pages 464--470. Springer Berlin Heidelberg.
Index Terms
- Evaluating an ECA with a Cognitive-Affective Architecture
Recommendations
Automatic understanding of affective and social signals by multimodal mimicry recognition
ACII'11: Proceedings of the 4th international conference on Affective computing and intelligent interaction - Volume Part IIHuman mimicry is one of the important behavioral cues displayed during social interaction that inform us about the interlocutors' interpersonal states and attitudes. For example, the absence of mimicry is usually associated with negative attitudes. A ...
E-VOX: a socially enhanced semantic ECA
DAA '16: Proceedings of the International Workshop on Social Learning and Multimodal Interaction for Designing Artificial AgentsIn this paper, we present E-VOX, an emotionally enhanced semantic ECA designed to work as a virtual assistant to search information from Wikipedia. It includes a cognitive-affective architecture that integrates an emotion model based on ALMA and the ...
ECA Control using a Single Affective User Dimension
ICMI '15: Proceedings of the 2015 ACM on International Conference on Multimodal InteractionUser interaction with Embodied Conversational Agents (ECA) should involve a significant affective component to achieve realism in communication. This aspect has been studied through different frameworks describing the relationship between user and ECA, ...
Comments
Information & Contributors
Information
Published In
September 2018
232 pages
Copyright © 2018 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 12 September 2018
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
Interacción 2018
Interacción 2018: XIX International Conference on Human Computer Interaction
September 12 - 14, 2018
Palma, Spain
Acceptance Rates
Interacción '18 Paper Acceptance Rate 47 of 73 submissions, 64%;
Overall Acceptance Rate 109 of 163 submissions, 67%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 186Total Downloads
- Downloads (Last 12 months)31
- Downloads (Last 6 weeks)2
Reflects downloads up to 03 Mar 2025
Other Metrics
Citations
Cited By
View allView Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in