skip to main content
10.1145/1655260.1655264acmconferencesArticle/Chapter ViewAbstractPublication Pagesicmi-mlmiConference Proceedingsconference-collections
research-article

Towards an intelligent affective multimodal virtual agent for uncertain environments

Published:06 November 2009Publication History

ABSTRACT

Affective interaction between a user and a virtual agent must be believable. The virtual actor has to behave properly, to have the capacity to talk in natural language and to express some affectivity. For achieving this goal, it is basic to provide the agent with intelligence to let him make all kind of real-time decisions in complex situations. In this paper, an architecture for the user interaction with intelligent affective multimodal virtual agents in uncertain environments is proposed. It is based on the integration of Maxine, a powerful multimodal animation engine for managing virtual agents and 3D scenarios, and PROPHET, a cognitive intelligent system based on Fuzzy Logic. The outstanding features of the proposed architecture are its affective and intelligence capabilities that make the system able to cope with decisions based on the analysis and learning of information and perceptions coming from uncertain environments.

References

  1. Cassell, J., Sullivan, J., Prevost, S. and Churchill E. 2000. Embodied conversational agents. Cambridge, MIT Press.Google ScholarGoogle Scholar
  2. Canny, J. 2006. The future of human-computer interaction. ACM Queue, Vol. 4, No. 6 (Jul./Aug. 2006). Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Pantic, M. and Bartlett, M. S. 2007. Machine Analysis of Facial Expressions. Face Recognition. K. Delac and M. Grgic, Eds. I-Tech Education and Publishing, Vienna, Austria, 377--416.Google ScholarGoogle Scholar
  4. Jaume-i-Capó, A., Varona, J. and Perales, F. J. 2006. Interactive applications driven by human gestures. Ibero-American Symposium on Computer Graphics (Santiago de Compostela, Spain, Jul. 2006).Google ScholarGoogle Scholar
  5. Cowie, R., Douglas-Cowie, E. and Schroeder, M. 2000. ICSA Workshop on Speech and Emotion: a Conceptual Framework for Research (Belfast).Google ScholarGoogle Scholar
  6. Egges, A., Kshirsagar, S. and Magnenat-Thalmann, N. 2004. Generic personality and emotion simulation for conversational agents. Computer Animation and Virtual Worlds, Vol. 15, No. 1, 1--13. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Magnenat-Thalmann, N. 2003. Creating a Smart Virtual Personality. Knowledge-Based Intelligent Information and Engineering Systems 2003, LNCS, Springer, Heidelberg, 15--16.Google ScholarGoogle Scholar
  8. Zadeh, L. A. 2003. Computing with Words and Perceptions - A Paradigm. Computing and Decision Analysis and Machine Intelligence, Proceedings of the 2003 International Conference on Machine Learning and Applications, 3--5.Google ScholarGoogle Scholar
  9. Baldassarri, S., Cerezo, E. and Seron, F. J. 2008. Maxine: a platform for embodied Animated Agents. Computers&Graphics, Vol. 32, No. 4, 430--437. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Hupont, I., Baldassari, S., Cerezo, E. and Del Hoyo, R. 2008. Effective emotional classification combining facial classifiers and user assessment. V Conference on Articulated Motion and Deformable Objects, LNCS, Springer, No. 5098, 431--440. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Del Hoyo, R., Ciprés, D., Prieto, J., Del Barrio, M., Polo, L. and Calahorra, R. 2007. PROPHET: Herramienta para la Toma de Decisiones en Sistemas Complejos. II Simposio de Inteligencia Computacional 2007 (Zaragoza, Spain).Google ScholarGoogle Scholar
  12. Del-Hoyo, R., Martín-del-Brío, B., Medrano, N. and Fernández-Navajas, J. Computational Intelligence Tools for Next Generation Quality of Service Management. Neurocomputing, 2009, in press. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. https://www.hibernate.org/Google ScholarGoogle Scholar
  14. Lin, C. T., and Lee, C. S. G. 1996. Neural Fuzzy Systems: A Neuro-Fuzzy Synergism to Intelligent Systems. Upper Saddle River, NJ: Prentice Hall. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Towards an intelligent affective multimodal virtual agent for uncertain environments

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in
        • Published in

          cover image ACM Conferences
          AFFINE '09: Proceedings of the International Workshop on Affective-Aware Virtual Agents and Social Robots
          November 2009
          47 pages

          Copyright © 2009 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 6 November 2009

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader