Skip to main content

Attentive Conversational Agent with Internal State Transition for Multiple Users

  • Chapter
Modeling Machine Emotions for Realizing Intelligence

Part of the book series: Smart Innovation, Systems and Technologies ((SIST,volume 1))

  • 717 Accesses

Abstract

In this chapter, we discuss how to add emotion to virtual agents and how this influences human-agent communication. Firstly, we conducted a preliminary experiment to investigate which kind of emotions we human beings represent during human to human communication. How do we represent them, and how they change. As a consequence of this analysis, we constructed a state transition model, where the agent has emotions as internal states. We change them according to the particular situation. To realize this model, we thought that the method of machine learning and especially the method of Support Vector Machine(SVM), would be useful. We implemented an agent using that model, and conducted an experiment. We did questionnaire survey and a GNAT test to evaluate the performance of the implemented agent. After analyzing these results combined together, we concluded that our model worked well when representing the natural nonverbal behaviors, which should convey agent’s present emotion. We couldn’t get a satisfactory result in the aspect of verbal behavior. Further research is necessary especially on the verbal aspect. In addition to this, we also plan to consider a model of users’ emotion during the conversation and then integrate it into the model.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Cassell, J., Churchill, E., Prevost, S., Sullivan, J., Prevost, S., Churchill, E. (eds.): Embodied conversational agents. MIT Press, Cambridge (2000)

    Google Scholar 

  2. Prendinger, H., Ishizuka, M. (eds.): Life-Like Characters: Tools, Affective Functions, and Applications (Cognitive Technologies). Springer, Heidelberg (2004)

    Google Scholar 

  3. Nishida, T. (ed.): Conversational Informatics: An Engineering Approach. John Wiley & Sons, Chichester (2007)

    Google Scholar 

  4. Ortony, A., Clore, G.L., Collins, A.: The cognitive structure of emotions. Cambridge university press, Cambridge (1988)

    Google Scholar 

  5. Mehrabian, A.: Pleasure-arousal-dominance: A general framework for describing and measuring individual differences in temperament. Current Psychology 14(4), 261–292 (1996)

    Article  MathSciNet  Google Scholar 

  6. Becker, C., Kopp, S., Pfeiffer-LeBmann, N., Wachsmuth, I.: Virtual humans growing up: From primary toward secondary emotions. KI - Kuenstliche Intelligenz 1, 23–27 (2008)

    Google Scholar 

  7. Gebhard, P., Schroder, M., Charfuelan, M., Endres, C., Kipp, M., Pammi, S., Rumpler, M., Turk, O.: IDEAS4 Games: Building Expressive Virtual Characters for Computer Games. In: Proceedings of the 8th international conference on Intelligent Virtual Agents, pp. 426–440. Springer, Heidelberg (2008)

    Google Scholar 

  8. Gratch, J., Marsella, S.: A domain-independent framework for modeling emotion. Cognitive Systems Research 5(4), 269–306 (2004)

    Article  Google Scholar 

  9. Gratch, J., Wang, N., Gerten, J., Fast, E., Duffy, R.: Creating rapport with virtual agents. In: Pelachaud, C., Martin, J.-C., André, E., Chollet, G., Karpouzis, K., Pelé, D. (eds.) IVA 2007. LNCS (LNAI), vol. 4722, p. 125. Springer, Heidelberg (2007)

    Chapter  Google Scholar 

  10. Ball, G., Breese, J.: Emotion and personality in a conversational agent. In: Embodied conversational agents, pp. 189–219 (2000)

    Google Scholar 

  11. Wilson, I.: The Artificial Emotion Engine, Driving Emotional Behavior. In: AAAI Spring Symposium on Artificial Intelligence and Interactive Entertainment, pp. 20–22 (2000)

    Google Scholar 

  12. OmronCorporation.: OKAO Vision, Website (2008), http://www.omron.com/r_d/coretech/vision/okao.html

  13. Kijima, H., Bono, M., Sumi, Y., Nishida, T.: Development of the environment for multimodal interaction analysis [in japanese]. Information Processing Society of Japan (IPSJ) SIG technical reports, 63–70 (2007)

    Google Scholar 

  14. Chang, C.C., Lin, C.J.: LIBSVM: a library for support vector machines (2001), Software, available at http://www.csie.ntu.edu.tw/~cjlin/libsvm

  15. Huang, H., Nishida, T., Cerekovic, A., Pandzic, I., Nakano, Y.: The design of a generic framework for integrating ECA components. In: Proceedings of the 7th international joint conference on Autonomous agents and multiagent systems. International Foundation for Autonomous Agents and Multiagent Systems, Richland, SC, vol. 1, pp. 128–135 (2008)

    Google Scholar 

  16. VisageTechnologiesAB.: visage|SDKTM, Website (2009), http://www.visagetechnologies.com/products_sdk.html

  17. Nosek, B.A., Banaji, M.R.: The go/no-go association task. In: Social Cognition, vol. 19, pp. 625–664 (2001)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer Berlin Heidelberg

About this chapter

Cite this chapter

Ohashi, H., Huang, HH., Nishida, T. (2010). Attentive Conversational Agent with Internal State Transition for Multiple Users. In: Nishida, T., Jain, L.C., Faucher, C. (eds) Modeling Machine Emotions for Realizing Intelligence. Smart Innovation, Systems and Technologies, vol 1. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-12604-8_7

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-12604-8_7

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-12603-1

  • Online ISBN: 978-3-642-12604-8

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics