Skip to main content

Virtual Butler: What Can We Learn from Adaptive User Interfaces?

  • Chapter
Your Virtual Butler

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 7407))

Abstract

In this paper, we discuss approaches and results from the field of User-Adaptive Interfaces that we believe can help advance the research on virtual butlers in general, and for the elderly in particular. We list principles underlying the design of effective mixed-initiative interactions that call for formal approaches to dealing both with the uncertainty on modeling relevant cognitive states of the user (e.g., goals, beliefs, preferences), as well as with the tradeoff between costs and benefits of the agent’s actions under uncertainty. We also discuss the need for virtual butlers to understand the affective states of their users, and to what extent they need to be transparent by providing means for their users to understand the rationale underlying their adaptive interventions.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Horvitz, E.: Principles of Mixed-Initiative User Interfaces. In: Proceedings of CHI 1999, ACM SIGCHI Conference on Human Factors in Computing Systems, Pittsburgh, PA (1999)

    Google Scholar 

  2. Jameson, A.: Adaptive Interfaces and Agents. In: Sears, A., Jacko, J. (eds.) The Human-Computer Interaction Handbook: Fundamentals, Evolving Technologies and Emerging Applications, 2nd edn., pp. 433–458. CRC Press, Boca Raton (2008)

    Google Scholar 

  3. Ferguson, G., Allen, J.: Mixed-Initiative Dialogue Systems for Collaborative Problem-Solving. AI Magazine: Special Issue on Mixed-Initiative Assistants 28(2), 2–32 (2007)

    Google Scholar 

  4. Rich, C., Sidner, C.: DiamondHelp: A generic collaborative task guidance system. AI Magazine: Special Issue on Mixed-Initiative Assistants (2007)

    Google Scholar 

  5. Bickmore, T., Picard, R.: Establishing and maintaining long-term human-computer relationships. ACM Trans. Comput.-Hum. Interact. 12(2), 293–327 (2005)

    Article  Google Scholar 

  6. Dean, T., Kanazawa, K.: A Model for Reasoning about Persistence and Causation. Computational Intelligence 5(3) (1989)

    Google Scholar 

  7. Conati, C.: Probabilistic Assessment of User’s Emotions in Educational Games. Journal of Applied Artificial Intelligence, Special Issue on Merging Cognition and Affect in HCI 16(7-8), 555–575 (2002)

    Article  Google Scholar 

  8. Healey, J.A., Picard, R.W.: Detecting Stress During Real-World Driving Tasks Using Physiological Sensors. IEEE Transactions on Intelligent Transportation Systems 6(2) (2005)

    Google Scholar 

  9. Prendinger, H., Mori, J., Ishizuka, M.: Recognizing, Modeling, and Responding to Users’ Affective States. In: Ardissono, L., Brna, P., Mitrović, A. (eds.) UM 2005. LNCS (LNAI), vol. 3538, pp. 60–69. Springer, Heidelberg (2005)

    Chapter  Google Scholar 

  10. Litman, D.J., Forbes-Riley, K.: Predicting Student Emotions in Computer-Human Tutoring Dialogues. In: 42nd Annual Meeting of the Association for Computational Linguistics, ACL (2004)

    Google Scholar 

  11. Mandryk, R.L., Inkpen, K.M., Calvert, T.W.: Using Psychophysiological Techniques to Measure User Experience with Entertainment Technologies. Journal of Behavior and Information Technology 25 (2006)

    Google Scholar 

  12. D’Mello, S.K., et al.: Automatic Detection of Learner’s Affect from Conversational Cues. User Modeling and User-Adapted Interaction 18(1-2) (2008)

    Google Scholar 

  13. Lang, P.J.: The emotion probe: Studies of motivation and attention. American Psychologist 50 (1995)

    Google Scholar 

  14. D’Mello, S.K., Chipman, P., Graesser, A.C.: Posture as a predictor of learner’s affective engagement. In: Proceedings of the 29th Annual Cognitive Science Society (2006)

    Google Scholar 

  15. Ortony, A., Clore, G.L., Collins, A.: The Cognitive Structure of Emotions. Cambridge University Press (1988)

    Google Scholar 

  16. Lang, P.J., et al.: Look at Pictures: Affective, Facial, Visceral, and Behavioral Reactions. Psychophysiology 30 (1993)

    Google Scholar 

  17. Zhou, X., Conati, C.: Inferring User Goals from Personality and Behavior in a Causal Model of User Affect. In: Proceedings of IUI 2003, International Conference on Intelligent User Interfaces, Miami, FL, U.S.A, pp. 211–218 (2003)

    Google Scholar 

  18. Conati, C., Maclaren, H.: Data-Driven Refinement of a Probabilistic Model of User Affect. In: Ardissono, L., Brna, P., Mitrović, A. (eds.) UM 2005. LNCS (LNAI), vol. 3538, pp. 40–49. Springer, Heidelberg (2005)

    Chapter  Google Scholar 

  19. Klein, J., Moon, Y., Picard, R.: This Computer Responds to User Frustration: Theory, Design, Results, and Implications. Interacting with Computers 14(2), 119–140 (2002)

    Article  Google Scholar 

  20. Burleson, W., Picard, R.W.: Gender-Specific Approaches to Developing Emotionally Intelligent Learning Companions. IEEE Intelligent Systems 22(4), 62–69 (2007)

    Article  Google Scholar 

  21. Prendinger, H., Ishizuka, M.: The Empathic Companion: A Character-Based Interface That Addresses Users’ Affective States. Applied Artificial Intelligence 19(3-4), 267–285 (2005)

    Article  Google Scholar 

  22. Paiva, A., Dias, J., Sobral, D., Aylett, R., Woods, S., Hall, L.E., Zoll, C.: Learning By Feeling: Evoking Empathy With Synthetic Characters. Applied Artificial Intelligence 19(3-4), 235–266 (2005)

    Article  Google Scholar 

  23. McQuiggan, S.W., Rowe, J.P., Lester, J.C.: The effects of empathetic virtual characters on presence in narrative-centered learning environments. In: CHI, pp. 1511–1520 (2008)

    Google Scholar 

  24. Howard, R.A., Matheson, J.E. (eds.): Readings in Decision Analysis. Decision Analysis Group, SRI International, Menlo Park, California (1977)

    Google Scholar 

  25. Czarkowski, M., Kay, J.: How to Give the User a Sense of Control over the Personalization of Adaptive Hypertext? In: Proc. of Adaptive Hypermedia and Adaptive Web-Based Systems (in Conjunction with UM 2003), pp. 121–131 (2003)

    Google Scholar 

  26. Zapata-Rivera, J.D., Greer, J.E.: Interacting with Inspectable Bayesian Student Models. International Journal of AI in Education 14 (2003)

    Google Scholar 

  27. Herlocker, J., Konstan, J.A., Riedl, J.: Explaining Collaborative Filtering Recommendations. In: Proc. of CSCW, pp. 241–250 (2000)

    Google Scholar 

  28. Horvitz, E., Breese, J., Henrion, M.: Decision Theory in Expert Systems and Artificial Intelligence. Journal of Approximate Reasoning 2, 247–302 (1988)

    Article  Google Scholar 

  29. Bunt, A., McGrenere, J., Conati, C.: Understanding the Utility of Rationale in a Mixed-Initiative System for GUI Customization. In: Conati, C., McCoy, K., Paliouras, G. (eds.) UM 2007. LNCS (LNAI), vol. 4511, pp. 147–156. Springer, Heidelberg (2007)

    Chapter  Google Scholar 

  30. Gervasio, M., Murdock, J.: What Were You Thinking? Filling in Missing Dataflow Through Inference in Learning from Demonstration. In: Proc. IUI 2009. ACM Press (2009)

    Google Scholar 

  31. Shen, J., Fitzhenry, E., Dietterich, T.G.: Discovering frequent work procedures from resource connections. In: IUI, pp. 277–286 (2009)

    Google Scholar 

  32. Arroyo, A., Cooper, D., Burleson, W., et al.: Emotion Sensors Go To School. In: AIED, pp. 17–24 (2009)

    Google Scholar 

  33. Conati, C.: Combining cognitive appraisal and sensors for affect detection in a  framework for modeling user affect. In: Calvo, R.A., D’Mello, S.K. (eds.) New Perspectives on Affect and Learning Technologies, Springer, New York (in press)

    Google Scholar 

  34. D’Mello, S., Lehman, B., Sullins, J., Daigle, R., Combs, R., Vogt, K., Perkins, L., Graesser, A.: A Time for Emoting: When Affect-Sensitivity Is and Isn’t Effective at Promoting Deep Learning. In: Aleven, V., Kay, J., Mostow, J. (eds.) ITS 2010, Part I. LNCS, vol. 6094, pp. 245–254. Springer, Heidelberg (2010)

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Conati, C. (2013). Virtual Butler: What Can We Learn from Adaptive User Interfaces?. In: Trappl, R. (eds) Your Virtual Butler. Lecture Notes in Computer Science(), vol 7407. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-37346-6_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-37346-6_4

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-37345-9

  • Online ISBN: 978-3-642-37346-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics