ABSTRACT
In this paper, we describe user experiences with a system equipped with cognitive vision that interacts with the user in the context of personal assistance in the office. A cognitive vision computer can see the user and user responses and react to situations that happen in the environment, crossing the boundary between the virtual and the physical world. How should such a seeing computer interact with its users? Three different interface styles -- a traditional GUI, a cartoon-like embodied agent and a realistic embodied agent -- are tested in two tasks where users are actively observed by a (simulated) cognitive vision system. The system assists them in problem solving. Both the non-embodied and the embodied interaction styles offer the user certain advantages and the pros and cons based on the experiment results are discussed in terms of performance, intelligence, trust, comfort, and social presence.
- Andre, E., Rist, T., and Muller, J., 1998. Integrating Reactive and Scripted Behaviors in a Life-Like Presentation Agent, Proc. 2nd International Conference on Autonomous Agents (Agents '98), 261--268 Google ScholarDigital Library
- G. Ball and J. Breese, 2000. Emotion and personality in a conversational agent. In J. Cassell, J. Sullivan, S. Prevost, and E. Churchill, Eds., Embodied conversational agents, Cambridge, MA: MIT Press, 189--219. Google ScholarDigital Library
- Bickmore, T. W., 2003. Relational Agents: Effecting Change through Human-Computer Relationships, Ph.D. Thesis, MIT.Google Scholar
- Bickmore, T. W. and Picard, R. W., 2005, Establishing and Maintaining Long-Term Human-Computer Relationships, ACM Transactions, 12 (2), 293--327. Google ScholarDigital Library
- Brennan, S. E. and Ohaeri, J. O., 1994. Effects of Message Style on Users' Attributions toward Agents, Conference Companion Proc. CHI '94, 281--282. Google ScholarDigital Library
- Cole, R., Vuuren, S. v., Pellom, B., Hacioglu, K., Ma, J., Movellan, J., Schwartz, S., Wadestein, D., Ward, W. and Yan, J., 2003. Perceptive Animated Interfaces: First Steps Toward a New Paradigm for Human--Computer Interaction, Proc. IEEE, 91(9), 1391--1405.Google ScholarCross Ref
- Cassell, J., 2001. Embodied Conversational Agents, AI Magazine, 22(4), 67--84. Google ScholarDigital Library
- Dahlbäck, N., Jänsson, A. and Ahrenberg, L., 1993. Wizard of Oz Studies - Why and How, Proc. ACM International Workshop on Intelligent User Interfaces '93, 193--200. Google ScholarDigital Library
- ECVision, online at http://www.ecvision.org. Last accessed: January 2006.Google Scholar
- Furnham, A., 1997. The psychology of behaviour at work, Psychology Press, Publishers, East Sussex, UK.Google Scholar
- de Greef, H. P. and IJsselsteijn, W. A., 2000. Social Presence in the PhotoShare Tele-Application. Proc. PRESENCE 2000, Delft, The NetherlandsGoogle Scholar
- Keirsey Online Temperament Sorter (German), http://www.keirsey.com/ Last accessed: January 2006.Google Scholar
- King, W. J., and Ohya, J., 1995. The representation of agents: a study of phenomena in virtual environments, Proc. RO-MAN'95.Google Scholar
- Koda, T. and Maes, P., 1996. Agents with Faces: The Effects of Personification of Agents, Proc. HCI '96 UK, 98--103.Google Scholar
- Lanier, J., 1995. Agents of alienation, ACM Interactions, 2 (3), 66--72. Google ScholarDigital Library
- Lee, K. M. and Nass, C., 2003. Designing Social Presence of Social Actors in Human Computer Interaction, Proc. CHI '03, 289--296. Google ScholarDigital Library
- Lester, J. C., Converse, S. A., Kahler, S. E., Barlow, S. T., Stone, B. A. & Bhogal, R. S., 1997. The Persona Effect: Affective Impact of Animated Pedagogical Agents, Proc. CHI '97, 359--366. Google ScholarDigital Library
- Mori, M., 1970. The Uncanny Valley. Energy, 7, 33--35.Google Scholar
- Mori, M., 2005. On the Uncanny Valley. Proc. workshop Humanoids-2005.Google Scholar
- Nass, C., Steuer, J. and Tauber, E. R., 1994. Computers are Social Actors, Proc. CHI '94, 72--78. Google ScholarDigital Library
- Picard, R. W., 1997. Affective Computing. Cambridge, MA: MIT Press. Google ScholarDigital Library
- Power, G., Wills, G. and Hall, W., 2002. User Perception of Anthropomorphic Characters with Varying Levels of Interaction. Proc. HCI '02 UK, 37--51.Google Scholar
- Reeves, B. and Nass, C., 1996. The Media Equation: How People Treat Computers, Television, and New Media Like Real People and Places. Cambridge University Press, Cambridge, UK. Google ScholarDigital Library
- Sas, C., Hare, G. M. P. O., and Reilly, R., 2004. Presence and task performance: an approach in the light of cognitive style, Cognition, Technology & Work, 6 (1), 53--56. Google ScholarDigital Library
- Short, J. A., Williams, E., & Christie, B., 1976. The social psychology of telecommunications, New York: John Wiley & Sons.Google Scholar
- Sproull, L., Walker, J., Subramani, R., Kiesler, S., and Waters, K., 1996. When the Interface is a Face, Human Computer Interaction, 11, 97--124. Google ScholarDigital Library
- Vernon, D., 2004. Cognitive Vision -- The Development of a Discipline, Proc. IST 2004 Event 'Participate in your future'.Google Scholar
- Xiao, J., Catrambone, R. and Stasko, J., 2003. Be Quiet? Evaluating Proactive and Reactive User Interface Assistants, Proc. INTERACT 2003, 383--390.Google Scholar
Index Terms
- Interacting with embodied agents that can see: how vision-enabled agents can assist in spatial tasks
Recommendations
Enabling Embodied Conversational Agents to Respond to Nonverbal Behavior of the Communication Partner
Human-Computer Interaction. User Experience and BehaviorAbstractHumans communicate on three levels: words, paralanguage, and nonverbal. While conversational agents focus mainly on the interpretation of words that are being spoken, recently the focus has also shifted to how we say those words with our tone, ...
Multi-Modal Embodied Agents Scripting
ICMI '02: Proceedings of the 4th IEEE International Conference on Multimodal InterfacesEmbodied agents present ongoing challenging agenda for research in multi-modal user interfaces and human-computer-interaction. Such agent metaphors will only be widely applicable to online applications when there is a standardised way to map underlying ...
Modeling situation-dependent nonverbal expressions for a pair of embodied agent in a dialogue based on conversations in TV programs
HCI'13: Proceedings of the 15th international conference on Human-Computer Interaction: interaction modalities and techniques - Volume Part IVMathematical model for controlling nonverbal expressions of a pair of embodied agents designed for presenting various information through their dialogue is discussed. Nonverbal expressions of a human during conversation with others depend on those of ...
Comments