Abstract
Entertainment, education and training are changing because of multi-party interaction technology. In the past we have seen the introduction of embodied agents and robots that take the role of a museum guide, a news presenter, a teacher, a receptionist, or someone who is trying to sell you insurances, houses or tickets. In all these cases the embodied agent needs to explain and describe. In this paper we contribute the design of a 3D virtual presenter that uses different output channels to present and explain. Speech and animation (posture, pointing and involuntary movements) are among these channels. The behavior is scripted and synchronized with the display of a 2D presentation with associated text and regions that can be pointed at (sheets, drawings, and paintings). In this paper the emphasis is on the interaction between 3D presenter and the 2D presentation.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Rui, Y., Gupta, A., Grudin, J.: Videography for telepresentations. CHI Letters 5(1), 457–464 (2003)
Rogina, I., Schaaf, T.: Lecture and presentation tracking in an intelligent meeting room. In: Proc. IEEE Intern. Conf. on Multimodal Interfaces, pp. 14–16 (2002)
Waibel, A., Steusloff, H., Stiefelhagen, R.: The CHIL Project Consortium.: CHIL - computers in the human interaction loop. In: 5th Intern. Workshop on Image Analysis for Multimedia Interactive Services, Lisbon, Portugal (2004)
Reidsma, D., op den Akker, H., Rienks, R., Poppe, R., Nijholt, A., Heylen, D., Zwiers, J.: Virtual meeting rooms: From observation to simulation. In: Proc. Social Intelligence Design, Stanford University, CA (2005)
Poppe, R., Heylen, D., Nijholt, A., Poel, M.: Towards real-time body pose estimation for presenters in meeting environments. In: Proc. of the Intern. Conf. in Central Europe on Computer Graphics, Visualization and Computer Vision, pp. 41–44 (2005)
Prendinger, H., Descamps, S., Ishizuka, M.: MPML: a markup language for controlling the behavior of life-like characters. J. Vis. Lang. Comput. 15(2) (2004)
Noma, T., Zhao, L., Badler, N.I.: Design of a virtual human presenter. IEEE Computer Graphics and Applications 20(4), 79–85 (2000)
André, E., Rist, T., Müller, J.: Webpersona: A life-like presentation agent for the world-wide web. Knowledge-Based Systems 11(1), 25–36 (1998)
Gratch, J., Rickel, J., André, E., Cassell, J., Petajan, E., Badler, N.I.: Creating Interactive Virtual Humans: Some Assembly Required. IEEE Intelligent Systems 17(4), 54–63 (2002)
Cassell, J., Vilhjálmsson, H.H., Bickmore, T.: BEAT: the Behavior Expression Animation Toolkit. In: SIGGRAPH 2001: Proceedings of the 28th annual conf. on Computer graphics and interactive techniques, pp. 477–486 (2001)
Nijholt, A., van Welbergen, H., Zwiers, J.: Introducing an Embodied Virtual Presenter Agent in a Virtual Meeting Room. In: Hamza, M.H. (ed.) Proc. of the IASTED Intern. Conf. on Artificial Intelligence and Applications, pp. 579–584 (2005)
Perlin, K.: Real time responsive animation with personality. IEEE Transactions on Visualization and Computer Graphics 1(1), 5–15 (1995)
Cassell, J., Nakano, Y., Bickmore, T., Sidner, C., Rich, C.: Annotating and Generating Posture from Discourse Structure in Embodied Conversational Agents. In: Workshop on Representing, Annotating, and Evaluating Non-Verbal and Verbal Communicative Acts to Achieve Contextual Embodied Agents, Autonomous Agents 2001 Conference, Montreal, Quebec (2001)
MacKenzie, I.S., Buxton, W.: Extending Fitts’ law to two-dimensional tasks. In: Proc. of the SIGCHI conf. on human factors in computing systems, pp. 219–226 (1992)
Kendon, A.: An Agenda for Gesture Studies. The Semiotic Review of Books 7(3) (1996)
Zhang, X., Chaffin, D.: The effects of speed variation on joint kinematics during multi-segment reaching movements. Human Movement Science (18) (1999)
Donders, F.C.: Beiträge zur Lehre von den Bewegungen des menschlichen Auges. Holländische Beträge Anat. Physiol. Wiss. 1, 104–145 (1848)
Tolani, D., Goswami, A., Badler, N.I.: Real-time inverse kinematics techniques for anthropomorphic limbs. Graph. Models Image Process 62(5), 353–388 (2000)
Smeulders, A., Hardman, L., Schreiber, G., Geusebroek, J.: An integrated multimedia approach to cultural heritage e-documents. In: Proc. 4th Intl. Workshop on Multimedia Information Retrieval (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
van Welbergen, H., Nijholt, A., Reidsma, D., Zwiers, J. (2005). Presenting in Virtual Worlds: Towards an Architecture for a 3D Presenter Explaining 2D-Presented Information. In: Maybury, M., Stock, O., Wahlster, W. (eds) Intelligent Technologies for Interactive Entertainment. INTETAIN 2005. Lecture Notes in Computer Science(), vol 3814. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11590323_21
Download citation
DOI: https://doi.org/10.1007/11590323_21
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-30509-5
Online ISBN: 978-3-540-31651-0
eBook Packages: Computer ScienceComputer Science (R0)