Summary
This chapter describes the output generation subsystem of SmartKom with special focus on the realization of the outstanding features of the new human-computer interaction paradigm. First, we start with a description and motivation of the design of the multimodal output modalities. Then we give a detailed characterization of the individual output modules, and finally we show how their collaboration is organized functionally in order to achieve a coherent overall system output behaviour.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
E. André. Ein planbasierter Ansatz zur Generierung multimedialer Präsentationen. PhD thesis, Universität des Saarlandes, 1995.
G. Ball, D. Ling, D. Kurlander, J. Miller, and D. Pugh. Lifelike Computer Characters: The Persona Project at Microsoft. In: J.M. Bradshaw (ed.), Software Agents, Menlo Park, CA, 1997. AAAI/MIT Press.
T. Becker. Practical, Template-Based Natural Language Generation With TAG. In: Proc. TAG+6, Venice, Italy, May 2002.
J. Cassell, J. Sullivan, S. Prevost, and E. Churchill. Embodied Conversational Agents. MIT Press, Cambridge, MA, 2000.
G. Herzog, H. Kirchmann, S. Merten, A. Ndiaye, P. Poller, and T. Becker. MULTIPLATFORM Testbed: An Integration Platform for Multimodal Dialog Systems. In: H. Cunningham and J. Patrick (eds.), Proc. HLT-NAACL 2003 Workshop on Software Engineering and Architecture of Language Technology Systems (SEALTS), pp. 75–82, Edmonton, Canada, 2003. Association for Computational Linguistics.
J. Müller. Persona: Ein anthropomorpher Präsentationsagent für Internet-Anwendungen. PhD thesis, Universität des Saarlandes, Saarbrücken, Germany, 2000.
T. Noma and N.I. Badler. A Virtual Human Presenter. In: Proc. IJCAI-97 Workshop on Animated Interface Agents: Making Them Intelligent, pp. 45–51, Nagoya, Japan, 1997.
S. Oviatt. Multimodal Interfaces. In: J.A. Jacko and A. Sears (eds.), The Human-Computer Interaction Handbook: Fundamentals, Evolving Technologies and Emerging Applications, pp. 286–304, Mahwah, NJ, 2003. Lawrence Erlbaum.
K. Perlin and A. Goldberg. Improv: A System for Scripting Interactive Actors in Virtual Worlds. Computer Graphics, 28(3), 1996.
P. Poller and J. Müller. Distributed Audio-Visual Speech Synchronization. In: Proc. ICSLP-2002, Denver, CO, 2002.
P. Poller and N. Reithinger. A State Model for the Realization of Visual Perceptive Feedback in SmartKom. In: Proc. Interspeech 2004, (ICSLP, 8th Int. Conf. on Spoken Language Processing), Jeju Island, Korea, 2004.
T. Rist, E. André, and J. Müller. Adding Animated Presentation Agents to the Interface. In: Proc. 1997 Int. Conf. on Intelligent User Interfaces, pp. 79–86, Orlando, FL, 1997.
A. Schweitzer, G. Dogil, and P. Poller. Gesture-Speech Interaction in the SmartKom Project. Poster presented at the 142nd meeting of the Acoustical Society of America (ASA). http://www.ims.uni-stuttgart.de/?schweitz/documents.shtml. Cited 11 April 2006.
V. Tschernomas. PrePlan Dokumentation (Java-Version). Deutsches Forschungszentrum für Künstliche Intelligenz, Saarbrücken, Germany, 1999.
W. Wahlster. SmartKom: Symmetric Multimodality in an Adaptive and Reusable Dialogue Shell. In: R. Krahl and D. Günther (eds.), Proc. Human Computer Interaction Status Conference 2003, pp. 47–62, Berlin, Germany, June 2003. DLR.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Poller, P., Tschernomas, V. (2006). Multimodal Fission and Media Design. In: Wahlster, W. (eds) SmartKom: Foundations of Multimodal Dialogue Systems. Cognitive Technologies. Springer, Berlin, Heidelberg . https://doi.org/10.1007/3-540-36678-4_25
Download citation
DOI: https://doi.org/10.1007/3-540-36678-4_25
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-23732-7
Online ISBN: 978-3-540-36678-2
eBook Packages: Computer ScienceComputer Science (R0)