Abstract
Creating intelligent interactive applications based on DPMs is a challenging task. The definition of system reactions, independent interface behaviors, and necessary context data requires expert programmers at various representation levels and often results in hard-to-maintain code. We use the Visual SceneMaker authoring tool, a visual authoring approach which was initially designed for the creation of interactive applications with virtual characters and has been extended to serve as a dialog and interaction manager for our DPM interactive applications. In SceneMaker a clean separation of content (scenes) and logic (sceneflow) is enforced. In order to access high-level context information, the SceneMaker tool provides interfaces to the Object Memory Server (OMS) and to knowledge deduction systems, such as the Java Expert System Shell (JESS). The tool also supports concurrency, variable scoping, and interaction history to facilitate modeling of multiple interaction modalities, robust data access, and flexible interruption policies as they occur in intelligent interactive environments with DPMs. Moreover, the version used allows real-time sceneflow visualization and modification at runtime to facilitate rapid prototyping and code maintenance. In the context of the SemProM project we rely on interactive virtual characters in several application setups in order to provide users with a compelling interaction experience with DPMs.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
- 2.
- 3.
Within the IDE, the content of a supernode can be edited by selecting a supernode.
- 4.
- 5.
- 6.
Globus Headquarter, St. Wendel, Germany.
References
J. Brusk, T. Lager, A. Hjalmarsson, P. Wik, DEAL dialogue management in SCXML for believable game characters, in Proceedings of ACM Future Play (ACM, New York, 2007), pp. 137–144
R. Engel, Robust and efficient semantic parsing of free word order languages in spoken dialogue systems, in INTERSPEECH 2005—Eurospeech, 9th European Conference on Speech Communication and Technology, Lisbon, Portugal (2005), pp. 3461–3464
B. Fogg, Persuasive Technology: Using Computers to Change What We Think and Do (Morgan Kaufmann, San Mateo, 2002)
P. Gebhard, M. Kipp, M. Klesen, T. Rist, Authoring scenes for adaptive, interactive performances, in Proceedings of the Second International Joint Conference on Autonomous Agents and Multi-Agent Systems (ACM Press, New York, 2003), pp. 725–732
J. Gratch, J. Rickel, E. André, J. Cassell, E. Petajan, N.I. Badler, Creating interactive virtual humans: some assembly required. IEEE Intell. Syst. 17(4), 54–63 (2002)
J. Gratch, S. Marsella, N. Wang, B. Stankovic, Assessing the validity of appraisal-based models of emotion, in International Conference on Affective Computing and Intelligent Interaction, Amsterdam (2009)
D. Harel, Statecharts: a visual formalism for complex systems, in Science of Computer Programming, Amsterdam, Netherlands, June, vol. 8 (Elsevier North-Holland, Inc., Amsterdam, 1987), pp. 231–274
S. Heidig, G. Clarebout, Do pedagogical agents make a difference to student motivation and learning? A review of empirical research. Educ. Res. Rev. (2010). doi:10.1016/j.edurev.2010.07.004
I.A. Iurgel, R.E. da Silva, P.R. Ribeiro, A.B. Soares, M.F. dos Santos, CREACTOR—an authoring framework for virtual actors, in Proceedings of the 9th International Conference of Intelligent Virtual Agents. LNAI, vol. 5773 (Springer, Berlin, 2009), pp. 562–563
M. Kipp, M. Neff, K.H. Kipp, I. Albrecht, Toward natural gesture synthesis: evaluating gesture units in a data-driven approach, in Proceedings of the 7th International Conference on Intelligent Virtual Agents. LNAI, vol. 4722 (2007), pp. 15–28
A. Kröner, P. Gebhard, L. Spassova, G. Kahl, M. Schmitz, Informing customers by means of digital product memories, in Proceedings of the 1st International Workshop on Digital Object Memories (DOMe), Barcelona, Spain, ed. by M. Schneider, A. Kröner, P. Olivier, P. Stephan (2009)
A. Kröner, J. Haupert, J. de Gea Fernández, R. Steffen, C. Kleegrewe, M. Schneider, Supporting interaction with digital product memories, in SemProM—Foundations of Semantic Product Memories for the Internet of Things, ed. by W. Wahlster. Cognitive Technologies (Springer, Berlin, 2013)
J. Miksatko, K.H. Kipp, M. Kipp, The persona zero-effect: evaluating virtual character benefits on a learning task, in Proceedings of the 10th International Conference on Intelligent Virtual Agents (IVA-10) (Springer, Berlin, 2010)
K. Perlin, A. Goldberg, Improv: a system for scripting interactive actors in virtual worlds, in Computer Graphics Proceedings (ACM SIGGRAPH, New York, 1996), pp. 205–216
H. Prendinger, S. Saeyor, M. Ishizuk, MPML and SCREAM: scripting the bodies and minds of life-like characters, in Life-Like Characters—Tools, Affective Functions, and Applications (Springer, Berlin, 2004), pp. 213–242
B. Reeves, C. Nass, The Media Equation: How People Treat Computers, Television, and New Media Like Real People and Places (Cambridge University Press, Cambridge, 1996)
M. Schmitz, B. Brandherm, J. Neidig, S. Schachtl, M. Schuster, Interaction modalities for digital product memories, in SemProM—Foundations of Semantic Product Memories for the Internet of Things, ed. by W. Wahlster. Cognitive Technologies (Springer, Berlin, 2013)
M. Schröder, Approaches to emotional expressivity in synthetic speech, in Emotions in the Human Voice, Volume 3: Culture and Perception, ed. by K. Izdebski (Plural, San Diego, 2008), pp. 307–321
U. Spierling, S.A. Weiss, W. Mueller, Towards accessible authoring tools for interactive storytelling, in Proceedings of Technologies for Interactive Digital Storytelling and Entertainment (Springer, Heidelberg, 2006)
M. von der Beeck, A comparison of statecharts variants, in Proceedings of the Third International Symposium Organized Jointly with the Working Group Provably Correct Systems on Formal Techniques in Real-Time and Fault-Tolerant Systems, London, UK (Springer, Berlin, 1994), pp. 128–148. http://portal.acm.org/citation.cfm?id=646843.706613
W. Wahlster, SmartKom: Foundations of Multimodal Dialogue Systems. Cognitive Technologies (Springer, Berlin, 2006)
W. Wahlster (ed.), SemProM—Foundations of Semantic Product Memories for the Internet of Things. Cognitive Technologies (Springer, Berlin, 2013)
Acknowledgements
We would like to thank Gregor Mehlmann (MMCI Lab, University Augsburg) for supporting us with his expertise.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Gebhard, P. (2013). Controlling Interaction with Digital Product Memories. In: Wahlster, W. (eds) SemProM. Cognitive Technologies. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-37377-0_15
Download citation
DOI: https://doi.org/10.1007/978-3-642-37377-0_15
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-37376-3
Online ISBN: 978-3-642-37377-0
eBook Packages: Computer ScienceComputer Science (R0)