Abstract
The penetration of mobile device in western countries is still increasing. The Italian case is really surprising: every single Italian has more than one mobile terminal. Thus, considering this large potential audience, there is real need for innovation and new services. In this context, usable multimodal services could have an unexpected impact on social behaviour. Nevertheless, the research community should be able to propose a framework for building generic multi-modal services, covering all their lifecycle. We are currently defining an architecture for building coordinated simultaneous multimodal applications trying to use as much as possible open source software: our goal is to define a set of tools for enabling a rapid deployment of a generic multimodal service. In our opinion, a platform based on open source software could meet the expectations of a large numbers of service developers. A special effort for enabling a mass diffusion of mobile multimodal services should be focused on the client side, where the situation is still evolving.
An erratum to this chapter can be found at http://dx.doi.org/10.1007/11915034_125.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Bolt, R.A.: Put that there: Voice and gesture at the graphics interface. Computer Graphics 14(3), 262–270 (1980)
Oviatt, S.L.: Multimodal interactive maps: Designing for human performance. Human-Computer Interaction 12, 93–129 (1997)
Oviatt, S.L., Cohen, P.R., Wu, L., Vergo, J., Duncan, L., Suhm, B., Bers, J., Holzman, T., Winograd, T., Landay, J., Larson, J., Ferro, D.: Designing the user interface for multimodal speech and gesture applications: State-of-the-art systems and research directions for 2000 and beyond
Knutkavale, N.: Janeikesetknudsen Speech Centric Multimodal Interfaces for Mobile Communication Systems. Telektronikk 2, 104–117 (2003)
Garzotto, F., Mainetti, L., Paolini, P.: Designing Modal Hypermedia Applications. In: The Eighth ACM Conference on Hypertext, Southampton, England, pp. 38–47 (1997)
Wu, L., Oviatt, S.L., Cohen, P.R.: Multimodal Integration - A Statistical View. IEEE Transactions on Multimedia 1(4), 334–341 (1999)
Beckham, J.L., Fabbrizio, G.D., Klarlund, M.: Towards SMIL as a Foundation for Multimodal, Multimedia Applications, W3C Multimodal Interaction Activity (2002)
Oviatt, S.L., DeAngeli, A., Kuhn, K.: Integration and synchronization of input modes during multimodal humancomputer interaction. In: Proceedings of the CHI 1997 Conference, pp. 415–422. ACM Press, New York (1997)
Oviatt, S.: Mutual disambiguation of recognition errors in a multimodal architecture. In: Proceedings of the Conference on Human Factors in Computing Systems: CHI 1999, pp. 576–583. ACM Press, Pittsburgh (1999); Multimodal Architectures: Issues and Experiences 983
Oviatt, S.: Ten Myths of Multimodal Interaction. Communications of the ACM 42(11), 74–81 (1999)
W3C Multimodal Architecture and Interfaces, http://www.w3.org/TR/2005/WD-mmiarch-20050422/
EMMA: Extensible MultiModal Annotation Markup Language, http://www.w3.org/TR/emma/
Overview of SGML Resources, http://www.w3.org/MarkUp/SGML/
X+V for the Next Generation Web, http://www.voicexml.org/specs/multimodal/
3GPP TS 23.057 V4.4.0 (2001-12) 3rd Generation Partnership Project Technical Specification Group Terminals Mobile Station Application Execution Environment (MExE), Functional description, Stage 2 (Release 4), http://www.3gpp.org/ftp/Specs/2001-12/Rel-4/23_series/23057-440.zip
Synchronized Multimedia Integration Language (SMIL) Specification, http://www.w3.org/TR/REC-smil/
Oviatt, S., Cohen, P.: Multimodal Interfaces That Process What Comes Naturally. Communications of the ACM 43(3), 45–53 (2000)
Matera, M.: SUE : A Systematic Methodology for Evaluating Hypermedia Usability, Ph. D. Thesis, Politecnico of Milano (2000)
Chai, J.Y., Hong, P., Zhou, M.X.: A probabilistic approach to reference resolution in multimodal user interfaces (2004)
Elting, C., Rapp, S., Möhler, G., Strube, M.: Architecture and implementation of multimodal plug and play. In: Proceedings of the 5th international conference on Multimodal interfaces (2003)
Johnston, M.: Multimodal Language Processing. In: Proceedings of International Conference on Spoken Language Processing (ICSLP), Sydney, Australia (1998)
Filippo, F., Krebs, A., Marsic, I.: A framework for rapid development of multimodal interfaces. In: Proceedings of the 5th international conference on Multimodal interfaces, Vancouver, British Columbia, Canada, November 05-07 (2003)
Rousseau, C., Bellik, Y., Vernier, F.: Multimodal Output Specification/Simulation Platform. In: Proceedings of the 7th international conference on Multimodal interfaces, Sorrento, Italy
Gourdol, A., Nigay, L., Salber, D., Coutaz, J.: Two Case Studies of Software Architecture for Multimodal Interactive Systems: Voice-Paint and a Voice-enabled Graphical Notebook. In: Proceedings of the IFIP WG 2.7 working conference, August 1992, North-Holland, Amsterdam (1992)
MUST – Multimodal and Multilingual services for small Mobile Terminals. Heidelberg, EURESCOM Brochure Serires (May 2002), http://www.eurescom.de/public/projects/P1100-series/P1104/default.asp
Bui, T.H.: Multimodal Dialogue Management - State of the art, CTIT Technical Report series No. 06-01, University of Twente (UT), Enschede, The Netherlands (January 2006)
Trewin, S., Zimmermann, G., Vanderheiden, G.: Abstract User Interface Representations: How Well do they Support Universal Access? In: Proceedings of the 2003 Conference on Universal Usability, pp. 77–84. Association for Computing Machinery, New York (2003)
Simon, R., Wegscheider, F., Tolar, K.: Tool-Supported Single Authoring for Device Independence and Multimodality. In: Proc. of the 7th International Conference on Human Computer Interaction with Mobile Devices and Services (Mobile HCI 2005), Salzburg, Austria, September 19-22 (2005)
Repo, P., Riekki, J.: Middleware Support for Implementing Context-Aware Multimodal User Interfaces. In: Proceedings of the 3rd international conference on Mobile and ubiquitous multimedia table of contents, College Park, Maryland
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Frattini, G. et al. (2006). Multimodal Architectures: Issues and Experiences. In: Meersman, R., Tari, Z., Herrero, P. (eds) On the Move to Meaningful Internet Systems 2006: OTM 2006 Workshops. OTM 2006. Lecture Notes in Computer Science, vol 4277. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11915034_122
Download citation
DOI: https://doi.org/10.1007/11915034_122
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-48269-7
Online ISBN: 978-3-540-48272-7
eBook Packages: Computer ScienceComputer Science (R0)