Abstract
The classical strategy of multimodal interactions is to simultaneously utilise several modalities offered on a ‘single’ device. However, practical restrictions appear, especially in mobile communications, due to the limitations of device’s interfaces and the continuously changing communication conditions. Taking multimodality out of this single-device scenario, this paper introduces a theoretical framework for dynamic Multi User Interfaces-Device Binding (MID-B). MID-B facilitates dynamic adaptation and customisation of physically distributed devices (and their user interfaces) into one ‘virtual’ multimodal environment, thus introducing ambient awareness into user interfaces. In MID-B, one device assumes the role of a “controller” which detects and binds the interfaces and modalities available on devices in the vicinity. After discovery, it binds these modalities to deliver the actual mobile service.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Notes
In mathematical definition, function or relation is said to be ‘onto’ if every y in Range Y have a mapping to x in Domain X.
An enumeration set defines a certain name space for a specific object.
References
Cellario M (2001) Human-centered intelligent vehicles: toward multimodal interface integration. IEEE Intell Syst 26:78–81
Schraefel MC, Eilson M, Russel A, Smith DA (2006) mSpace: improving information access to multimedia domains with multimodal exploratory search. Commun ACM 49:47–49
Ahn LV, Ginosar S, Kedia M, Liu R, Blum M (2006) Improving accessibility of the web with a computer game. In: ACM Conference on Human Factor in Computer System: ACM, New York, pp 78–82
Oviatt S (2002) Multimodal interfaces. In: Sears JJAA (ed) Handbook of human–computer interaction. Lawrence Erlbaum, New Jersey, pp 286–304
Niklfeld G, Anegg H, Gassner A (2005) Device independent mobile multimodal user interfaces with the MONA multimodal presentation server. In: Eurescom Summit 2005:ubiquitous services and applications exploiting the potential, Heidelberg, Germany
Riekki J, Davidyuk O, Forstadius J, Sun J, Sauvola J. Enabling context-aware services for mobile users. In: IFIP, INTELLCOMM ’04
Tarasewich P (2003) Wireless devices for mobile commerce: user interface design and usability. In: Mobile commerce: technology, theory, and applications, pp 26–50
Kobayashi N, Tokunaga E, Kimura H (2005) An input widget framework for multi-modal and multi-device environments. Presented at 3rd IEEE Workshop on Software Technologies for Future Embedded and Ubiquitous System (SEUS’05)
“WAG UAProf,” Aireless Application Protocol Form, Ltd WAP-248-UAPROF-20011020-a, 2001
Belotti R, Decurtins C, Norrie MC, Phthon E (2005) A context-aware component registry for ubiquitous and mobile applications. In: CAiSE Workshop on Ubiquitous Mobile Information and Collaboration Systems (UMICS 2005), Porto, Portugal
Padovitz A, Loke SW, Zaslavsky A (2004) Towards a theory of context spaces. In: 2nd IEEE Annual Conference on Pervasive Computing and Communications Workshop. Florida, USA: IEEE Computer Society
Curzon P, Blandford A (2000) Using a verification system to reason about post-completion errors. In: Paterno PPAF (ed) 7th International Workshop on Design, Specification and Verification of Interactive System, pp 290–308
Thimbleby H, Gow J (2004) Computer algebra in interface design research. In: 9th International Conference on Intelligent User Interface. Madeira, Portugal
Jeschke S, Richiter T (2005) Mathematics in virtual knowledge spaces: user adaptation by intelligent assistants. Presented at PISA-Workshop, Palmerston North, New Zealand
Hrbacek K, Jech T (1999) Introduction to set theory, 3rd edn. Macel Dekker, New York
Razak AHF (2004) Understanding interaction experience in mobile learning. In: Asia Pacific Computer Human Interaction (APCHI) (Doctoral Consortium)
Axelsson J, Potter S, Raman TV, Raggett D (2004) Modality component to host environment dom requirements and capabilities assessment. http://www.w3.org/TR/modality-interface (Last accessed: 04.05.08).
Floreen P, Przybilski M, Nurmi P, Koolwaaij J, Tarlano A, Wagner M (2005) Towards a context management framework for mobilife. In: IST Mobile & Communication Summit Dresden, Germany
Deitel HM, Deitel PJ, Nieto TR, Lin TM, Sadhu P (2001) Creating markup with XML. In: Horton M (ed) XML how to program. Prentice Hall, Upper Saddle River, pp 112–132
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Prammanee, S., Moessner, K. Mobile Multimodality: A Theoretical Approach to Facilitate Virtual Device Environments. Mobile Netw Appl 13, 569–582 (2008). https://doi.org/10.1007/s11036-008-0091-z
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11036-008-0091-z