Abstract
Today a large variety of mobile interaction devices such as PDAs and mobile phones enforce the development of a wide range of user interfaces for each platform. The complexity even grows, when multiple interaction devices are used to perform the same task and when different modalities have to be supported. We introduce a new dialog model for the abstraction of concrete user interfaces with a separate advanced control layer for the integration of different modalities. In this context, we present the Dialog and Interface Specification Language (DISL), which comes with a proof-of-concept implementation.
Parts of the work presented here have been funded by the EU within the 6th Framework Program project UBISEC and by the German Research Foundation (DFG) within the project ADDO.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Weiser, M.: The Computer for the 21st Century. Scientific American 265(3), 94–104 (1991)
Aarts, E.: Technological Issues in Ambient Intelligence. In: Aarts, E., Marzano, S. (eds.) The New Everyday – Views on Ambient Intelligence, pp. 12–17. 010 Publishers, Rotterdam (2003)
Nichols, J., et al.: Generating remote control interfaces for complex appliances. In: CHI Letters: ACM Symposium on User Interface Software and Technology, UIST’02 (2002)
Larson, J.A., et al.: W3C Multimodal Interaction Framework. W3CNote (2003)
Eisenstein, J., Vanderdonckt, J., Puerta, A.: Applying Model-Based Techniques to the Development of UIs for Mobile Computers. In: Proceedings of Intelligent User Interfaces Conference (IUI2001) (2001)
Paternò, F., Santoro, C.: One Model, Many Interfaces. In: Proceedings Fourth International Conference on Computer Aided Design of User Interfaces (CADUI 2002), Kluwer Academic Publishers, Dordrecht (2002)
Abrams, M., et al.: UIML: an appliance-independent XML user interface language. Computer Networks 31 (1999)
Clerckx, T., Luyten, K., Coninx, K.: Generating Context-Sensitive Multiple Device Interfaces From Design. In: Proceedings Fifth International Conference on Computer Aided Design of User Interfaces (CADUI 2004), Kluwer Academic Publishers, Dordrecht (2004)
Limbourg, Q., et al.: USIXML: A Language Supporting Multi-path Development of User Interfaces. In: Bastide, R., Palanque, P., Roth, J. (eds.) DSV-IS 2004 and EHCI 2004. LNCS, vol. 3425, pp. 200–220. Springer, Heidelberg (2005)
Sandor, C., Reicher, T.: CUIML: A language for generating multimodal human-computer interfaces. In: Proceedings of the European UIML Conference (2001)
Boyer, J.M., et al.: XForms 1.0, 2nd edn., W3C Recommendation (2006)
Open Mobile Alliance: Wireless Markup Language Version 2.0, Wireless Application Protocol, WAP-238-WML-20010911-a (2001)
Roché, P., d’Ausbourg, B., Durrieu, G.: Deriving a Formal Model from UIL Description in order to Verify and Test its Behavior. In: Duke, D.J., Puerta, A.R. (eds.) Proceedings of 6th Int. Eurographics Workshop on Design, Specification, Verification of Interactive Systems DSV-IS’99. Focus on Computer Graphics, Springer, Heidelberg (1999)
Janssen, C.: Dialogue Nets for the Description of Dialogue Flows in Graphical Interactive Systems. In: Proceedings of Software Ergonomie 93, Bremen (1993)
Curry, M.B., Monk, A.F.: Dialogue Modelling of Graphical User Interfaces with a Production System. Behaviour and Information Technology 14(1), 41–55 (1995)
Harel, D.: State Charts: A Visual Formalism for Complex Systems. Science of Computer Programming 8 (1987)
Coutaz, J., et al.: Four easy pieces for assessing the usability of multimodal interaction: The care properties. In: Arnesen, S.A., Gilmore, D. (eds.) Proceedings of the INTERACT’95 conference, pp. 115–120. Chapman and Hall, Boca Raton (1995)
Martin, J.C.: TYCOON: Theoretical Framework and Software Tools for Multimodal Interfaces. In: Lee, J. (ed.) Intelligence and Multimodality in Multimedia interfaces, AAAI Press, Menlo Park (1998)
Plomp, J., Schaefer, R., Mueller, W.: Comparing Transcoding Tools for Use with a Generic User Interface Format. In: Proceedings of Extreme Markup Languages (2002)
Bleul, S., Schaefer, R., Mueller, W.: Multimodal Dialog Description for Mobile Devices. In: Luyten, K., et al. (eds.) Developing User Interfaces with XML: Advances on User Interface Description Languages, Satellite Workshop of Advanced Visual Interfaces (AVI) (2004)
Plomp, J., Mayora-Ibarra, O.: A generic widget vocabulary for the generation of graphical and speech-driven user interfaces. International Journal of Speech Technology 5(1), 39–47 (2002)
Vanderdonckt, J., Bodart, F.: Encapsulating Knowledge For Intelligent Automatic Interaction Objects Selection. In: ACM Conference on Human Aspects in Computing Systems, INTERCHI’93 (1993)
Schaefer, R., Bleul, S.: Towards Object Oriented, UIML-Based Interface Descriptions For Mobile Devices. In: Calvary, G., et al. (eds.) Computer-Aided Design of User Interfaces V, Proceedings of 6th Int. Conf. on Computer-Aided Design of User Interfaces CADUI’2006. Information Systems Series, pp. 15–26. Springer, Heidelberg (2006)
Automatic Service Brokering in Service oriented Architectures, Project Homepage, http://www.vs.uni-kassel.de/research/addo/
Jaeger, M.C., et al.: Ranked Matching for Service Descriptions using OWL-S. In: Kommunikation in verteilten Systemen (KiVS 2005). Informatik Aktuell, pp. 91–102. Springer, Heidelberg (2005)
Bleul, S., Geihs, K.: Automatic Quality-Aware Service Discovery and Matching. In: 13th HP OpenView University Association (HP-OVUA) workshop (2006)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Schaefer, R., Bleul, S., Mueller, W. (2007). Dialog Modeling for Multiple Devices and Multiple Interaction Modalities. In: Coninx, K., Luyten, K., Schneider, K.A. (eds) Task Models and Diagrams for Users Interface Design. TAMODIA 2006. Lecture Notes in Computer Science, vol 4385. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-70816-2_4
Download citation
DOI: https://doi.org/10.1007/978-3-540-70816-2_4
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-70815-5
Online ISBN: 978-3-540-70816-2
eBook Packages: Computer ScienceComputer Science (R0)