Dominik Ertl
ABSTRACT
Automation in the course of user-interface (UI) development has the potential to save resources and time. For graphical user interfaces, quite some research has been performed on their automated generation. While the results are still not in wide-spread use, at least the problems are well understood meanwhile. In contrast, automated generation of multimodal UIs is still in its infancy. We address this problem by proposing a tool-supported process for generating multimodal UIs for dialogue-based interactive systems. For its concrete enactment, we provide tool support for generating a runtime configuration and glue code, respectively. In a nutshell, our approach generates multimodal dialogue-based UIs semi-automatically.
- R. Aylett, G. Castellano, B. Raducanu, A. Paiva, and M. Hanheide. Long-term socially perceptive and interactive robot companions: challenges and future perspectives. In Proceedings of the 13th International Conference on Multimodal Interfaces (ICMI), pages 323--326, 2011. Google Scholar
Digital Library
- C. Bogdan, D. Ertl, H. Hüttenrauch, M. Göller, A. Green, K. Severinsson Eklundh, J. Falb, and H. Kaindl. Evaluation of robot body movements supporting communication: Towards HRI on the move. In New Frontiers in Human Robot Interaction, pages 185--210. John Benjamins Publishing Company, 2011.Google Scholar
- J. Coutaz, L. Nigay, D. Salber, A. Blandford, J. May, and R. M. Young. Four easy pieces for assessing the usability of multimodal interaction: the CARE properties. In Proceedings of INTERACT 95, pages 115--120, 1995.Google ScholarCross Ref
- D. Ertl, J. Falb, and H. Kaindl. Semi-automatically configured fission for multimodal user interfaces. In ACHI, pages 85--90, 2010. Google ScholarDigital Library
- D. Ertl, S. Kavaldjian, H. Kaindl, and J. Falb. Semi-automatically generated high-level fusion for multimodal user interfaces. In Proceedings of the 43nd Annual Hawaii International Conference on System Sciences (HICSS-43), Piscataway, NJ, USA, 2010. IEEE Computer Society Press. Google ScholarDigital Library
- J. Falb, H. Kaindl, H. Horacek, C. Bogdan, R. Popp, and E. Arnautovic. A discourse model for interaction design based on theories of human communication. In Extended Abstracts on Human Factors in Computing Systems (CHI '06), pages 754--759. ACM Press: New York, NY, 2006. Google Scholar
- J. Falb, S. Kavaldjian, R. Popp, D. Raneburger, E. Arnautovic, and H. Kaindl. Fully automatic user interface generation from discourse models. In Proceedings of the 13th International Conference on Intelligent User Interfaces (IUI '09), pages 475--476. ACM Press: New York, NY, 2009. Google ScholarDigital Library
- G. Mori, F. Paternò, and C. Santoro. CTTE: Support for developing and analyzing task models for interactive system design. IEEE Transactions on Software Engineering, 28:797--813, 2002. Google ScholarDigital Library
- D. Raneburger, R. Popp, S. Kavaldjian, H. Kaindl, and J. Falb. Optimized GUI generation for small screens. In H. Hussmann, G. Meixner, and D. Zuehlke, editors, Model-Driven Development of Advanced User Interfaces, volume 340 of Studies in Computational Intelligence, pages 107--122. Springer Berlin / Heidelberg, 2011.Google Scholar
- L. M. Reeves, J. Lai, J. A. Larson, S. Oviatt, T. S. Balaji, S. Buisine, P. Collings, P. Cohen, B. Kraal, J.-C. Martin, M. McTear, T. Raman, K. M. Stanney, H. Su, and Q. Y. Wang. Guidelines for multimodal user interface design. Commun. ACM, 47(1):57--59, Jan. 2004. Google ScholarDigital Library
- A. Stanciulescu and J. Vanderdonckt. Design options for multimodal web applications. Computer-Aided Design Of User Interfaces V, pages 41--56, 2008.Google Scholar
- D. Tzovaras. Multimodal User Interfaces: From Signals to Interaction (Signals and Communication Technology). Springer Publishing Company, Incorporated, 1 edition, 2008. Google ScholarDigital Library
- J. van den Bergh and K. Coninx. From task to dialog model in the UML. In Proceedings of the 6th International Workshop on Task Models and Diagrams for User Interface Design (TAMODIA 2007), LNCS 4849, pages 98--111, Toulouse, France, Nov 2007. Springer. Google ScholarDigital Library
- J. M. Vanderdonckt. Model-driven engineering of user interfaces: Promises, successes, and failures. In Proceedings of 5th Annual Romanian Conf. on Human-Computer Interaction, pages 1--10. Matrix ROM, Sept. 2008.Google Scholar
Index Terms
- Semi-automatic generation of multimodal user interfaces for dialogue-based interactive systems
Recommendations
Towards multimodal user interfaces composition based on UsiXML and MBD principles
HCI'07: Proceedings of the 12th international conference on Human-computer interaction: intelligent multimodal interaction environmentsIn software design, the reuse issue brings the increasing of web services, components and others techniques. These techniques allow reusing code associated to technical aspect (as software component). With the development of business components which ...
Usability of user interfaces: from monomodal to multimodal
BCS-HCI '07: Proceedings of the 21st British HCI Group Annual Conference on People and Computers: HCI...but not as we know it - Volume 2This workshop is aimed at reviewing and comparing existing Usability Evaluation Methods (UEMs) which are applicable to monomodal and multimodal applications, whether they are web-oriented or not. It addresses the problem on how to assess the usability ...
Semi-automatic multimodal user interface generation
EICS '09: Proceedings of the 1st ACM SIGCHI symposium on Engineering interactive computing systemsMultimodal applications are typically developed together with their user interfaces, leading to a tight coupling. Additionally, human-computer interaction is often less considered. This potentially results in a worse user interface when additional ...
Comments