Joëlle Coutaz
ABSTRACT
Ten years ago, I introduced the notion of user interface plasticity to denote the capacity of user interfaces to adapt, or to be adapted, to the context of use while preserving usability. The Model Driven Engineering (MDE) approach, which was used for user interface generation since the early eighties in HCI, has recently been revived to address this complex problem. Although MDE has resulted in interesting and convincing results for conventional WIMP user interfaces, it has not fully demonstrated its theoretical promises yet. In this paper, we discuss how to push MDE to the limit in order to reconcile high-level modeling techniques with low-level programming in order to go beyond WIMP user interfaces.
- Balme, L. Interfaces homme-machine plastiques: une approche par composants dynamiques. Thèse de doctorat Informatique préparée au Laboratoire d'Informatique de Grenoble (LIG), Université Joseph Fourier, 20 juin 2008, 240 pagesGoogle Scholar
- Balme, L., Demeure, A., Barralon, N., Coutaz, J., Calvary, G. CAMELEON-RT: a Software Architecture Reference Model for Distributed, Migratable, and Plastic User Interfaces, second European Symposium on Ambient Intelligence, EUSAI 04, EUSAI 2004, LNCS 3295, Markopoulos et al. Eds, 291--302Google Scholar
- Balakrishnan, R., Baudisch, P. Special Issue on Ubiquitous Multi-Display Environments, Human-Computer Interaction, 2009, Vol. 24, Taylor and Francis publ.Google Scholar
- Berti, S. & Paternò F. (2005). Migratory multimodal interfaces in multidevice environments. In Proc. International Conference on Multimodal Interfaces (ICMI 05), ACM Publ., 92--99 Google ScholarDigital Library
- Bézivin, J., Dupé, G., Jouault, F., Pitette, G. & Rougui, J. First Experiments with the ATL Transformation Language: Transforming XSLT into Xquery. OOPSLA Workshop, Anaheim California USA (2003)Google Scholar
- Bolt, R. "Put That There": Voice and gesture at the graphics interface. In Proc. of the 7th International Conf. on Computer Graphics and Interactive techniques, ACM Publ. (1980), 262--270 Google ScholarDigital Library
- Bouillon, L., Vanderdonckt, J., Souchon, N., "Recovering Alternatives Presentation Models of a Web Page with Vaquita", In: Proceedings of 4th International Conference on Computer-Aided Design of User Interfaces, CADUI 2002, Kluwer Academics Pub., p. 311--322, Valenciennes, France, May 2002Google Scholar
- Bourguin, G., Lewandowski , A., Tarby, J.-C. Defining Task Oriented Component. In Proc. TAMODIA 2007, Lecture Notes in Computer Science 4849 Springer 2007, ISBN 978-3-540-77221-7, (2007) 170--183 Google ScholarDigital Library
- Calvary, G., Coutaz, J., Thevenin, D., Limbourg, Q., Souchon, N., Bouillon, L., Vanderdonckt, J.: Plasticity of User Interfaces: A Revised Reference Framework. 1rst International Workshop on Task Models and Diagrams for User Interface Design TAMODIA'2002, (2002) 127--134 Google ScholarDigital Library
- Canfora, G., Di Penta, M., Lombardi, P., Villani, M.L. Dynamic Composition of Web Applications in Human centered Processes. IEEE PESOS'09, May 18--19, (2009) Google ScholarDigital Library
- Coninx, K., Luyten, K., Vandervelpen, C., Van den Bergh, J. & Creemers, B. (2003). Dygimes: Dynamically Generating Interfaces for Mobile Computing Devices and Embedded Systems. In Proc. Mobile HCI, 256--270.Google ScholarCross Ref
- Coutaz, J., Nigay, L., Salbert, D., Blandford, A., May, J., "Four easy pieces for assessing the usability of multimodal interaction: the CARE properties", In: Proceedings of the IFIP Interantional Conference on Human-Computer Interaction, INTERACT 1995, p. 115--120, Lillehammer, Norway, (1995)Google ScholarCross Ref
- Coutaz, J. Meta User Interfaces for Ambient Spaces. In Proc. TAMODIA 2006, 5th International Workshop on Task Models and Diagrams for User Interface Design TAMODIA'2006, (2006), Springer Verlag publ. Google ScholarDigital Library
- Coyette, A., Faulkner, S., Kolp, M., Limbourg, Q., Vanderdonckt, J., "SketchiXML: towards a multi-agent design tool for sketching user interfaces based on USIXML", In: Proceedings of the 3rd Annual Conference on Task Models and Diagrams, TAMODIA 2004, Prague, Czech Republic, (2004) Google ScholarDigital Library
- Crease, M., Brewster, S.A., Gray, P., "Caring, Sharing Widgets: a toolkit of sensitive widgets", In: Proceedings of the 14th Annual Conference of the British HCI Group, BCS-HCI 2000, Springer, pp 257--270, Sunderland, UK, September 2000ß Past, Present, and Future of User Interface Software Tools. Transactions on Computer-Human Interaction (TOCHI), ACM Publ., Vol 7(1), (2000) 3--28 Google ScholarDigital Library
- Demeure, A., Calvary, G., Koninx, K. COMET(s), a Software Architecture Style and an Interactors Toolkit for Plastic user Interfaces. In Proc. 15th International Workshop, DSV-IS 2008, T.C.N. Graham & P. Palanque (Eds), Lecture Notes in Computer Science 5136, Springer Berlin / Heidelberg, Kingston, Canada, (2008), 225--237 Google ScholarDigital Library
- Ferry, N. Hourdin, G., Lavirotte, S., Rey, G., Tigli, J.-Y., Riveill, M. Models at Runtime: Service for Device Composition and Adaptation. In 4th International Workshop [email protected], Models 2009 (MRT'09), (2009)Google Scholar
- Gajos, K., Wobbrock, J., and Weld, D. Improving the performance of motor-impaired users with automatically-generated, ability-based interfaces. In CHI '08: Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems, pages 1257--1266, New York, NY, USA, ACM (2008) Google ScholarDigital Library
- Hayes, P.J., Szekely, P. & Lerner, R.A. Design alternatives for user interface management systems based on experience with COUSIN. In Proc. Of the ACM Conf. on Human Factors in Computing Systems (CHI'85, San Francisco, CA, Apr. 14-18), (1985) 169--175 Google ScholarDigital Library
- Lachenal, C., Rey, G., Barralon, N. MUSICAE, an infrastructure for MUlti-Surface Interaction in Context Aware Environment. In Proc. HCI International, Crete, (2003), 125--126Google Scholar
- Mens, T., Czarnecki, K. & Van Gorp, P. A taxonomy or Model Transformations. Dagstuhl Seminar Proc04101. (2005) http://drops.dagstuhl.de/opus/volltexte/2005/11Google Scholar
- Mistry, P., Maes, P. SixthSense -- A Wearable Gestural Interface. In Proc. SIGGRAPH Asia 2009, Emerging Technologies, Yokohama, Japan (2009) Google ScholarDigital Library
- Myers, B. Creating User Interfaces using programming by example, visual programming, and constraints. ACM Transaction on Programming Languages and Systems (TOPLAS), Vol. 12 (2) (1990), ACM Publ., 143--177 Google ScholarDigital Library
- Myers, B., Park, S.Y., Nakano, Y., Mueller, G., Ko, A. How designers Design and Program Interactive Behaviors. in Proc. IEEE Symposium on Visual Languages and Human Centric Computing (VL/HCC) (2008) 177--184 Google ScholarDigital Library
- Newman, M. W., Sedivy, J. Z., Neuwirth, C. M., Edwards, W. K., Hong, J. I., Izadi, S., Marcelo, K., Smith, T. F., "Designing for Serendipity: Supporting End-User Configuration of Ubiquitous Computing Environments", In: Proceedings of Designing Interactive Systems, DIS 2002, p. 147--156, London, UK, (2002). Google ScholarDigital Library
- Nichols, J., Rothrock, B., Chau, D. H., Myers, B. A., "Huddle: Automatically Generating Interfaces for Systems of Multiple Connected Appliances," In: Proceedings of the 19th Annual ACM Symposium on User interface Software and Technology, UIST 2006, p. 279--288, Montreux, Switzerland, (2006). Google ScholarDigital Library
- Oreizy, P., Gorlick, M., Taylor, R., Heimbigner, D., Johnson, G., Medvidovic, N., Quilici, A., Rosenblum, D., Wolf, A.: An Architecture-Based Approach to Self-Adaptive Software", IEEE Intelligent Systems, May/June (1999) 54--62 Google ScholarDigital Library
- Pietschmann, S., Voigt, M., MeiBner, K. Dynamic Composition of Service-Oriented Web User Interfaces. Proc. of the 4th International Conf. on Internet and Web Applications and Services, ICIW 2009, IEEE CPS, ISBN 9780769536132, (2009) Google ScholarDigital Library
- Ponnekanti, S., Lee, B., Fox, A., Hanrahan, P. & Winograd, T. Icrafter: a Service Framework for Ubiquitous Computing Environments. In Proc. Ubicomp 2001, G. Abowd, B. Brumitt, S. Shafer Eds., Springer Publ., LNCS 2201, (2001) 57--75 Google ScholarDigital Library
- Reignier, P. Brdiczka, O., Vaufreydaz, D., Crowley, J.L., Maisonnasse, J. Contexte-Aware Environments: from Specification to Implementation. Expert Systems: The Journal of Knowledge Engineering (2007)Google Scholar
- Smith, D. C. Pygmalion: An executable Electronic Blackboard. Chapter1 In "Watch What I Do", A. Cypher ed., The MIT Press (1993) Google ScholarDigital Library
- Sottet, J.-S., Calvary, G., Favre, J.-M.: Towards Model Driven Engineering of Plastic User Interfaces. International workshop on Model Driven Development of Advanced User Interfaces (MDDAUI), MoDELS 05 (2005) Google ScholarDigital Library
- Sottet, J.-S., Calvary, G., Coutaz, J., Favre, J.-M. A Model-Driven Engineering Approach for the Usability of User Interfaces. In Proc. Engineering Interactive Systems (EIS2007), J. Gulliksen et al. (eds), LNCS 4940, (2007), 140--157 Google ScholarDigital Library
- Sousa, J.P., Garlan, D., "The Aura Software Architecture: an Infrastructure for Ubiquitous Computing", In: Carnegie Mellon Technical Report, CMU-CS-03-183, (2003)Google Scholar
- Taleb, M., Seffah, A., Abran, A. Interactive Systems Engineering: A Pattern-Oriented and Model-Driven Architecture. In Software Engineering Research and Practice (2009), 636--642.Google Scholar
- Tandler, P., "Software Infrastructure for Ubiquitous Computing Environments: Supporting Synchronous Collaboration with Heterogeneous Devices", In: Proceedings of UBICOMP 2001, LNCS 2201, p. 96--115, Atlanta, GA, USA, (2001). Google ScholarDigital Library
- Thevenin, D., Coutaz, J.: Plasticity of User Interfaces: Framework and Research Agenda. In Proc. Interact'99, Edinburgh, A. Sasse & C. Johnson Eds, IFIP IOS Press, (1999) 110--117, 2002.Google Scholar
- Yu, J. Benatallah, B., Saint-Paul, R., Casati, F., Daniel, F. M., Matera. A Framework for rapid Integration of Presentation Components. In WWW'07 Proc. of the 16th International Conf. on World Wide Web (2007) 923--932 Google ScholarDigital Library
Index Terms
- User interface plasticity: model driven engineering to the limit!
Recommendations
Model-driven adaptation for plastic user interfaces
INTERACT'07: Proceedings of the 11th IFIP TC 13 international conference on Human-computer interactionUser Interface (UI) plasticity denotes UI adaptation to the context of use (user, platform, physical and social environments) while preserving usability. In this article, we focus on the use of Model-Driven Engineering and demonstrate how the intrinsic ...
A second generation user interface design environment: the model and the runtime architecture
CHI '93: Proceedings of the INTERACT '93 and CHI '93 Conference on Human Factors in Computing SystemsSeveral obstacles exist in the user interface design process which distract a developer from designing a good user interface. One of the problems is the lack of an application model to keep the designer in perspective with the application. The other ...
User interface composition: operators and composability checking
IHM '15: Proceedings of the 27th Conference on l'Interaction Homme-MachineThe automatic User Interface (UI) composition of UI components thanks to UI composition operators (composers) is one of the approaches to improve the UI development, to produce adaptive UI and to master the development of large scale UI. In this setting,...
Comments