Abstract
The price drop of digital displays during the last decade has promoted the use of coupled-display ecosystems. This paper proposes a model-based approach to develop applications that exploit these ecosystems. It introduces the concept of Distributable User Interface to define applications running on coupled-display ecosystems that enable users to distribute interaction objects (e.g., labels, buttons, panels and frames) across interaction surfaces (e.g., Web documents, frames and panels) using a set of distribution primitives. The Distributable User Interface concept is formalized in the User Interface Distribution meta-model, which is implemented using the Eclipse Modeling Framework to ensure the compliance of these models with the OMG standards. This paper also describes the graphical model editor to create, edit and validate User Interface Distribution models conforming to the proposed meta-model. The models created with the model editor are used as input parameters for the model-to-text transformation developed in Acceleo that generates the source code of Web applications supporting Distributable User Interfaces. The generated code runs on the User Interface Distribution Framework which is also presented in this paper. Finally, the On-line Photo Gallery application is the case of study presented to demonstrate the viability of the proposal.
Similar content being viewed by others
References
Calvary, G., Coutaz, J., Thevenin, D., Limbourg, Q., Bouillon, L., Vanderdonckt, J.: A unifying reference framework for multi-target user interfaces. Interact. Comput. 15(3), 289 (2003). https://doi.org/10.1016/S0953-5438(03)00010-9
Coutaz, J., Nigay, L., Salber, D., Blandford, A., May, J., Young, R.M.: Four Easy Pieces for Assessing the Usability of Multimodal Interaction: The CARE Properties, pp. 115–120. Springer, Boston (1995). https://doi.org/10.1007/978-1-5041-2896-4_19
Coyette, A., Kieffer, S., Vanderdonckt, J.: Multi-fidelity prototyping of user interfaces. In: Proceedings of the 11th IFIP TC 13 International Conference on Human-computer Interaction, INTERACT’07, pp. 150–164. Springer, Berlin, (2007). http://dl.acm.org/citation.cfm?id=1776994.1777015
Eclipse Foundation: The MOFScript home page (2011). https://eclipse.org/gmt/mofscript/
Eclipse Foundation: ACCELEO (2016). https://eclipse.org/acceleo/
Eclipse Foundation: The atlas transformation language (2016). https://eclipse.org/atl/
Eclipse Foundation: The eclipse modeling framework (2016). https://eclipse.org/modeling/emf/
Eclipse Foundation: Ecore (2016). https://wiki.eclipse.org/Ecore
Eclipse Foundation: The graphical modeling framework (2016). https://wiki.eclipse.org/Graphical_Modeling_Framework
Eclipse Foundation: The graphical modeling project (2016). http://www.eclipse.org/modeling/gmp/
Eclipse Foundation: OclInEcore (2016). https://wiki.eclipse.org/OCL/OCLinEcore
Eclipse Foundation: Papyrus modeling environment (2016). https://eclipse.org/papyrus/
Fielding, R.T.: Architectural styles and the design of network-based software architectures. Ph.D. thesis, University of California, Irvine (2000). Chapter 5: Representational State Transfer (REST)
Fondement, F., Baar, T.: Making Metamodels Aware of Concrete Syntax, pp. 190–204. Springer, Berlin (2005). https://doi.org/10.1007/11581741_15
Frosini, L., Paternò, F.: User interface distribution in multi-device and multi-user environments with dynamically migrating engines. In: Proceedings of the 2014 ACM SIGCHI Symposium on Engineering Interactive Computing Systems, EICS ’14, pp. 55–64. ACM, New York, NY, USA (2014). https://doi.org/10.1145/2607023.2607032
Guerrero-Garcia, J., Vanderdonckt, J., Gonzalez-Calleros, J.M.: Towards a multi-user interaction meta-model (2008). http://www.academia.edu/26771363/Towards_a_Multi-User_Interaction_Meta-Model
Hutchings, H.M., Pierce, J.S.: Understanding the whethers, hows, and whys of divisible interfaces. In: Proceedings of the Working Conference on Advanced Visual Interfaces, AVI ’06, pp. 274–277. ACM, New York, NY, USA (2006). https://doi.org/10.1145/1133265.1133320
Johanson, B., Ponnekanti, S., Sengupta, C., Fox, A.: Multibrowsing: Moving Web Content Across Multiple Displays, pp. 346–353. Springer, Berlin (2001). https://doi.org/10.1007/3-540-45427-6_29
Lorenz, A., De Castro, C.F., Rukzio, E.: Using handheld devices for mobile interaction with displays in home environments. In: Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services, MobileHCI ’09, pp. 18:1–18:10. ACM, New York, NY, USA (2009). https://doi.org/10.1145/1613858.1613882
Manca, M., Paternò, F.: Customizable dynamic user interface distribution. In: Proceedings of the 8th ACM SIGCHI Symposium on Engineering Interactive Computing Systems, EICS ’16, pp. 27–37. ACM, New York, NY, USA (2016). https://doi.org/10.1145/2933242.2933259
Martinie, C., Navarre, D., Palanque, P.: A multi-formalism approach for model-based dynamic distribution of user interfaces of critical interactive systems. Int. J. Hum. Comput. Stud. 72(1), 77–99 (2014). https://doi.org/10.1016/j.ijhcs.2013.08.013
Masson, D., Demeure, A., Calvary, G.: Magellan, an evolutionary system to foster user interface design creativity. In: Proceedings of the 2Nd ACM SIGCHI Symposium on Engineering Interactive Computing Systems, EICS ’10, pp. 87–92. ACM, New York, NY, USA (2010)
Meixner, G., Calvary, G., Coutaz, J.: Introduction to model-based user interfaces (2014). https://www.w3.org/TR/mbui-intro/
Meixner, G., Paternò, F., Vanderdonckt, J.: Past, present, and future of model-based user interface development. i-com 10(3), 2–11 (2011). https://doi.org/10.1524/icom.2011.0026
Meixner, G., Schäfer, R.: Modellbasierte entwicklung von benutzungsschnittstellen mit UIML (model-based development of user interfaces with UIML). i-com 8(1), 60–67 (2009). https://doi.org/10.1524/icom.2009.0010
Melchior, J., Vanderdonckt, J., Van Roy, P.: A model-based approach for distributed user interfaces. In: Proceedings of the 3rd ACM SIGCHI Symposium on Engineering Interactive Computing Systems, EICS ’11, pp. 11–20. ACM, New York, NY, USA (2011). https://doi.org/10.1145/1996461.1996488
Mellor, S.: MDA Distilled, Principles of Model Driven Architecture. Addison-Wesley Professional, Boston (2004)
Nebeling, M., Dey, A.K.: Xdbrowser: User-defined cross-device web page designs. In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, CHI ’16, pp. 5494–5505. ACM, New York, NY, USA (2016). https://doi.org/10.1145/2858036.2858048
Object Management Group OMG: Unified modeling language (uml) (2015). http://www.omg.org/mof/
Object Management Group OMG: Mda - the architecture of choice for a changing world (2016). http://www.omg.org/mda/
Object Management Group OMG: Meta object facility (2016). http://www.omg.org/mof/
Object Management Group OMG: The object constraint language specification (2016). http://www.omg.org/spec/OCL/
Peñalver, A., López-Espín, J.J., Gallud, J.A., Lazcorreta, E., Botella, F.: Distributed User Interfaces: Specification of Essential Properties, pp. 13–21. Springer, London (2011). https://doi.org/10.1007/978-1-4471-2271-5_2
Petrasch, R.: Model based user interface design: model driven architecture and hci patterns. Mitt Ges Inf. 27(3), 5–10 (2007)
Pilemalm, S., Hallberg, N., Sparf, M., Niclason, T.: Practical experiences of model-based development: case studies from the swedish armed forces. Syst. Eng. 15(4), 407–421 (2012)
Pinheiro da Silva, P.: User interface declarative models and development environments: A survey. In: Palanque, P., Paternò, F. (eds.) Proceedings of the 7th International Workshop in Interactive Systems Design, Specification and Verification DSV-IS 2000, pp. 207–226. Springer, Berlin (2001)
Szekely, P.: Retrospective and challenges for model-based interface development. In: Bodart, F., Vanderdonckt, J. (eds.) Proceedings of the Eurographics Workshop in Design, Specification and Verification of Interactive Systems ’96, pp. 1–27. Springer Vienna (1996)
Terrenghi, L., Quigley, A., Dix, A.: A taxonomy for and analysis of multi-person-display ecosystems. Personal Ubiquitous Comput. 13(8), 583–598 (2009)
Vanderdonckt, J.: Distributed user interfaces: how to distribute user interface elements across users, platforms, and environments. Proc. XI Interaccin 2010, 20–32 (2010)
Vanderdonckt, J., Bodart, F.: Encapsulating knowledge for intelligent automatic interaction objects selection. In: Proceedings of the ACM Conference on Human Factors in Computing Systems, pp. 424–429. ACM Press (1993)
Vanderdonckt, J., Tesoriero, R., Mezhoudi, N., Motti, V., Beuvens, F., Melchior, J.: MBUI—abstract user interface models (2014). https://www.w3.org/TR/abstract-ui/
Villanueva, P.G., Tesoriero, R., Gallud, J.A.: Revisiting the Concept of Distributed User Interfaces, pp. 1–15. Springer, Berlin (2013)
Yang, J., Wigdor, D.: Panelrama: Enabling easy specification of cross-device web applications. In: Proceedings of the 32Nd Annual ACM Conference on Human Factors in Computing Systems, CHI ’14, pp. 2783–2792. ACM, New York, NY, USA (2014). https://doi.org/10.1145/2556288.2557199
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Tesoriero, R., Altalhi, A.H. Model-based development of distributable user interfaces. Univ Access Inf Soc 18, 719–746 (2019). https://doi.org/10.1007/s10209-017-0600-6
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10209-017-0600-6