skip to main content
10.1145/2836041.2836073acmotherconferencesArticle/Chapter ViewAbstractPublication PagesmumConference Proceedingsconference-collections
research-article

Authoring context-dependent cross-device user interfaces based on trigger/action rules

Published: 30 November 2015 Publication History

Abstract

Current authoring environments provide the possibility of developing user interfaces with limited adaptation capacities. The most widely adopted tools follow the responsive design approach and allow developers to obtain user interfaces that can adapt mainly to the screen size and orientation. We present a solution able to support development of user interfaces able to adapt to the various types of contextual events (that can be related to users, devices, environments, and social relationships), with the added possibility of distributing the user interface elements across multiple devices. The context-dependent behavior is modelled through trigger / action rules, and can even be applied to Web applications that were not originally designed to be context-aware. This paper describes the design and main features of the novel authoring environment and reports on a first user study.

References

[1]
Brown, P. J. 1996. The Stick-e Document: a Framework for Creating Context-aware Applications. ElectronicPublishing, WILEY, Chichester, GB, vol. 8, no. 2-3, 24 September 1996, pp. 259--272.
[2]
Chen, X. A., Grossman, T., Wigdor, D. J., and Fitzmaurice, G. 2014. Duet: exploring joint interactions on a smart phone and a smart watch. Proceedings of CHI 2014, ACM, pp. 159--168.
[3]
Chi, P. and Li, Y. 2015. Weave: Scripting Cross-Device Wearable Interaction. Proceedings of CHI 2015, ACM, pp.3923-3932.
[4]
Dumas, B., Solórzano, M., and Signer, B. 2013. Design guidelines for adaptive multimodal mobile input solutions. Proceedings of MobileHCI 2013, ACM, pp. 285--294.
[5]
Frosini, L. and Paternò, F. 2014. User Interface Distribution in Multi-Device and Multi-User Environments with Dynamically Migrating Engines. Proceedings of EICS 2014, ACM, pp. 55--64.
[6]
Ghiani, G., Manca, M., Paternò, F., and Porta, C. 2014. Beyond Responsive Design: Context-Dependent Multimodal Augmentation of Web Applications. Proceedings of MobiWIS 2014, LNCS Volume 8640, pp. 71-85, Springer Verlag.
[7]
Grubert, J., Heinisch, M., Quigley, A. J., and Schmalstieg, D. 2015. MultiFi: Multi Fidelity Interaction with Displays On and Around the Body. Proceedings of CHI 2015, ACM, pp. 3933--3942.
[8]
Houben, S., and Marquardt, N. 2015. WatchConnect: A Toolkit for Prototyping Smartwatch-Centric Cross-Device Applications. Proceedings of CHI 2015, ACM, pp. 1247--1256.
[9]
Lin, J. and Landay J. A. 2008. Employing patterns and layers for early-stage design and prototyping of cross-device user interfaces. In Proceedings of CHI 2008, ACM, pp. 1313--1322.
[10]
Korpipää, P., Malm, E., Rantakokko, T., Kyllönen, V., Kela, J., Mäntyjärvi, J., Häkkilä, J., and Känsälä, I. 2006. Customizing User Interaction in Smart Phones. IEEE Pervasive Computing 5(3): 82-90 (2006).
[11]
Marcotte, E. 2011. Responsive Web Design, A Book Apart (2011), http://www.abookapart.com/products/responsive-web-design
[12]
Marquardt, N., Diaz-Marino, R., Boring, S., and Greenberg, S. 2011. The proximity toolkit: prototyping proxemic interactions in ubiquitous computing ecologies. In Proceedings of UIST 2011, ACM, pp. 315--326.
[13]
Maues, R. A. and Barbosa, S. D. J. 2013. Keep doing what I just did: automating smartphones by demonstration. In Proceedings of MobileHCI 2013, ACM, pp. 295--303.
[14]
Meskens, J., Luyten, K., and Coninx, K. 2010. Jelly: a multi-device design environment for managing consistency across devices. In Proceedings of AVI 2010, ACM, pp. 289--296.
[15]
Nebeling, M., Mintsi, T., Husmann, M., Norrie, M. C. 2014. Interactive development of cross-device user interfaces. In Proceedings of CHI 2014, ACM, pp. 2793--2802.
[16]
Realinho, V., Romão, T., and Dias, A. E. 2012. An event-driven workflow framework to develop context-aware mobile applications. In Proceedings of the 11th International Conference on Mobile and Ubiquitous Multimedia (MUM '12), article 12, ACM Press, 2012.
[17]
Salber, D., Anind, D., and Abowd, G. 1999. The context toolkit: Aiding the development of context-enabled applications. In: Proceedings of CHI 1999, ACM, pp. 434--441.
[18]
Ur, B., McManus, E., Ho, M. P. Y., and Littman, M. L. 2014. Practical trigger-action programming in the smart home. In Proceedings of CHI 2014, ACM, pp. 803--812.
[19]
Yang, J. and Wigdor, D. 2014. Panelrama: enabling easy specification of cross-device web applications. In Proceedings of CHI 2014, ACM, pp. 2783--2792.

Cited By

View all
  • (2024)Opportunistic Nudges for Task Migration Between Personal DevicesExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3651037(1-8)Online publication date: 11-May-2024
  • (2023)A mixed factorial experiment with colors and adaptive web user interfaces to change emotionsProceedings of the XXII Brazilian Symposium on Human Factors in Computing Systems10.1145/3638067.3638092(1-12)Online publication date: 16-Oct-2023
  • (2021)IFTTT Rely Based a Semantic Web Approach to Simplifying Trigger-Action Programming for End-User Application with IoT ApplicationsSemantic IoT: Theory and Applications10.1007/978-3-030-64619-6_17(385-397)Online publication date: 13-Apr-2021
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
MUM '15: Proceedings of the 14th International Conference on Mobile and Ubiquitous Multimedia
November 2015
442 pages
ISBN:9781450336055
DOI:10.1145/2836041
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

  • FH OOE: University of Applied Sciences Upper Austria
  • Johannes Kepler Univ Linz: Johannes Kepler Universität Linz

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 30 November 2015

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. context-awareness
  2. cross-device user interfaces
  3. ubiquitous computing

Qualifiers

  • Research-article

Funding Sources

Conference

MUM '15
Sponsor:
  • FH OOE
  • Johannes Kepler Univ Linz

Acceptance Rates

MUM '15 Paper Acceptance Rate 33 of 89 submissions, 37%;
Overall Acceptance Rate 190 of 465 submissions, 41%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)27
  • Downloads (Last 6 weeks)0
Reflects downloads up to 16 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Opportunistic Nudges for Task Migration Between Personal DevicesExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3651037(1-8)Online publication date: 11-May-2024
  • (2023)A mixed factorial experiment with colors and adaptive web user interfaces to change emotionsProceedings of the XXII Brazilian Symposium on Human Factors in Computing Systems10.1145/3638067.3638092(1-12)Online publication date: 16-Oct-2023
  • (2021)IFTTT Rely Based a Semantic Web Approach to Simplifying Trigger-Action Programming for End-User Application with IoT ApplicationsSemantic IoT: Theory and Applications10.1007/978-3-030-64619-6_17(385-397)Online publication date: 13-Apr-2021
  • (2020)User-driven Design Guidelines for the Authoring of Cross-Device and Internet of Things ApplicationsProceedings of the 11th Nordic Conference on Human-Computer Interaction: Shaping Experiences, Shaping Society10.1145/3419249.3420136(1-12)Online publication date: 25-Oct-2020
  • (2019)User Interface Distribution Method Based on Pi-CalculusInternational Journal of Distributed Systems and Technologies10.4018/IJDST.201907010110:3(1-20)Online publication date: 1-Jul-2019
  • (2019)FortunettesProceedings of the ACM on Human-Computer Interaction10.1145/33311623:EICS(1-20)Online publication date: 13-Jun-2019
  • (2019)Context- and Data-driven Satisfaction Analysis of User Interface Adaptations Based on Instant User FeedbackProceedings of the ACM on Human-Computer Interaction10.1145/33311613:EICS(1-20)Online publication date: 13-Jun-2019
  • (2019)AB4WebProceedings of the ACM on Human-Computer Interaction10.1145/33311603:EICS(1-28)Online publication date: 13-Jun-2019
  • (2019)MoCaDiXProceedings of the ACM on Human-Computer Interaction10.1145/33311593:EICS(1-40)Online publication date: 13-Jun-2019
  • (2019)SAPIENSProceedings of the ACM on Human-Computer Interaction10.1145/33311533:EICS(1-24)Online publication date: 13-Jun-2019
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media