Skip to main content
SpringerLink
Log in

Foundations for distributing the interaction: facilitating universal access through Responsive Cross-Device Applications

  • Long Paper
  • Published:
Universal Access in the Information Society Aims and scope Submit manuscript

Abstract

The emergence of the Internet of Things has created the prospect of a future in which devices can always be connected. There is a trend for information to be available to anyone, anywhere and anytime. Moreover, current scenarios are full of interconnected devices with their own interactive capabilities. The problem of orchestrating these capabilities in multi-device environments is complex and remains unsolved. However, providing universal access is not only a question of devices being connected or sharing information. To get a better understanding of how to distribute interaction in Web applications, we developed new theoretical and practical proposals. Also, we perform case studies through the supporting tools developed as prototypes. On this article, we present two major contributions. First, we present the foundations of Responsive Cross-Device Applications. This approach is aimed at supporting user tasks in cross-device environments, adapting interaction to facilitate user task completion. Secondly, we provide the answer for the following research questions: (1) What do we mean by Distributed Interaction? (2) How do current approaches deal with the distribution of the interaction? (3) What is the best platform for distributing the interaction? and (4) Does the distribution of the interaction facilitate universal access? Finally, we discuss the outcomes of this article in view of these research questions.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Notes

  1. http://www.xbox.com

  2. https://www.w3.org/html/

  3. https://www.w3.org/wiki/Category:HTMLElement

  4. http://getbootstrap.com/

References

  1. Abowd, G.D.: Formal aspects of human-computer interaction. Ph.D. thesis (1991)

  2. Albertos Marco, F., Gallud, J., Penichet, V.M., Winckler, M.: A model-based approach for describing offline navigation of web applications. J. Web Eng. 16(1&2), 1–38 (2017)

    Google Scholar 

  3. Albertos Marco, F., Penichet, V.M., Gallud, J.A.: Drag&share: a shared workspace for distributed synchronous collaboration. In: Gallud, J.A., Tesoriero, R., Penichet, V.M. (eds.) Distributed User Interfaces, Human-Computer Interaction Series, pp. 125–132. Springer London, London (2011). https://doi.org/10.1007/978-1-4471-2271-5_14

    Chapter  Google Scholar 

  4. Albertos Marco, F., Penichet, V.M.R., Gallud, J.A.: Collaborative e-learning through Drag&Share in synchronous shared workspaces. J. UCS 19(7), 894–911 (2013). https://doi.org/10.3217/jucs-019-07-0894

    Article  Google Scholar 

  5. Albertos Marco, F., Penichet, V.M.R., Gallud, J.A.: Making distributed user interfaces interruption-resistant: a model-based approach. In: Lozano, M.D., Mashat, A.S., Fardoun, H.M., Gallud, J.A., Penichet, V.M.R., Tesoriero, R., Vanderdonckt, J. (eds.) DUI@EICS, pp. 18–22 (2013)

  6. Albertos Marco, F., Penichet, V.M.R., Gallud, J.A, Winckler, M.A.: User interaction with offline web applications: a case study. In: Interacción’15 (2015). https://doi.org/10.1145/2829875.2829890

  7. Albertos Marco, F., Penichet, V.M.R., Gallud, J.A, Winckler, M.A.: What happens when students go offline in mobile devices? In: Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct, MobileHCI ’15, pp. 1199–1206. ACM, New York, NY, USA (2015). https://doi.org/10.1145/2786567.2801609

  8. Almeida, N., Silva, S., Teixeira, A.: Multimodal multi-device application supported by an SCXML state chart machine. In: Proceedings of EICS Workshop on Engineering Interactive Systems with SCXML (2014)

  9. Bunde-Pedersen, J.: Distributed interaction for activity-based computing. Ph.D. thesis, Department of Computer Science, University of Aarhus (2009)

  10. Chi, P.Y.P., Li, Y.: Weave: scripting cross-device wearable interaction. In: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, CHI ’15, pp. 3923–3932. ACM, New York, NY, USA (2015). https://doi.org/10.1145/2702123.2702451

  11. Dearman, D., Pierce, J.S.: It’s on my other computer!: Computing with multiple devices. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’08, pp. 767–776. ACM, New York, NY, USA (2008). https://doi.org/10.1145/1357054.1357177

  12. de la Guía, E., Camacho, V., Orozco-Barbosa, L., Lujan, V.B., Penichet, V.M.R., Lozano, M.: Introducing IoT and wearable technologies into task-based language learning for young children. IEEE Trans. Learn. Technol. PP(99), 1–1 (2016). https://doi.org/10.1109/TLT.2016.2557333

    Article  Google Scholar 

  13. Elmqvist, N.: Distributed User Interfaces: State of the Art, pp. 1–12. Springer London, London (2011). https://doi.org/10.1007/978-1-4471-2271-5_1

    Book  Google Scholar 

  14. Fitzmaurice, G.W., Khan, A., Buxton, W., Kurtenbach, G., Balakrishnan, R.: Sentient data access via a diverse society of devices. Queue 1(8), 52–62 (2003). https://doi.org/10.1145/966712.966721

    Article  Google Scholar 

  15. Ghiani, G., Manca, M., Paternò, F.: Authoring context-dependent cross-device user interfaces based on trigger/action rules. In: Proceedings of the 14th International Conference on Mobile and Ubiquitous Multimedia, MUM ’15, pp. 313–322. ACM, New York, NY, USA (2015). https://doi.org/10.1145/2836041.2836073

  16. Ghiani, G., Paternò, F., Santoro, C.: Push and pull of web user interfaces in multi-device environments. In: Proceedings of the International Working Conference on Advanced Visual Interfaces, AVI ’12, pp. 10–17. ACM, New York, NY, USA (2012). https://doi.org/10.1145/2254556.2254563

  17. Hamilton, P., Wigdor, D.J.: Conductor: enabling and understanding cross-device interaction. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’14, pp. 2773–2782. ACM, New York, NY, USA (2014). https://doi.org/10.1145/2556288.2557170

  18. Houben, S.: An activity-centric approach to configuration work in distributed interaction. Ph.D. thesis, Pervasive Interaction Technology Laboratory, IT University of Copenhagen (2015)

  19. Houben, S., Nielsen, S., Esbensen, M., Bardram, J.E.: Noosphere: an activity-centric infrastructure for distributed interaction. In: Proceedings of the 12th International Conference on Mobile and Ubiquitous Multimedia, MUM ’13, pp. 13:1–13:10. ACM, New York, NY, USA (2013). https://doi.org/10.1145/2541831.2541856

  20. Husmann, M., Nebeling, M., Norrie, M.: Multimasher: a visual tool for multi-device mashups. In: Sheng, Q., Kjeldskov, J. (eds.) Current Trends in Web Engineering, Lecture Notes in Computer Science, pp. 27–38. Springer, Cham (2013). https://doi.org/10.1007/978-3-319-04244-2_4

    Chapter  Google Scholar 

  21. Jetter, H.C., Zllner, M., Gerken, J., Reiterer, H.: Design and implementation of post-wimp distributed user interfaces with zoil. Int. J. Hum. Comput. Interact. 28(11), 737–747 (2012). https://doi.org/10.1080/10447318.2012.715539

    Article  Google Scholar 

  22. Jokela, T., Ojala, J., Olsson, T.: A diary study on combining multiple information devices in everyday activities and tasks. In: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, CHI ’15, pp. 3903–3912. ACM, New York, NY, USA (2015). https://doi.org/10.1145/2702123.2702211

  23. Kane, S.K., Karlson, A.K., Meyers, B.R., Johns, P., Jacobs, A., Smith, G.: Exploring cross-device web use on pcs and mobile devices. In: Proceedings of the 12th IFIP TC 13 International Conference on Human-Computer Interaction: Part I, INTERACT ’09, pp. 722–735. Springer, Berlin (2009). https://doi.org/10.1007/978-3-642-03655-2_79

    Chapter  Google Scholar 

  24. Manca, M., Paternò, F.: Customizable dynamic user interface distribution. In: Proceedings of the 8th ACM SIGCHI Symposium on Engineering Interactive Computing Systems, EICS ’16, pp. 27–37. ACM, New York, NY, USA (2016). https://doi.org/10.1145/2933242.2933259

  25. Manca, M., Paternó, F., Santoro, C., Spano, L.: Generation of multi-device adaptive multimodal web applications. In: Daniel, F., Papadopoulos, G., Thiran, P. (eds.) Mobile Web Information Systems, Lecture Notes in Computer Science, pp. 218–232. Springer, Berlin (2013). https://doi.org/10.1007/978-3-642-40276-0_17

    Chapter  Google Scholar 

  26. Nebeling, M., Mintsi, T., Husmann, M., Norrie, M.: Interactive development of cross-device user interfaces. In: Proceedings of the 32nd Annual ACM Conference on Human Factors in Computing Systems, CHI ’14, pp. 2793–2802. ACM, New York, NY, USA (2014). https://doi.org/10.1145/2556288.2556980

  27. Oulasvirta, A., Sumari, L.: Mobile kits and laptop trays: managing multiple devices in mobile information work. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’07, pp. 1127–1136. ACM, New York, NY, USA (2007). https://doi.org/10.1145/1240624.1240795

  28. Rekimoto, J.: Pick-and-drop: a direct manipulation technique for multiple computer environments. In: UIST ’97—Proceedings of the 10th Annual ACM Symposium on User Interface Software and Technology, pp. 31–39. ACM Press, New York, NY, USA (1997). https://doi.org/10.1145/263407.263505

  29. Santosa, S., Wigdor, D.: A field study of multi-device workflows in distributed workspaces. In: Proceedings of the 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing, UbiComp ’13, pp. 63–72. ACM, New York, NY, USA (2013). https://doi.org/10.1145/2493432.2493476

  30. Schreiner, M., Rädle, R., Jetter, H.C., Reiterer, H.: Connichiwa: a framework for cross-device web applications. In: Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems, CHI EA ’15, pp. 2163–2168. ACM, New York, NY, USA (2015). https://doi.org/10.1145/2702613.2732909

  31. Silva, S., Almeida, N., Pereira, C., Martins, A.I., Rosa, A.F., Oliveira e Silva, M., Teixeira, A.: Design and Development of Multimodal Applications: A Vision on Key Issues and Methods, pp. 109–120. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-20678-3_11

    Book  Google Scholar 

  32. Stephanidis, C.: Universal access in the information society—a retrospective of recent activities. In: Universal Design: Towards Universal Access in the Information Society, CHI ’01. ACM, New York, NY, USA (2001)

  33. Villanueva, P.G., Tesoriero, R., Gallud, J.A.: Copyflypaste: distributing information on distributed user interfaces. In: Distributed User Interfaces: Models, Methods and Tools, DUI 2013 In Conjunction with ACM EICS 2013 Conference, London, UK, June 24th 2013, pp. 62–66 (2013)

  34. Villanueva, P.G., Tesoriero, R., Gallud, J.A.: Proxywork: distributing user interface components of web applications. In: Distributed User Interfaces: Models, Methods and Tools, DUI 2013 In Conjunction with ACM EICS 2013 Conference, London, UK, June 24th 2013, pp. 58–61 (2013)

  35. Wäljas, M., Segerståhl, K., Väänänen-Vainio-Mattila, K., Oinas-Kukkonen, H.: Cross-platform service user experience: a field study and an initial framework. In: Proceedings of the 12th International Conference on Human Computer Interaction with Mobile Devices and Services, MobileHCI ’10, pp. 219–228. ACM, New York, NY, USA (2010). https://doi.org/10.1145/1851600.1851637

  36. Yang, J., Wigdor, D.: Panelrama: enabling easy specification of cross-device web applications. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’14, pp. 2783–2792. ACM, New York, NY, USA (2014). https://doi.org/10.1145/2556288.2557199

Download references

Acknowledgements

This work has been partially supported by Grant 2014/10340 from the University of Castilla-La Mancha, Spain.

Author information

Authors and Affiliations

  1. Computer System Department, University of Castilla-La Mancha, Albacete, Spain

    Felix Albertos-Marco, Victor M. R. Penichet & Jose A. Gallud

Authors
  1. Felix Albertos-Marco
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Victor M. R. Penichet
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jose A. Gallud
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Felix Albertos-Marco.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Albertos-Marco, F., Penichet, V.M.R. & Gallud, J.A. Foundations for distributing the interaction: facilitating universal access through Responsive Cross-Device Applications. Univ Access Inf Soc 18, 821–835 (2019). https://doi.org/10.1007/s10209-017-0599-8

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10209-017-0599-8

Keywords

Search

Navigation