Skip to main content
SpringerLink
Log in

Automated Web GUI Generation from High-Level Interaction Design with Discourse Models

  • Conference paper
  • First Online:
Web Engineering (ICWE 2023)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 13893))

Included in the following conference series:

  • 481 Accesses

Abstract

Interaction design is considered important for achieving usable Web user interfaces. Communicative acts as abstractions from speech acts can model basic building blocks (‘atoms’) of communication, like a question or an answer. When, e.g., a question and an answer are glued together as a so-called adjacency pair, a simple ‘molecule’ of a dialogue is modeled. Deliberately complex discourse structures can be modeled using relations from Rhetorical Structure Theory (RST). The content of a communicative act can refer to ontologies of the domain of discourse. Taking all this together, we created a new discourse metamodel that specifies what discourse models may look like. Such discourse models can specify an interaction design. Since manual creation of user interfaces is hard and expensive, automated generation may become more and more important. This tutorial also demonstrates how such an interaction design can be used for automated Web GUI generation. This is based on model-transformation rules according to the model-driven architecture. Based on AI optimization techniques, the graphical user interfaces (GUIs) are automatically tailored to a device such as a smartphone according to a given device specification. Since the usability of fully-automatically generated GUIs is still not satisfactory, unique customization techniques are employed as well. We also address low-vision accessibility of Web-pages, by combining automated design-time generation of Web-pages with responsive design for improving accessibility.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 64.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 84.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Bogdan, C., et al.: Generating an abstract user interface from a discourse model inspired by human communication. In: Proceedings of the 41st Hawaii International Conference on System Sciences (HICSS 2008), Waikoloa, Big Island, Hawaii. IEEE (2008)

    Google Scholar 

  2. Bogdan, C., Kaindl, H., Falb, J., Popp, R.: Modeling of interaction design by end users through discourse modeling, In: Proceedings of the 2008 ACM International Conference on Intelligent User Interfaces (IUI 2008), Maspalomas, Gran Canaria, Spain. ACM Press (2008)

    Google Scholar 

  3. Falb, J., Kaindl, H., Horacek, H., Bogdan, C., Popp, R., Arnautovic, E.: A discourse model for interaction design based on theories of human communication. In: CHI’06 Extended Abstracts on Human Factors in Computing Systems, pp. 754–759, ACM Press (2006)

    Google Scholar 

  4. Falb, J., Kavaldjian, S., Popp, R., Raneburger, D., Arnautovic, E., Kaindl, H.: Fully automatic user interface generation from discourse models. In: Proceedings of the 2009 ACM International Conference on Intelligent User Interfaces (IUI 2009). ACM Press (2009). Tool demo paper

    Google Scholar 

  5. Falb, J., Popp, R., Röck, T., Jelinek, H., Arnautovic, E., Kaindl, H.: Using communicative acts in interface design specifications for automated synthesis of user interfaces. In: Proceedings of the 21st IEEE/ACM International Conference on Automated Software Engineering (ASE 2006), pp. 261–264 (2006)

    Google Scholar 

  6. Falb, J., Popp, R., Röck, T., Jelinek, H., Arnautovic, E., Kaindl, H.: UI prototyping for multiple devices through specifying interaction design. In: Baranauskas, C., Palanque, P., Abascal, J., Barbosa, S.D.J. (eds.) INTERACT 2007. LNCS, vol. 4662, pp. 136–149. Springer, Heidelberg (2007). https://doi.org/10.1007/978-3-540-74796-3_15

    Chapter  Google Scholar 

  7. Kaindl, H., Popp, R., Raneburger, D.: Alternative interaction design patterns for automated GUI generation from discourse-based communication models. In: Proceedings of the 2014 IEEE International Conference on Systems, Man and Cybernetics (SMC 2014), San Diego, CA, USA. IEEE (2014)

    Google Scholar 

  8. Kavaldjian, S., Bogdan, C., Falb, J., Kaindl, H.: Transforming Discourse Models to Structural User Interface Models, Models in Software Engineering, MoDELS 2007 Workshops, LNCS 5002, pp. 77–88. Springer-Verlag, Berlin-Heidelberg (invited) (2008)

    Google Scholar 

  9. Kavaldjian, S., Falb, J., Kaindl, H.: Generating content presentation according to purpose. In: Proceedings of the 2009 IEEE International Conference on Systems, Man and Cybernetics (SMC 2009), San Antonio, TX, USA. IEEE (2009)

    Google Scholar 

  10. Popp, R., Falb, J., Raneburger, D., Kaindl, H.: A transformation engine for model-driven UI generation. In: Proceedings of the 4th ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS 2012), Copenhagen, Denmark (2012)

    Google Scholar 

  11. Popp, R., Kaindl, H., Badalians Gholi Kandi, S., Raneburger, D., Paterno, F.: Duality of task- and discourse-based interaction design for GUI generation. In: Proceedings of the 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC 2014), pp. 3323–3328 (2014)

    Google Scholar 

  12. Popp, R., Kaindl, H., Raneburger, D.: Connecting interaction models and application logic for model-driven generation of web-based graphical user interfaces. In: Proceedings of the 20th Asia-Pacific Software Engineering Conference (APSEC 2013). ACM (2013)

    Google Scholar 

  13. Popp, R., Raneburger, D., and Kaindl, H.: Tool support for automated multi-device GUI generation from discourse-based communication models. In: Proceedings of the ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS 2013) (2013)

    Google Scholar 

  14. Raneburger, D., Alonso-Ríos, D., Popp, R., Kaindl, H., Falb, J.: A user study with GUIs tailored for smartphones. In: Kotzé, P., Marsden, G., Lindgaard, G., Wesson, J., Winckler, M. (eds.) INTERACT 2013. LNCS, vol. 8118, pp. 505–512. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-40480-1_34

    Chapter  Google Scholar 

  15. Raneburger, D., Kaindl, H., Popp, R.: Strategies for automated GUI tailoring for multiple devices. In: Proceedings of the 48st Annual Hawaii International Conference on System Sciences (HICSS-48) (2015)

    Google Scholar 

  16. Raneburger, D., Kaindl, H., Popp, R.: Model transformation rules for customization of multi-device graphical user interfaces. In: Proceedings of the 7th ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS 2015), pp. 100–109 (2015)

    Google Scholar 

  17. Raneburger, D., Kaindl, H., Popp, R., Šajatovic, V., Armbruster, A.: A process for facilitating interaction design through automated GUI generation. In: Proceedings of the 29th ACM/SIGAPP Symposium on Applied Computing (SAC 2014) (2014)

    Google Scholar 

  18. Raneburger, D., Popp, R., Kaindl, H.: Model-driven transformation for optimizing PSMs: a case study of rule design for multi-device GUI generation. In Proceedings of the 8th International Joint Conference on Software Technologies (ICSOFT 2013). SciTePress (2013)

    Google Scholar 

  19. Raneburger, D., Popp, R., Kaindl, H.: A user study to evaluate the customization of automatically generated GUIs. In: Black, N.L., Neumann, W.P., Noy, I. (eds.) IEA 2021. LNNS, vol. 223, pp. 683–690. Springer, Cham (2022). https://doi.org/10.1007/978-3-030-74614-8_85

    Chapter  Google Scholar 

  20. Raneburger, D., Popp, R., Kaindl, H., Armbruster, A., Šajatović, V.: An iterative and incremental process for interaction design through automated GUI generation. In: Kurosu, M. (ed.) HCI 2014. LNCS, vol. 8510, pp. 373–384. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-07233-3_35

    Chapter  Google Scholar 

  21. Raneburger, D., Popp, R., Kaindl, H., Falb, J.: Automated WIMP-UI behavior generation: parallelism and granularity of communication units. In: Proceedings of the 2011 IEEE International Conference on Systems, Man and Cybernetics (SMC 2011), pp. 2816–2821 (2011)

    Google Scholar 

  22. Raneburger, D., Popp, R., Kaindl, H., Falb, J., Ertl, D.: Automated generation of device-specific WIMP-UIs: weaving of structural and behavioral models. In: Proceedings of the 2011 SIGCHI Symposium on Engineering Interactive Computing Systems (EICS 2011) (2011)

    Google Scholar 

  23. Rathfux, T., Popp, R., Kaindl, H.,: Adding custom widgets to model-driven GUI generation. In: Proceedings of the 8th ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS 2016), Brussels, Belgium (2016)

    Google Scholar 

  24. Rathfux, T., Thöner, J., Kaindl, H., Popp, R.: Combining design-time generation of web-pages with responsive design for improving low-vision accessibility. In: Proceedings of the ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS 2018), Paris (2018)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. TU Wien, Vienna, Austria

    Hermann Kaindl

Authors
  1. Hermann Kaindl
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hermann Kaindl .

Editor information

Editors and Affiliations

  1. University of Alicante, Alicante, Spain

    Irene Garrigós

  2. University of Extremadura, Cáceres, Spain

    Juan Manuel Murillo Rodríguez

  3. Johannes Kepler University Linz, Linz, Austria

    Manuel Wimmer

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Kaindl, H. (2023). Automated Web GUI Generation from High-Level Interaction Design with Discourse Models. In: Garrigós, I., Murillo Rodríguez, J.M., Wimmer, M. (eds) Web Engineering. ICWE 2023. Lecture Notes in Computer Science, vol 13893. Springer, Cham. https://doi.org/10.1007/978-3-031-34444-2_37

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-34444-2_37

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-34443-5

  • Online ISBN: 978-3-031-34444-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation