Skip to main content
SpringerLink
Log in

Shadow Display Design Concepts for AI Enhanced Environments

  • Conference paper
  • First Online:
ArtsIT, Interactivity and Game Creation (ArtsIT 2022)

Included in the following conference series:

  • 591 Accesses

Abstract

In this paper, we focus on the idea of using artificial shadows as information displays. Through scenarios, co-design methods, and low-fi prototyping, we assess and create different scenarios to chart people’s preferences in designing shadow displays. We report on two user studies, which reveal aesthetics, experiental aspects, unobtrusiveness, and ambiguity as key strengths of shadow displays. Our work contributes to the research knowledge in applying co-design methods to create user interfaces for artificial intelligence (AI) enhanced environments.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 89.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 119.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://material.io/design/environment/light-shadows.html.

References

  1. Abowd, G.D., Dey, A.K., Brown, P.J., Davies, N., Smith, M., Steggles, P.: Towards a better understanding of context and context-awareness. In: Gellersen, H.-W. (ed.) HUC 1999. LNCS, vol. 1707, pp. 304–307. Springer, Heidelberg (1999). https://doi.org/10.1007/3-540-48157-5_29

    Chapter  Google Scholar 

  2. Bjerknes, G., Ehn, P., Kyng, M.: Computers and democracy. Aldershot, England Avebury (1987)

    Google Scholar 

  3. Bodker, S.: Scenarios in user-centred design-setting the stage for reflection and action. In: Proceedings of the 32nd Annual Hawaii International Conference on Systems Sciences, HICSS-32. Abstracts and CD-ROM of Full Papers, p. 11. IEEE (1999)

    Google Scholar 

  4. Bødker, S., Kyng, M., Greenbaum, J.: Setting the Stage: Workshops and Group Interaction, pp. 139–154. Lawrence Erlbaum Associates, Hillsdale (1991)

    Google Scholar 

  5. Boer, L., Donovan, J.: Provotypes for participatory innovation. In: Proceedings of the Designing Interactive Systems Conference, pp. 388–397 (2012)

    Google Scholar 

  6. Brandt, E., Grunnet, C.: Evoking the future: drama and props in user centered design. In: Proceedings of Participatory Design Conference (PDC 2000), pp. 11–20. ACM Press, New York (2000)

    Google Scholar 

  7. Carroll, J.M.: Making Use: Scenario-Based Design of Human-Computer Interactions. MIT press, Cambridge (2003)

    Book  Google Scholar 

  8. Chromik, M., Butz, A.: Human-XAI interaction: a review and design principles for explanation user interfaces. In: Ardito, C., Lanzilotti, R., Malizia, A., Petrie, H., Piccinno, A., Desolda, G., Inkpen, K. (eds.) INTERACT 2021. LNCS, vol. 12933, pp. 619–640. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-85616-8_36

    Chapter  Google Scholar 

  9. Colley, A., Raudanjoki, Ö., Mikkonen, K., Häkkilä, J.: Plant shadow morphing as a peripheral display. In: Proceedings of the 18th International Conference on Mobile and Ubiquitous Multimedia, pp. 1–5 (2019)

    Google Scholar 

  10. Döring, T., Sylvester, A., Schmidt, A.: A design space for ephemeral user interfaces. In: Proceedings of the 7th International Conference on Tangible, Embedded and Embodied Interaction, pp. 75–82 (2013)

    Google Scholar 

  11. Došilović, F.K., Brčić, M., Hlupić, N.: Explainable artificial intelligence: a survey. In: 2018 41st International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO), pp. 0210–0215. IEEE (2018)

    Google Scholar 

  12. Ehn, P., Kyng, M.: Cardboard Computers: Mocking-It-up or Hands-on the Future, pp. 169–196. L. Erlbaum Associates Inc., USA (1992)

    Google Scholar 

  13. Fogarty, J., Forlizzi, J., Hudson, S.E.: Aesthetic information collages: generating decorative displays that contain information. In: Proceedings of the 14th Annual ACM Symposium on User Interface Software and Technology, pp. 141–150 (2001)

    Google Scholar 

  14. Goswami, V., Singh, D.R.: Impact of mobile phone addiction on adolescent’s life: a literature review. Int. J. Home Sci. 2(1), 69–74 (2016)

    Google Scholar 

  15. Harjuniemi, E., Colley, A., Rytilahti, P., Li, H., Forest, J., Häkkilä, J.: Idle stripes shirt: ambient wearable display for activity tracking. In: Proceedings of the 2018 ACM International Symposium on Wearable Computers, pp. 254–259 (2018)

    Google Scholar 

  16. Heiner, J.M., Hudson, S.E., Tanaka, K.: The information percolator: ambient information display in a decorative object. In: Proceedings of the 12th annual ACM Symposium on User Interface Software and Technology, pp. 141–148 (1999)

    Google Scholar 

  17. Hendricks, L.A., Akata, Z., Rohrbach, M., Donahue, J., Schiele, B., Darrell, T.: Generating visual explanations. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9908, pp. 3–19. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46493-0_1

    Chapter  Google Scholar 

  18. Hohman, F.: Interactive Scalable Interfaces for Machine Learning Interpretability. Ph.D. thesis, Georgia Institute of Technology (2020)

    Google Scholar 

  19. Iversen, O.S., Dindler, C.: Pursuing aesthetic inquiry in participatory design. In: PDC, pp. 138–145 (2008)

    Google Scholar 

  20. Jensen, W., Löchtefeld, M., Knoche, H.: Shadowlamp: An ambient display with controllable shadow projection using electrochromic materials. In: Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems, p. LBW1510. ACM (2019)

    Google Scholar 

  21. Kao, H.L., Johns, P., Roseway, A., Czerwinski, M.: Tattio: fabrication of aesthetic and functional temporary tattoos. In: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems, pp. 3699–3702 (2016)

    Google Scholar 

  22. Kostakos, V., Ojala, T.: Public displays invade urban spaces. IEEE Perv. Comput. 12(1), 8–13 (2013)

    Article  Google Scholar 

  23. Li, H., Müller, H., Häkkilä, J.: Our little secret: design and user study on an electrochromic ambient display for supporting long-distance relationships. In: Brooks, A., Brooks, E.I. (eds.) ArtsIT/DLI -2019. LNICST, vol. 328, pp. 611–622. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-53294-9_45

    Chapter  Google Scholar 

  24. Linardatos, P., Papastefanopoulos, V., Kotsiantis, S.: Explainable AI: a review of machine learning interpretability methods. Entropy 23(1), 18 (2020)

    Article  Google Scholar 

  25. Mankoff, J., Dey, A.K., Hsieh, G., Kientz, J., Lederer, S., Ames, M.: Heuristic evaluation of ambient displays. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 169–176 (2003)

    Google Scholar 

  26. Miller, T., Howe, P., Sonenberg, L.: Explainable AI: beware of inmates running the asylum or: how i learnt to stop worrying and love the social and behavioural sciences. arXiv preprint arXiv:1712.00547 (2017)

  27. Mogensen, P., Trigg, R.: Artifacts as triggers for participatory analysis. In: Participatory Design Conference (PDC), pp. 55–62 (1992)

    Google Scholar 

  28. Muller, M., Druin, A.: Participatory design: the third space in HCI. In: Handbook of HCI (2002)

    Google Scholar 

  29. Pakanen, M., Lappalainen, T., Roinesalo, P., Häkkilä, J.: Exploring smart handbag concepts through co-design. In: Proceedings of the 15th International Conference on Mobile and Ubiquitous Multimedia, pp. 37–48 (2016)

    Google Scholar 

  30. Preece, A.: Asking ‘why’in AI: explainability of intelligent systems-perspectives and challenges. Intell. Syst. Accoun. Finan. Manag. 25(2), 63–72 (2018)

    Article  Google Scholar 

  31. Raudanjoki, Ö., Häkkilä, J.: Towards a design space for shadows as ambient displays. In: Ardito, C., Lanzilotti, R., Malizia, A., Petrie, H., Piccinno, A., Desolda, G., Inkpen, K. (eds.) INTERACT 2021. LNCS, vol. 12936, pp. 509–512. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-85607-6_68

    Chapter  Google Scholar 

  32. Raudanjoki, Ö., Häkkilä, J., Hurtig, K., Colley, A.: Perceptions of human shadow manipulation as an ambient display. In: Proceedings of the 9TH ACM International Symposium on Pervasive Displays, pp. 71–77 (2020)

    Google Scholar 

  33. Sanders, E.B.N., Stappers, P.J.: Co-creation and the new landscapes of design. Co-design 4(1), 5–18 (2008)

    Google Scholar 

  34. Weiser, M., Brown, J.S.: The coming age of calm technology. In: Beyond Calculation, pp. 75–85. Springer, Heidelberg (1997). https://doi.org/10.1007/978-1-4612-0685-9_6

  35. Wolf, C.T.: Explainability scenarios: towards scenario-based xai design. In: Proceedings of the 24th International Conference on Intelligent User Interfaces, pp. 252–257 (2019)

    Google Scholar 

Download references

Acknowledgements

This research has been supported by TechFashion project, funded by Academy of Finland, and Lapland Robotics project, funded by European Regional Development Fund.

Author information

Authors and Affiliations

  1. University of Lapland, Rovaniemi, Finland

    Özge Raudanjoki, Jonna Häkkilä & Ashley Colley

  2. University of Aarhus, Aarhus, Denmark

    Minna Pakanen

Authors
  1. Özge Raudanjoki
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jonna Häkkilä
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Minna Pakanen
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ashley Colley
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jonna Häkkilä .

Editor information

Editors and Affiliations

  1. Aalborg University, Aalborg, Denmark

    Anthony L. Brooks

Rights and permissions

Reprints and permissions

Copyright information

© 2023 ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Raudanjoki, Ö., Häkkilä, J., Pakanen, M., Colley, A. (2023). Shadow Display Design Concepts for AI Enhanced Environments. In: Brooks, A.L. (eds) ArtsIT, Interactivity and Game Creation. ArtsIT 2022. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 479. Springer, Cham. https://doi.org/10.1007/978-3-031-28993-4_26

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-28993-4_26

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-28992-7

  • Online ISBN: 978-3-031-28993-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation