Skip to main content
SpringerLink
Log in

User-Centered Evaluation of Different Configurations of a Touchless Gestural Interface for Interactive Displays

  • Conference paper
  • First Online:
Human-Computer Interaction – INTERACT 2023 (INTERACT 2023)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 14142))

Included in the following conference series:

  • 670 Accesses

Abstract

Approaches for improving the user experience when interacting with touchless displays have been proposed, such as using activation gestures and representing users as avatars in real-time. However, the novelty of such approaches may hinder users’ natural interaction behavior bringing challenges such as ease of use. In this paper, we investigate how the presence of avatars and their configurations, the usage of activation gestures, and the arrangement of interactive tiles in a touchless visual interface impact users’ experience, usability and task performance. We also compare users’ willingness to promote the interaction setup, perceived task difficulty, and time consumed to perform four different tasks in each configuration. We found that using a squared arrangement of elements, adopting activation gestures to trigger actions, and showing a moving avatar, resulted in the highest perceived usability and user experience, also reducing errors, task completion time, and perceived task difficulty. Our findings support the design of interactive displays to ensure high usability and user experience.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 79.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 99.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Ackad, C., Clayphan, A., Tomitsch, M., Kay, J.: An in-the-wild study of learning mid-air gestures to browse hierarchical information at a large interactive public display. In: Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing, UbiComp 2015, pp. 1227–1238. Association for Computing Machinery, New York (2015). https://doi.org/10.1145/2750858.2807532

  2. Ackad, C., Tomitsch, M., Kay, J.: Skeletons and silhouettes: comparing user representations at a gesture-based large display. In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, CHI 2016, pp. 2343–2347. Association for Computing Machinery, New York (2016). https://doi.org/10.1145/2858036.2858427

  3. Alroobaea, R., Mayhew, P.J.: How many participants are really enough for usability studies? In: 2014 Science and Information Conference, pp. 48–56. IEEE (2014). https://doi.org/10.1109/SAI.2014.6918171

  4. Alt, F., Schneegaß, S., Schmidt, A., Müller, J., Memarovic, N.: How to evaluate public displays. In: Proceedings of the 2012 International Symposium on Pervasive Displays, PerDis 2012. Association for Computing Machinery, New York (2012). https://doi.org/10.1145/2307798.2307815

  5. Alt, F., Shirazi, A.S., Kubitza, T., Schmidt, A.: Interaction techniques for creating and exchanging content with public displays. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1709–1718 (2013). https://doi.org/10.1145/2470654.2466226

  6. Brignull, H., Rogers, Y.: Enticing people to interact with large public displays in public spaces. In: INTERACT 2003-9th IFIP TC13 International Conference on Human-Computer Interaction, vol. 3, pp. 17–24 (2003)

    Google Scholar 

  7. Brooke, J., et al.: SUS-a quick and dirty usability scale. In: Usability Evaluation in Industry, vol. 189, no. 194, pp. 4–7 (1996)

    Google Scholar 

  8. Dalton, N.S., Collins, E., Marshall, P.: Display blindness? Looking again at the visibility of situated displays using eye-tracking. In: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, CHI 2015, pp. 3889–3898. Association for Computing Machinery, New York (2015). https://doi.org/10.1145/2702123.2702150

  9. Davies, N., Clinch, S., Alt, F.: Pervasive displays: understanding the future of digital signage. Synth. Lect. Mob. Pervasive Comput. 8(1), 1–128 (2014). https://doi.org/10.1007/978-3-031-02484-9

    Article  Google Scholar 

  10. Francik, E.: Five, ten, or twenty-five - how many test participants? (2015). https://www.humanfactors.com/newsletters/how_many_test_participants.asp. Accessed 09 May 2023

  11. Gentile, V., Khamis, M., Milazzo, F., Sorce, S., Malizia, A., Alt, F.: Predicting mid-air gestural interaction with public displays based on audience behaviour. Int. J. Hum.-Comput. Stud. 144, 102497 (2020). https://doi.org/10.1016/j.ijhcs.2020.102497. http://www.sciencedirect.com/science/article/pii/S1071581920300999

  12. Gentile, V., Khamis, M., Sorce, S., Alt, F.: They are looking at me! Understanding how audience presence impacts on public display users. In: Proceedings of the 6th ACM International Symposium on Pervasive Displays, pp. 1–7 (2017). https://doi.org/10.1145/3078810.3078822

  13. Gentile, V., Sorce, S., Malizia, A., Milazzo, F., Gentile, A.: Investigating how user avatar in touchless interfaces affects perceived cognitive load and two-handed interactions. In: Proceedings of the 6th ACM International Symposium on Pervasive Displays, pp. 1–7 (2017). https://doi.org/10.1145/3078810.3078831

  14. Gentile, V., Sorce, S., Malizia, A., Pirrello, D., Gentile, A.: Touchless interfaces for public displays: can we deliver interface designers from introducing artificial push button gestures? In: Proceedings of the International Working Conference on Advanced Visual Interfaces, pp. 40–43 (2016). https://doi.org/10.1145/2909132.2909282

  15. Hart, S.G.: Nasa-task load index (NASA-TLX); 20 years later. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 50, pp. 904–908. Sage Publications, Los Angeles (2006). https://doi.org/10.1177/154193120605000909

  16. Houben, S., Weichel, C.: Overcoming interaction blindness through curiosity objects. In: CHI 2013 Extended Abstracts on Human Factors in Computing Systems, CHI EA 2013, pp. 1539–1544. Association for Computing Machinery, New York (2013). https://doi.org/10.1145/2468356.2468631

  17. Ju, W., Sirkin, D.: Animate objects: how physical motion encourages public interaction. In: Ploug, T., Hasle, P., Oinas-Kukkonen, H. (eds.) PERSUASIVE 2010. LNCS, vol. 6137, pp. 40–51. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-13226-1_6

    Chapter  Google Scholar 

  18. Khamis, M., Becker, C., Bulling, A., Alt, F.: Which one is me? Identifying oneself on public displays. In: Proceedings of the 36th Annual ACM Conference on Human Factors in Computing Systems, CHI 2018. ACM, New York (2018). https://doi.org/10.1145/3152832.3157813

  19. Khamis, M., Bulling, A., Alt, F.: Tackling challenges of interactive public displays using gaze. In: Adjunct Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM (2015). https://doi.org/10.1145/2800835.2807951

  20. Khamis, M., Klimczak, A., Reiss, M., Alt, F., Bulling, A.: Eyescout: active eye tracking for position and movement independent gaze interaction with large public displays. In: Proceedings of the 30th Annual ACM Symposium on User Interface Software & Technology, UIST 2017. ACM, New York (2017). https://doi.org/10.1145/3126594.3126630

  21. Khamis, M., et al.: Cueauth: comparing touch, mid-air gestures, and gaze for cue-based authentication on situated displays. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 2(4) (2018). https://doi.org/10.1145/3287052

  22. Laugwitz, B., Held, T., Schrepp, M.: Construction and evaluation of a user experience questionnaire. In: Holzinger, A. (ed.) USAB 2008. LNCS, vol. 5298, pp. 63–76. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-89350-9_6

    Chapter  Google Scholar 

  23. Mäkelä, V., Khamis, M., Mecke, L., James, J., Turunen, M., Alt, F.: Pocket transfers: interaction techniques for transferring content from situated displays to mobile devices. In: Proceedings of the 36th Annual ACM Conference on Human Factors in Computing Systems, CHI 2018. ACM, New York (2018). https://doi.org/10.1145/3173574.3173709

  24. Mäkelä, V., et al.: Virtual field studies: conducting studies on public displays in virtual reality. In: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, CHI 2020, pp. 1–15. Association for Computing Machinery, New York (2020). https://doi.org/10.1145/3313831.3376796

  25. Memarovic, N., Clinch, S., Alt, F.: Understanding display blindness in future display deployments. In: Proceedings of the 4th International Symposium on Pervasive Displays, PerDis 2015, pp. 7–14. Association for Computing Machinery, New York (2015). https://doi.org/10.1145/2757710.2757719

  26. Microsoft: Microsoft human interface guidelines (2014). https://download.microsoft.com/download/6/7/6/676611b4-1982-47a4-a42e-4cf84e1095a8/kinecthig.2.0.pdf. Accessed 31 Jan 2023

  27. Müller, J., Alt, F., Michelis, D., Schmidt, A.: Requirements and design space for interactive public displays. In: Proceedings of the 18th ACM International Conference on Multimedia, MM 2010, pp. 1285–1294. Association for Computing Machinery, New York (2010). https://doi.org/10.1145/1873951.1874203

  28. Müller, J., Bailly, G., Bossuyt, T., Hillgren, N.: Mirrortouch: combining touch and mid-air gestures for public displays. In: Proceedings of the 16th International Conference on Human-Computer Interaction with Mobile Devices & Services, pp. 319–328 (2014). https://doi.org/10.1145/2628363.2628379

  29. Müller, J., Walter, R., Bailly, G., Nischt, M., Alt, F.: Looking glass: a field study on noticing interactivity of a shop window. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 297–306 (2012). https://doi.org/10.1145/2207676.2207718

  30. Müller, J., et al.: Display blindness: the effect of expectations on attention towards digital signage. In: Tokuda, H., Beigl, M., Friday, A., Brush, A.J.B., Tobe, Y. (eds.) Pervasive 2009. LNCS, vol. 5538, pp. 1–8. Springer, Heidelberg (2009). https://doi.org/10.1007/978-3-642-01516-8_1

    Chapter  Google Scholar 

  31. Ng, P.C., She, J., Jeon, K.E., Baldauf, M.: When smart devices interact with pervasive screens: a survey. ACM Trans. Multimedia Comput. Commun. Appl. 13(4), 1–23 (2017). https://doi.org/10.1145/3115933

    Article  Google Scholar 

  32. Nielsen, J., Landauer, T.K.: A mathematical model of the finding of usability problems. In: Proceedings of the INTERACT 1993 and CHI 1993 Conference on Human Factors in Computing Systems, pp. 206–213 (1993). https://doi.org/10.1145/169059.169166

  33. Sauro, J.: If you could only ask one question, use this one (2010). https://measuringu.com/single-question/. Accessed 31 Jan 2023

  34. Vom Lehn, D., Heath, C.: Displacing the object: mobile technologies and interpretive resources. Arch. Museum Inform. 2 (2003)

    Google Scholar 

  35. Walter, R., Bailly, G., Müller, J.: Strikeapose: revealing mid-air gestures on public displays. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 841–850 (2013). https://doi.org/10.1145/2470654.2470774

  36. Walter, R., Bailly, G., Valkanova, N., Müller, J.: Cuenesics: using mid-air gestures to select items on interactive public displays. In: Proceedings of the 16th International Conference on Human-Computer Interaction with Mobile Devices & Services, pp. 299–308 (2014). https://doi.org/10.1145/2628363.2628368

  37. Wikipedia, The Free Encyclopedia: Net promoter score (2022). https://en.wikipedia.org/wiki/Net_promoter_score. Accessed 08 Jan 2023

  38. Yoo, S., Parker, C., Kay, J., Tomitsch, M.: To dwell or not to dwell: an evaluation of mid-air gestures for large information displays. In: Proceedings of the Annual Meeting of the Australian Special Interest Group for Computer Human Interaction, OzCHI 2015, pp. 187–191. Association for Computing Machinery, New York (2015). https://doi.org/10.1145/2838739.2838819

Download references

Acknowledgements

This work was partly supported by the EPSRC (EP/V008870/1), and the PETRAS National Centre of Excellence for IoT Systems Cybersecurity, which is also funded by the EPSRC (EP/S035362/1).

Author information

Authors and Affiliations

  1. synbrAIn srl, Milano, Italy

    Vito Gentile

  2. University of Glasgow, Glasgow, UK

    Habiba Farzand & Mohamed Khamis

  3. Università degli Studi di Palermo, Palermo, Italy

    Simona Bonaccorso & Davide Rocchesso

  4. Università degli Studi di Pisa, Pisa, Italy

    Alessio Malizia

  5. Università degli Studi di Enna “Kore”, Enna, Italy

    Salvatore Sorce

Authors
  1. Vito Gentile
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Habiba Farzand
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Simona Bonaccorso
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Davide Rocchesso
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Alessio Malizia
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Mohamed Khamis
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Salvatore Sorce
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Salvatore Sorce .

Editor information

Editors and Affiliations

  1. University of West London, London, UK

    José Abdelnour Nocera

  2. Reykjavik University, Reykjavik, Iceland

    Marta Kristín Lárusdóttir

  3. University of York, York, UK

    Helen Petrie

  4. University of Bari Aldo Moro, Bari, Italy

    Antonio Piccinno

  5. Université Côte d’Azur, Sophia Antipolis Cedex, France

    Marco Winckler

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Gentile, V. et al. (2023). User-Centered Evaluation of Different Configurations of a Touchless Gestural Interface for Interactive Displays. In: Abdelnour Nocera, J., Kristín Lárusdóttir, M., Petrie, H., Piccinno, A., Winckler, M. (eds) Human-Computer Interaction – INTERACT 2023. INTERACT 2023. Lecture Notes in Computer Science, vol 14142. Springer, Cham. https://doi.org/10.1007/978-3-031-42280-5_32

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-42280-5_32

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-42279-9

  • Online ISBN: 978-3-031-42280-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Societies and partnerships

Search

Navigation