Spyros Vosinakis
ABSTRACT
Touchscreens are a widely used medium for interacting with digital applications in public and they are found in various contexts including entertainment, culture, travel, marketing, etc. However, in the current times of COVID-19 pandemic there are safety concerns about the use of these devices, as touching a common surface may increase the risk of transmission. Thus, there is a need for alternative means for interacting with public interactive kiosks in a usable and effective way. In this paper we propose and evaluate a universal solution to safer interactions with public touchscreens using the smartphone as a touchpad controller. Users have to scan a QR code, and then use their device as a controller to interact with the public system though touch and multi-touch interactions (tap, drag and two-finger gestures). We have setup a user study, where we compare the usability and user experience of smartphone control to the traditional touchscreen input and we examine the users’ intention and opinion about the proposed approach. Our study indicates that the use of the mobile device as a controller has the potential to be a safe and practical alternative to direct touch input for public interactive kiosks, and reveals some usability issues that need further consideration.
- Eva Hornecker and Luigina Ciolfi. 2019. Human-Computer Interactions in Museums. Synthesis Lectures on Human-Centered Informatics 12, i–153. https://doi.org/10.2200/s00901ed1v01y201902hci042 Google Scholar
Digital Library
- Healthline. Want to Avoid Dangerous Bacteria? Don't Use Public Touch Screens; 2018. Available from: https://www.healthline.com/health-news/ want-to-avoid-dangerous-bacteria-dont-use-touch-screensGoogle Scholar
- Alexandra Zbuchea. 2020. Museums in Times of the COVID-19 Pandemic. Focus on Romania and Italy. STRATEGICA, 680.Google Scholar
- Carmelo Ardito, Paolo Buono, Maria Francesca Costabile, and Giuseppe Desolda. 2015. Interaction with Large Displays. ACM Computing Surveys 47, 3: 1–38. https://doi.org/10.1145/2682623 Google ScholarDigital Library
- Robert Walter, Gilles Bailly, Nina Valkanova, and Jörg Müller. 2014. Cuenesics: using mid-air gestures to select items on interactive public displays. In Proceedings of the 16th international conference on Human-computer interaction with mobile devices & services, 299–308. https://doi.org/10.1145/2628363.2628368 Google ScholarDigital Library
- Harry Brignull and Yvonne Rogers. 2003. Enticing People to Interact with Large Public Displays in Public Spaces. In Proceedings of INTERACT, 17–24.Google Scholar
- Jeffrey T. Hansberger, Chao Peng, Shannon L. Mathis, Vaidyanath Areyur Shanthakumar, Sarah C. Meacham, Lizhou Cao, and Victoria R. Blakely. 2017. Dispelling the gorilla arm syndrome: The viability of prolonged gesture interactions. In Proceedings of the International Conference on Virtual, Augmented and Mixed Reality, 505-520. Springer, Cham. https://doi.org/10.1007/978-3-319-57987-0_41Google Scholar
- Mikkel Jakobsen, Yvonne Jansen, Sebastian Boring, and Kasper Hornbaek. 2015. Should I stay or should I go? Selecting between touch and mid-air gestures for large-display interaction. In Proceedings of IFIP Conference on Human-Computer Interaction, 455-473. Springer, Cham. Google ScholarDigital Library
- Ismo Rakkolainen, Antti Sand, and Roope Raisamo. 2019. A Survey of Mid-Air Ultrasonic Tactile Feedback. In Proceedings - 2019 IEEE International Symposium on Multimedia, ISM 2019: 94–98. https://doi.org/10.1109/ISM46123.2019.00022Google ScholarCross Ref
- Pai Chet Ng, James She, Kang Eun Jeon, and Matthias Baldauf. 2017. When Smart Devices Interact With Pervasive Screens: A Survey. ACM Transactions on Multimedia Computing, Communications and Applications 13, 4: 1–23. https://doi.org/10.1145/3115933 Google ScholarDigital Library
- Franca Rupprecht, Carol Naranjo, Achim Ebert, Joseph Olakumni, and Bernd Hamann. 2019. When Bigger is Simply Better After all: Natural and Multi-Modal Interaction with Large Displays Using a Smartwatch. In Proceedings of the Twelfth International Conference on Advances in Computer-Human Interactions Comparison (ACHI 2019), 57–65.Google Scholar
- Sebastian Boring and Dominikus Baur. 2013. Making Public Displays Interactive Everywhere. IEEE Computer Graphics & Applications 33, 2: 28–36. Google ScholarDigital Library
- Tilman Dingler, Tobias Bagg, Yves Grau, Niels Henze, and Albrecht Schmidt. 2015. uCanvas: A Web Framework for Spontaneous Smartphone Interaction with Ubiquitous Displays. In Proceedings of the IFIP Conference on Human-Computer Interaction, 402-409. Springer, Cham. https://doi.org/10.1007/978-3-319-22698-9 Google ScholarDigital Library
- Matthias Baldauf, Florence Adegeye, Florian Alt, and Johannes Harms. Your Browser is the Controller - Advanced Web-Based Smartphone Remote Controls for Public Screens. In Proceedings of the 5th ACM International Symposium on Pervasive Displays, 175–181. Google ScholarDigital Library
- Gyanendra Sharma and Richard J. Radke. 2019. Multi-person Spatial Interaction in a Large Immersive Display Using Smartphones as Touchpads. In Proceedings of SAI Intelligent Systems Conference, 285-302. Springer, Cham.Google Scholar
- Matthias Baldauf, Peter Fröhlich, Jasmin Buchta, and Theresa Stürmer. 2013. From touchpad to smart lens: A comparative study on smartphone interaction with public displays. International Journal of Mobile Human Computer Interaction 5, 2: 1–20. https://doi.org/10.4018/jmhci.2013040101Google ScholarCross Ref
- Priscilla Jimenez and Leilah Lyons. 2011. An Exploratory Study of Input Modalities for Mobile Devices Used with Museum Exhibits. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 895–904. Google ScholarDigital Library
- Shaishav Siddhpuria, Sylvain Malacria, Mathieu Nancel, and Edward Lank. 2018. Pointing at a distance with everyday smart devices. In Proceedings of Conference on Human Factors in Computing Systems 2018, 1–11. https://doi.org/10.1145/3173574.3173747 Google ScholarDigital Library
- John Brooke. 2020. SUS: A “Quick and Dirty” Usability Scale. Usability Evaluation In Industry: 207–212. https://doi.org/10.1201/9781498710411-35Google Scholar
- Marc Hassenzahl, Michael Burmester, and Franz Koller. 2003. AttrakDiff: Ein Fragebogen zur Messung wahrgenommener hedonischer und pragmatischer Qualität. Mensch & computer: 187–196. https://doi.org/10.1007/978-3-322-80058-9_19Google Scholar
- Elena Not, Massimo Zancanaro, Mark T. Marshall, Daniela Petrelli, and Anna Pisetti. 2017. Writing postcards from the museum: Composing personalised tangible souvenirs. In Proceedings of the 12th Biannual Conference on Italian SIGCHI Chapter, 1-9. https://doi.org/10.1145/3125571.3125583 Google ScholarDigital Library
Index Terms
- Touch Your Own Device! A COVID-Safe Alternative to Multi-touch Interactions with Public Touchscreens
Recommendations
Direct and indirect multi-touch interaction on a wall display
IHM '14: Proceedings of the 26th Conference on l'Interaction Homme-MachineMulti-touch wall displays allow to take advantage of co-located interaction (direct interaction) on very large surfaces. However interacting with content beyond arms' reach requires body movements, introducing fatigue and impacting performance. ...
Design and evaluation of interaction models for multi-touch mice
GI '10: Proceedings of Graphics Interface 2010Adding multi-touch sensing to the surface of a mouse has the potential to substantially increase the number of interactions available to the user. However, harnessing this increased bandwidth is challenging, since the user must perform multi-touch ...
Comparing Tangible and Multi-touch Interaction for Interactive Data Visualization Tasks
TEI '16: Proceedings of the TEI '16: Tenth International Conference on Tangible, Embedded, and Embodied InteractionInteractive visualization plays a key role in the analysis of large datasets. It can help users to explore data, investigate hypotheses and find patterns. The easier and more tangible the interaction, the more likely it is to enhance understanding. This ...
Comments