skip to main content
research-article

Orbuculum - Predicting When Users Intend to Leave Large Public Displays

Published:30 March 2021Publication History
Skip Abstract Section

Abstract

We present a system, predicting the point in time when users of a public display are about to leave. The ability to react to users' intention to leave is valuable for researchers and practitioners alike: users can be presented additional content with the goal to maximize interaction times; they can be offered a discount coupon for redemption in a nearby store hence enabling new business models; or feedback can be collected from users right after they have finished interaction without interrupting their task. Our research consists of multiple steps: (1) We identified features that hint at users' intention to leave from observations and video logs. (2) We implemented a system capable of detecting such features from Microsoft Kinect's skeleton data and subsequently make a prediction. (3) We trained and deployed a prediction system with a Quiz game which reacts when users are about to leave (N=249), achieving an accuracy of 78%. The majority of users indeed reacted to the presented intervention.

Skip Supplemental Material Section

Supplemental Material

References

  1. Florian Alt, Thomas Kubitza, Dominik Bial, Firas Zaidan, Markus Ortel, Björn Zurmaar, Tim Lewen, Alireza Sahami Shirazi, and Albrecht Schmidt. 2011. Digifieds: Insights into Deploying Digital Public Notice Areas in the Wild. In Proceedings of the 10th International Conference on Mobile and Ubiquitous Multimedia (Beijing, China) (MUM '11). Association for Computing Machinery, New York, NY, USA, 165--174. https://doi.org/10.1145/2107596.2107618Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Florian Alt, Stefan Schneegass, Albrecht Schmidt, Jörg Müller, and Nemanja Memarovic. 2012. How to Evaluate Public Displays. In Proceedings of the 2012 International Symposium on Pervasive Displays (Porto, Portugal) (PerDis'12). ACM, New York, NY, USA, Article 17, 6 pages. https://doi.org/10.1145/2307798.2307815Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Florian Alt, Sarah Torma, and Daniel Buschek. 2016. Don't Disturb Me: Understanding Secondary Tasks on Public Displays. In Proceedings of the 5th ACM International Symposium on Pervasive Displays (Oulu, Finland) (PerDis '16). ACM, New York, NY, USA, 1--12. https://doi.org/10.1145/2914920.2915023Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Gilbert Beyer, Florian Alt, Jörg Müller, Albrecht Schmidt, Karsten Isakovic, Stefan Klose, Manuel Schiewe, and Ivo Haulsen. 2011. Audience Behavior Around Large Interactive Cylindrical Screens. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vancouver, BC, Canada) (CHI '11). ACM, New York, NY, USA, 1021--1030. https://doi.org/10.1145/1978942.1979095Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Harry Brignull and Yvonne Rogers. 2003. Enticing people to interact with large public displays in public spaces. In Proceedings of the IFIP TC13 International Conference on Human-Computer Interaction (INTERACT '03). Springer, Berlin-Heidelberg, 17--24.Google ScholarGoogle Scholar
  6. Luigina Ciolfi, Mikael Fernström, Liam J Bannon, Parag Deshpande, Paul Gallagher, Colm McGettrick, Nicola Quinn, and Stephen Shirley. 2007. The shannon portal installation: Interaction design for public places. Computer 7 (2007), 64--71.Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Jorgos Coenen, Niels Wouters, and Andrew Vande Moere. 2016. Synchronized Wayfinding on Multiple Consecutively Situated Public Displays. In Proceedings of the 5th ACM International Symposium on Pervasive Displays (Oulu, Finland) (PerDis '16). ACM, New York, NY, USA, 182--196. https://doi.org/10.1145/2914920.2929906Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Marco Cristani, Loris Bazzani, Giulia Paggetti, Andrea Fossati, Diego Tosato, Alessio Del Bue, Gloria Menegaz, and Vittorio Murino. 2011. Social interaction discovery by statistical analysis of F-formations.. In BMVC, Vol. 2. 4.Google ScholarGoogle Scholar
  9. Nigel Davies, Sarah Clinch, and Florian Alt. 2014. Pervasive Displays - Understanding the Future of Digital Signage. Morgan and Claypool.Google ScholarGoogle Scholar
  10. Tiare Feuchtner, Robert Walter, and Jörg Müller. 2016. Interruption and Pausing of Public Display Games. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services (Florence, Italy) (MobileHCI '16). ACM, New York, NY, USA, 306--317. https://doi.org/10.1145/2935334.2935335Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Saul Greenberg, Nicolai Marquardt, Till Ballendat, Rob Diaz-Marino, and Miaosen Wang. 2011. Proxemic Interactions: The New Ubicomp? Interactions 18, 1 (Jan. 2011), 42--50. https://doi.org/10.1145/1897239.1897250Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Bernd Huber, Joong Ho Lee, and Ji-Hyung Park. 2015. Detecting User Intention at Public Displays from Foot Positions. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI '15). ACM, New York, NY, USA, 3899--3902. https://doi.org/10.1145/2702123.2702148Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Hannu Kukka, Heidi Oja, Vassilis Kostakos, Jorge Gonçalves, and Timo Ojala. 2013. What Makes You Click: Exploring Visual Signals to Entice Interaction on Public Displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Paris, France) (CHI '13). ACM, New York, NY, USA, 1699--1708. https://doi.org/10.1145/2470654.2466225Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Paul Marshall, Yvonne Rogers, and Nadia Pantidi. 2011. Using F-formations to Analyse Spatial Patterns of Interaction in Physical Environments. In Proceedings of the ACM 2011 Conference on Computer Supported Cooperative Work (Hangzhou, China) (CSCW '11). ACM, New York, NY, USA, 445--454. https://doi.org/10.1145/1958824.1958893Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Nemanja Memarovic, Sarah Clinch, and Florian Alt. 2015. Understanding Display Blindness in Future Display Deployments. In Proceedings of the 4th International Symposium on Pervasive Displays (Saarbruecken, Germany) (PerDis '15). Association for Computing Machinery, New York, NY, USA, 7--14. https://doi.org/10.1145/2757710.2757719Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Alexander Meschtscherjakov, Wolfgang Reitberger, Michael Lankes, and Manfred Tscheligi. 2008. Enhanced Shopping: A Dynamic Map in a Retail Store. In Proceedings of the 10th International Conference on Ubiquitous Computing (Seoul, Korea) (UbiComp '08). Association for Computing Machinery, New York, NY, USA, 336--339. https://doi.org/10.1145/1409635.1409680Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Jörg Müller, Florian Alt, Daniel Michelis, and Albrecht Schmidt. 2010. Requirements and Design Space for Interactive Public Displays. In Proceedings of the International Conference on Multimedia (Firenze, Italy) (MM '10). ACM, New York, NY, USA, 1285--1294. https://doi.org/10.1145/1873951.1874203Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Jörg Müller, Robert Walter, Gilles Bailly, Michael Nischt, and Florian Alt. 2012. Looking Glass: A Field Study on Noticing Interactivity of a Shop Window. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Austin, Texas, USA) (CHI '12). Association for Computing Machinery, New York, NY, USA, 297--306. https://doi.org/10.1145/2207676.2207718Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Thorsten Prante, Carsten Röcker, Norbert Streitz, Richard Stenzel, Carsten Magerkurth, Daniel Van Alphen, and Daniela Plewe. 2003. Hello.Wall-beyond ambient displays. In Adjunct Proceedings of Ubicomp. Citeseer, 277--278.Google ScholarGoogle Scholar
  20. Fiona Redhead and Margot Brereton. 2009. Designing Interaction for Local Communications: An Urban Screen Study. In Proceedings of the 12th IFIP TC 13 International Conference on Human-Computer Interaction: Part II (Uppsala, Sweden) (INTERACT'09). Springer-Verlag, Berlin, Heidelberg, 457--460.Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Lior Rokach and Oded Maimom. 2007. Data mining with decision trees: theory and applications. https://doi.org/10.1007/978-0-387-09823-4Google ScholarGoogle Scholar
  22. Hasibullah Sahibzada, Eva Hornecker, Florian Echtler, and Patrick Tobias Fischer. 2017. Designing Interactive Advertisements for Public Displays. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI '17). Association for Computing Machinery, New York, NY, USA, 1518--1529. https://doi.org/10.1145/3025453.3025531Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Daniel J Simons and Michael S Ambinder. 2005. Change blindness: Theory and consequences. Current directions in psychological science 14, 1 (2005), 44--48.Google ScholarGoogle ScholarCross RefCross Ref
  24. Fabius Steinberger, Marcus Foth, and Florian Alt. 2014. Vote With Your Feet: Local Community Polling on Urban Screens. In Proceedings of The International Symposium on Pervasive Displays (Copenhagen, Denmark) (PerDis '14). Association for Computing Machinery, New York, NY, USA, 44--49. https://doi.org/10.1145/2611009.2611015Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Karolina Szymbor. 2015. The Interactive Touch Wall at the Copenhagen Airport in Human-Computer Interaction Perspective: Evaluation of The User Experience. Master Thesis at Aalborg University.Google ScholarGoogle Scholar
  26. Maurice Ten Koppel, Gilles Bailly, Jörg Müller, and Robert Walter. 2012. Chained Displays: Configurations of Public Displays Can Be Used to Influence Actor-, Audience-, and Passer-by Behavior. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Austin, Texas, USA) (CHI '12). ACM, New York, NY, USA, 317--326. https://doi.org/10.1145/2207676.2207720Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Nina Valkanova, Robert Walter, Andrew Vande Moere, and Jörg Müller. 2014. MyPosition: Sparking Civic Discourse by a Public Interactive Poll Visualization. In Proceedings of the 17th ACM Conference on Computer Supported Cooperative Work Social Computing (Baltimore, Maryland, USA) (CSCW '14). Association for Computing Machinery, New York, NY, USA, 1323--1332. https://doi.org/10.1145/2531602.2531639Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Daniel Vogel and Ravin Balakrishnan. 2004. Interactive Public Ambient Displays: Transitioning From Implicit to Explicit, Public to Personal, Interaction with Multiple Users. In Proceedings of the 17th annual ACM Symposium on User Interface Software and Technology (Santa Fe, NM, USA) (UIST'04). ACM, New York, NY, USA, 137--146. https://doi.org/10.1145/1029632.1029656Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Robert Walter, Gilles Bailly, and Jörg Müller. 2013. StrikeAPose: Revealing Mid-Air Gestures on Public Displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 841--850. https://doi.org/10.1145/2470654.2470774Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Niels Wouters, John Downs, Mitchell Harrop, Travis Cox, Eduardo Oliveira, Sarah Webber, Frank Vetere, and Andrew Vande Moere. 2016. Uncovering the Honeypot Effect: How Audiences Engage with Public Interactive Systems. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems (Brisbane, QLD, Australia) (DIS '16). ACM, New York, NY, USA, 5--16. https://doi.org/10.1145/2901790.2901796Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Yanxia Zhang, Jörg Müller, Ming Ki Chong, Andreas Bulling, and Hans Gellersen. 2014. GazeHorizon: Enabling Passers-by to Interact with Public Displays by Gaze. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing (Seattle, Washington) (UbiComp '14). ACM, New York, NY, USA, 559--563. https://doi.org/10.1145/2632048.2636071Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Orbuculum - Predicting When Users Intend to Leave Large Public Displays

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in

      Full Access

      • Published in

        cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
        Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies  Volume 5, Issue 1
        March 2021
        1272 pages
        EISSN:2474-9567
        DOI:10.1145/3459088
        Issue’s Table of Contents

        Copyright © 2021 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 30 March 2021
        Published in imwut Volume 5, Issue 1

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article
        • Research
        • Refereed

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader