Abstract
We present a system, predicting the point in time when users of a public display are about to leave. The ability to react to users' intention to leave is valuable for researchers and practitioners alike: users can be presented additional content with the goal to maximize interaction times; they can be offered a discount coupon for redemption in a nearby store hence enabling new business models; or feedback can be collected from users right after they have finished interaction without interrupting their task. Our research consists of multiple steps: (1) We identified features that hint at users' intention to leave from observations and video logs. (2) We implemented a system capable of detecting such features from Microsoft Kinect's skeleton data and subsequently make a prediction. (3) We trained and deployed a prediction system with a Quiz game which reacts when users are about to leave (N=249), achieving an accuracy of 78%. The majority of users indeed reacted to the presented intervention.
Supplemental Material
Available for Download
Supplemental movie, appendix, image and software files for, Orbuculum - Predicting When Users Intend to Leave Large Public Displays
- Florian Alt, Thomas Kubitza, Dominik Bial, Firas Zaidan, Markus Ortel, Björn Zurmaar, Tim Lewen, Alireza Sahami Shirazi, and Albrecht Schmidt. 2011. Digifieds: Insights into Deploying Digital Public Notice Areas in the Wild. In Proceedings of the 10th International Conference on Mobile and Ubiquitous Multimedia (Beijing, China) (MUM '11). Association for Computing Machinery, New York, NY, USA, 165--174. https://doi.org/10.1145/2107596.2107618Google ScholarDigital Library
- Florian Alt, Stefan Schneegass, Albrecht Schmidt, Jörg Müller, and Nemanja Memarovic. 2012. How to Evaluate Public Displays. In Proceedings of the 2012 International Symposium on Pervasive Displays (Porto, Portugal) (PerDis'12). ACM, New York, NY, USA, Article 17, 6 pages. https://doi.org/10.1145/2307798.2307815Google ScholarDigital Library
- Florian Alt, Sarah Torma, and Daniel Buschek. 2016. Don't Disturb Me: Understanding Secondary Tasks on Public Displays. In Proceedings of the 5th ACM International Symposium on Pervasive Displays (Oulu, Finland) (PerDis '16). ACM, New York, NY, USA, 1--12. https://doi.org/10.1145/2914920.2915023Google ScholarDigital Library
- Gilbert Beyer, Florian Alt, Jörg Müller, Albrecht Schmidt, Karsten Isakovic, Stefan Klose, Manuel Schiewe, and Ivo Haulsen. 2011. Audience Behavior Around Large Interactive Cylindrical Screens. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vancouver, BC, Canada) (CHI '11). ACM, New York, NY, USA, 1021--1030. https://doi.org/10.1145/1978942.1979095Google ScholarDigital Library
- Harry Brignull and Yvonne Rogers. 2003. Enticing people to interact with large public displays in public spaces. In Proceedings of the IFIP TC13 International Conference on Human-Computer Interaction (INTERACT '03). Springer, Berlin-Heidelberg, 17--24.Google Scholar
- Luigina Ciolfi, Mikael Fernström, Liam J Bannon, Parag Deshpande, Paul Gallagher, Colm McGettrick, Nicola Quinn, and Stephen Shirley. 2007. The shannon portal installation: Interaction design for public places. Computer 7 (2007), 64--71.Google ScholarDigital Library
- Jorgos Coenen, Niels Wouters, and Andrew Vande Moere. 2016. Synchronized Wayfinding on Multiple Consecutively Situated Public Displays. In Proceedings of the 5th ACM International Symposium on Pervasive Displays (Oulu, Finland) (PerDis '16). ACM, New York, NY, USA, 182--196. https://doi.org/10.1145/2914920.2929906Google ScholarDigital Library
- Marco Cristani, Loris Bazzani, Giulia Paggetti, Andrea Fossati, Diego Tosato, Alessio Del Bue, Gloria Menegaz, and Vittorio Murino. 2011. Social interaction discovery by statistical analysis of F-formations.. In BMVC, Vol. 2. 4.Google Scholar
- Nigel Davies, Sarah Clinch, and Florian Alt. 2014. Pervasive Displays - Understanding the Future of Digital Signage. Morgan and Claypool.Google Scholar
- Tiare Feuchtner, Robert Walter, and Jörg Müller. 2016. Interruption and Pausing of Public Display Games. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services (Florence, Italy) (MobileHCI '16). ACM, New York, NY, USA, 306--317. https://doi.org/10.1145/2935334.2935335Google ScholarDigital Library
- Saul Greenberg, Nicolai Marquardt, Till Ballendat, Rob Diaz-Marino, and Miaosen Wang. 2011. Proxemic Interactions: The New Ubicomp? Interactions 18, 1 (Jan. 2011), 42--50. https://doi.org/10.1145/1897239.1897250Google ScholarDigital Library
- Bernd Huber, Joong Ho Lee, and Ji-Hyung Park. 2015. Detecting User Intention at Public Displays from Foot Positions. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI '15). ACM, New York, NY, USA, 3899--3902. https://doi.org/10.1145/2702123.2702148Google ScholarDigital Library
- Hannu Kukka, Heidi Oja, Vassilis Kostakos, Jorge Gonçalves, and Timo Ojala. 2013. What Makes You Click: Exploring Visual Signals to Entice Interaction on Public Displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Paris, France) (CHI '13). ACM, New York, NY, USA, 1699--1708. https://doi.org/10.1145/2470654.2466225Google ScholarDigital Library
- Paul Marshall, Yvonne Rogers, and Nadia Pantidi. 2011. Using F-formations to Analyse Spatial Patterns of Interaction in Physical Environments. In Proceedings of the ACM 2011 Conference on Computer Supported Cooperative Work (Hangzhou, China) (CSCW '11). ACM, New York, NY, USA, 445--454. https://doi.org/10.1145/1958824.1958893Google ScholarDigital Library
- Nemanja Memarovic, Sarah Clinch, and Florian Alt. 2015. Understanding Display Blindness in Future Display Deployments. In Proceedings of the 4th International Symposium on Pervasive Displays (Saarbruecken, Germany) (PerDis '15). Association for Computing Machinery, New York, NY, USA, 7--14. https://doi.org/10.1145/2757710.2757719Google ScholarDigital Library
- Alexander Meschtscherjakov, Wolfgang Reitberger, Michael Lankes, and Manfred Tscheligi. 2008. Enhanced Shopping: A Dynamic Map in a Retail Store. In Proceedings of the 10th International Conference on Ubiquitous Computing (Seoul, Korea) (UbiComp '08). Association for Computing Machinery, New York, NY, USA, 336--339. https://doi.org/10.1145/1409635.1409680Google ScholarDigital Library
- Jörg Müller, Florian Alt, Daniel Michelis, and Albrecht Schmidt. 2010. Requirements and Design Space for Interactive Public Displays. In Proceedings of the International Conference on Multimedia (Firenze, Italy) (MM '10). ACM, New York, NY, USA, 1285--1294. https://doi.org/10.1145/1873951.1874203Google ScholarDigital Library
- Jörg Müller, Robert Walter, Gilles Bailly, Michael Nischt, and Florian Alt. 2012. Looking Glass: A Field Study on Noticing Interactivity of a Shop Window. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Austin, Texas, USA) (CHI '12). Association for Computing Machinery, New York, NY, USA, 297--306. https://doi.org/10.1145/2207676.2207718Google ScholarDigital Library
- Thorsten Prante, Carsten Röcker, Norbert Streitz, Richard Stenzel, Carsten Magerkurth, Daniel Van Alphen, and Daniela Plewe. 2003. Hello.Wall-beyond ambient displays. In Adjunct Proceedings of Ubicomp. Citeseer, 277--278.Google Scholar
- Fiona Redhead and Margot Brereton. 2009. Designing Interaction for Local Communications: An Urban Screen Study. In Proceedings of the 12th IFIP TC 13 International Conference on Human-Computer Interaction: Part II (Uppsala, Sweden) (INTERACT'09). Springer-Verlag, Berlin, Heidelberg, 457--460.Google ScholarDigital Library
- Lior Rokach and Oded Maimom. 2007. Data mining with decision trees: theory and applications. https://doi.org/10.1007/978-0-387-09823-4Google Scholar
- Hasibullah Sahibzada, Eva Hornecker, Florian Echtler, and Patrick Tobias Fischer. 2017. Designing Interactive Advertisements for Public Displays. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI '17). Association for Computing Machinery, New York, NY, USA, 1518--1529. https://doi.org/10.1145/3025453.3025531Google ScholarDigital Library
- Daniel J Simons and Michael S Ambinder. 2005. Change blindness: Theory and consequences. Current directions in psychological science 14, 1 (2005), 44--48.Google ScholarCross Ref
- Fabius Steinberger, Marcus Foth, and Florian Alt. 2014. Vote With Your Feet: Local Community Polling on Urban Screens. In Proceedings of The International Symposium on Pervasive Displays (Copenhagen, Denmark) (PerDis '14). Association for Computing Machinery, New York, NY, USA, 44--49. https://doi.org/10.1145/2611009.2611015Google ScholarDigital Library
- Karolina Szymbor. 2015. The Interactive Touch Wall at the Copenhagen Airport in Human-Computer Interaction Perspective: Evaluation of The User Experience. Master Thesis at Aalborg University.Google Scholar
- Maurice Ten Koppel, Gilles Bailly, Jörg Müller, and Robert Walter. 2012. Chained Displays: Configurations of Public Displays Can Be Used to Influence Actor-, Audience-, and Passer-by Behavior. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Austin, Texas, USA) (CHI '12). ACM, New York, NY, USA, 317--326. https://doi.org/10.1145/2207676.2207720Google ScholarDigital Library
- Nina Valkanova, Robert Walter, Andrew Vande Moere, and Jörg Müller. 2014. MyPosition: Sparking Civic Discourse by a Public Interactive Poll Visualization. In Proceedings of the 17th ACM Conference on Computer Supported Cooperative Work Social Computing (Baltimore, Maryland, USA) (CSCW '14). Association for Computing Machinery, New York, NY, USA, 1323--1332. https://doi.org/10.1145/2531602.2531639Google ScholarDigital Library
- Daniel Vogel and Ravin Balakrishnan. 2004. Interactive Public Ambient Displays: Transitioning From Implicit to Explicit, Public to Personal, Interaction with Multiple Users. In Proceedings of the 17th annual ACM Symposium on User Interface Software and Technology (Santa Fe, NM, USA) (UIST'04). ACM, New York, NY, USA, 137--146. https://doi.org/10.1145/1029632.1029656Google ScholarDigital Library
- Robert Walter, Gilles Bailly, and Jörg Müller. 2013. StrikeAPose: Revealing Mid-Air Gestures on Public Displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 841--850. https://doi.org/10.1145/2470654.2470774Google ScholarDigital Library
- Niels Wouters, John Downs, Mitchell Harrop, Travis Cox, Eduardo Oliveira, Sarah Webber, Frank Vetere, and Andrew Vande Moere. 2016. Uncovering the Honeypot Effect: How Audiences Engage with Public Interactive Systems. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems (Brisbane, QLD, Australia) (DIS '16). ACM, New York, NY, USA, 5--16. https://doi.org/10.1145/2901790.2901796Google ScholarDigital Library
- Yanxia Zhang, Jörg Müller, Ming Ki Chong, Andreas Bulling, and Hans Gellersen. 2014. GazeHorizon: Enabling Passers-by to Interact with Public Displays by Gaze. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing (Seattle, Washington) (UbiComp '14). ACM, New York, NY, USA, 559--563. https://doi.org/10.1145/2632048.2636071Google ScholarDigital Library
Index Terms
- Orbuculum - Predicting When Users Intend to Leave Large Public Displays
Recommendations
The Role of Tangible Interaction in Exploring Information on Public Visualization Displays
PerDis '15: Proceedings of the 4th International Symposium on Pervasive DisplaysA rising number of public displays are becoming equipped with tangible interfaces. Especially in the context of the visualization of data in the public realm, offering tangible interaction modalities might actively attract and engage passer-bys, and ...
Public displays for public participation in urban settings: a survey
PerDis '17: Proceedings of the 6th ACM International Symposium on Pervasive DisplaysPublic displays can be used to support public participation in urban settings. This article provides a survey of the use of public displays for public participation in an urban context, covering articles on this topic published between 2012 and 2016. 36 ...
Adding an interactive display to a public basketball hoop can motivate players and foster community
UbiComp '13: Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computingInteractive displays that aim to engage people through play have been successfully deployed in urban environments. However, there has been little work bringing interactive displays into existing public game spaces like outdoor basketball courts. To ...
Comments