Julian Petford
Iain Carson
Miguel A. Nacenta
Carl Gutwin
ABSTRACT
Full-coverage displays can place visual content anywhere on the interior surfaces of a room (e.g., a weather display near the coat stand). In these settings, digital artefacts can be located behind the user and out of their field of view - meaning that it can be difficult to notify the user when these artefacts need attention. Although much research has been carried out on notification, little is known about how best to direct people to the necessary location in room environments. We designed five diverse attention-guiding techniques for full-coverage display rooms, and evaluated them in a study where participants completed search tasks guided by the different techniques. Our study provides new results about notification in full-coverage displays: we showed benefits of persistent visualisations that could be followed all the way to the target and that indicate distance-to-target. Our findings provide useful information for improving the usability of interactive full-coverage environments.
Supplemental Material
- Petra Ahde and Jussi Mikkonen. 2008. Hello: Bracelets Communicating Nearby Presence of Friends. In Proceedings of the Tenth Anniversary Conference on Participatory Design 2008 (PDC '08). Indiana University, IN, USA, 324--325. http://dl.acm.org/citation.cfm?id=1795234.1795326 Google Scholar
Digital Library
- Mark Altosaar, Roel Vertegaal, Changuk Sohn, and Daniel Cheng. 2006. AuraOrb: Social Notification Appliance. In CHI '06 Extended Abstracts on Human Factors in Computing Systems (CHI EA '06). ACM, New York, NY, USA, 381--386. Google ScholarDigital Library
- Mark Altosaar, Roel Vertegaal, Changuk Sohn, and Daniel Cheng. 2006. AuraOrb: Using Social Awareness Cues in the Design of Progressive Notification Appliances. In Proceedings of the 18th Australia Conference on Computer-Human Interaction: Design: Activities, Artefacts and Environments (OZCHI '06). ACM, New York, NY, USA, 159--166. Google ScholarDigital Library
- Richard Bates, M. Donegan, H. O. Istance, J. P. Hansen, and K.-J. Räihä. 2007. Introducing COGAIN: communication by gaze interaction. Universal Access in the Information Society 6, 2 (01 Sep 2007), 159--166. Google ScholarDigital Library
- Patrick Baudisch and Ruth Rosenholtz. 2003. Halo: A Technique for Visualizing Off-screen Objects. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '03). ACM, New York, NY, USA, 481--488. Google ScholarDigital Library
- Stefano Burigat and Luca Chittaro. 2007. Navigation in 3D Virtual Environments: Effects of User Experience and Location-pointing Navigation Aids. Int. J. Hum.-Comput. Stud. 65, 11 (Nov. 2007), 945--958. Google ScholarDigital Library
- Andreas Butz, Michael Schneider, and Mira Spassova. 2004. SearchLight -- A Lightweight Search Function for Pervasive Environments. In Pervasive Computing, Alois Ferscha and Friedemann Mattern (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 351--356.Google Scholar
- Christopher S. Campbell and Peter Tarasewich. 2004. Designing Visual Notification Cues for Mobile Devices. In CHI '04 Extended Abstracts on Human Factors in Computing Systems (CHI EA '04). ACM, New York, NY, USA, 1199--1202. Google ScholarDigital Library
- Marta G. Carcedo, Soon Hau Chua, Simon Perrault, Pawel Wozniak, Raj Joshi, Mohammad Obaid, Morten Fjeld, and Shengdong Zhao. 2016. HaptiColor: Interpolating Color Information As Haptic Feedback to Assist the Colorblind. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 3572--3583. Google ScholarDigital Library
- Angela Chang, Ben Resner, Brad Koerner, XingChen Wang, and Hiroshi Ishii. 2001. LumiTouch: An Emotional Communication Device. In CHI '01 Extended Abstracts on Human Factors in Computing Systems (CHI EA '01). ACM, New York, NY, USA, 313--314. Google ScholarDigital Library
- Luca Chittaro and Stefano Burigat. 2004. 3D Location-pointing As a Navigation Aid in Virtual Environments. In Proceedings of the Working Conference on Advanced Visual Interfaces (AVI '04). ACM, New York, NY, USA, 267--274. Google ScholarDigital Library
- Carolina Cruz-Neira, Daniel J. Sandin, Thomas A. DeFanti, Robert V. Kenyon, and John C. Hart. 1992. The CAVE: Audio Visual Experience Automatic Virtual Environment. Commun. ACM 35, 6 (June 1992), 64--72. Google ScholarDigital Library
- Andreas Rene Fender, Hrvoje Benko, and Andy Wilson. 2017. MeetAlive: Room-Scale Omni-Directional Display System for Multi-User Content and Control Sharing. In Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces (ISS '17). ACM, New York, NY, USA, 106--115. Google ScholarDigital Library
- Jutta Fortmann, Vanessa Cobus, Wilko Heuten, and Susanne Boll. 2014. WaterJewel: Be Aware of Your Daily Servings of Water with an LED illuminated Bracelet. In Proceedings of the 8th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth '14). ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering), ICST, Brussels, Belgium, Belgium, 195--196. Google ScholarDigital Library
- Jutta Fortmann, Heiko Müller, Susanne Boll, and Wilko Heuten. 2013. Illumee: Aesthetic Light Bracelet As a Wearable Information Display for Everyday Life. In Proceedings of the 2013 ACM Conference on Pervasive and Ubiquitous Computing Adjunct Publication (UbiComp '13 Adjunct). ACM, New York, NY, USA, 393--396. Google ScholarDigital Library
- Jutta Fortmann, Heiko Müller, Wilko Heuten, and Susanne Boll. 2014. How to Present Information on Wrist-worn Point-light Displays. In Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational (NordiCHI '14). ACM, New York, NY, USA, 955--958. Google ScholarDigital Library
- Hind Gacem, Gilles Bailly, James Eagan, and Eric Lecolinet. 2015. Finding Objects Faster in Dense Environments Using a Projection Augmented Robotic Arm. In Human-Computer Interaction -- INTERACT 2015, Julio Abascal, Simone Barbosa, Mirko Fetter, Tom Gross, Philippe Palanque, and Marco Winckler (Eds.). Springer International Publishing, Cham, 221--238. Google ScholarDigital Library
- Richard Langton Gregory, John Zachary Young, and Hugh Christopher Longuet-Higgins. 1968. Perceptual illusions and brain models. Proceedings of the Royal Society of London B: Biological Sciences 171, 1024, 279--296.Google Scholar
- Uwe Gruenefeld, Abdallah El Ali, Wilko Heuten, and Susanne Boll. 2017. Visualizing Out-of-view Objects in Head-mounted Augmented Reality. In Proceedings of the 19th International Conference on HumanComputer Interaction with Mobile Devices and Services (MobileHCI '17). ACM, New York, NY, USA, Article 81, 7 pages. Google ScholarDigital Library
- Uwe Gruenefeld, Dag Ennenga, Abdallah El Ali, Wilko Heuten, and Susanne Boll. 2017. EyeSee360: Designing a Visualization Technique for Out-of-view Objects in Head-mounted Augmented Reality. In Proceedings of the 5th Symposium on Spatial User Interaction (SUI '17). ACM, New York, NY, USA, 109--118. Google ScholarDigital Library
- Sean Gustafson, Patrick Baudisch, Carl Gutwin, and Pourang Irani. 2008. Wedge: Clutter-free Visualization of Off-screen Locations. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '08). ACM, New York, NY, USA, 787--796. Google ScholarDigital Library
- Sean G. Gustafson and Pourang P. Irani. 2007. Comparing Visualizations for Tracking Off-screen Moving Targets. In CHI '07 Extended Abstracts on Human Factors in Computing Systems (CHI EA '07). ACM, New York, NY, USA, 2399--2404. Google ScholarDigital Library
- Carl Gutwin, Andy Cockburn, and Ashley Coveney. 2017. Peripheral Popout: The Influence of Visual Angle and Stimulus Intensity on Popout Effects. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 208--219. Google ScholarDigital Library
- Mark Hancock, Miguel Nacenta, Carl Gutwin, and Sheelagh Carpendale. 2009. The Effects of Changing Projection Geometry on the Interpretation of 3D Orientation on Tabletops. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS '09). ACM, New York, NY, USA, 157--164. Google ScholarDigital Library
- Rebecca Hansson and Peter Ljungstrand. 2000. The Reminder Bracelet: Subtle Notification Cues for Mobile Devices. In CHI '00 Extended Abstracts on Human Factors in Computing Systems (CHI EA '00). ACM, New York, NY, USA, 323--324. Google ScholarDigital Library
- Hyungeun Jo, Sungjae Hwang, Hyunwoo Park, and Jung-hee Ryu. 2011. Mobile Augmented Reality: Aroundplot: Focus+Context Interface for Off-screen Objects in 3D Environments. Comput. Graph. 35, 4 (Aug. 2011), 841--853. Google ScholarDigital Library
- Brad Johanson, Armando Fox, and Terry Winograd. 2002. The Interactive Workspaces Project: Experiences with Ubiquitous Computing Rooms. IEEE Pervasive Computing 1, 2 (April 2002), 67--74. Google ScholarDigital Library
- Brett R. Jones, Hrvoje Benko, Eyal Ofek, and Andrew D. Wilson. 2013. IllumiRoom: Peripheral Projected Illusions for Interactive Experiences. In ACM SIGGRAPH 2013 Emerging Technologies (SIGGRAPH '13). ACM, New York, NY, USA, Article 7, 1 pages. Google ScholarDigital Library
- Lee Jones, John McClelland, Phonesavanh Thongsouksanoumane, and Audrey Girouard. 2017. Ambient Notifications with Shape Changing Circuits in Peripheral Locations. In Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces (ISS '17). ACM, New York, NY, USA, 405--408. Google ScholarDigital Library
- Kazuki Kobayashi and Seiji Yamada. 2013. Shape Changing Device for Notification. In Proceedings of the Adjunct Publication of the 26th Annual ACM Symposium on User Interface Software and Technology (UIST '13 Adjunct). ACM, New York, NY, USA, 71--72. Google ScholarDigital Library
- Magic Leap. 2018. Magic Leap One: Creator Edition | Magic Leap. https://www.magicleap.com/magic-leap-oneGoogle Scholar
- Yen-Chen Lin, Yung-Ju Chang, Hou-Ning Hu, Hsien-Tzu Cheng, ChiWen Huang, and Min Sun. 2017. Tell Me Where to Look: Investigating Ways for Assisting Focus in 360? Video. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 2535--2545. Google ScholarDigital Library
- Yung-Ta Lin, Yi-Chi Liao, Shan-Yuan Teng, Yi-Ju Chung, Liwei Chan, and Bing-Yu Chen. 2017. Outside-In: Visualizing Out-of-Sight Regionsof-Interest in a 360 Video Using Spatial Picture-in-Picture Previews. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST '17). ACM, New York, NY, USA, 255--265. Google ScholarDigital Library
- Paul P. Maglio and Christopher S. Campbell. 2000. Tradeoffs in Displaying Peripheral Information. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '00). ACM, New York, NY, USA, 241--248. Google ScholarDigital Library
- Shizuko Matsuzoe, Shan Jiang, Miwa Ueki, and Keiju Okabayashi. 2017. Intuitive Visualization Method for Locating Off-screen Objects Inspired by Motion Perception in Peripheral Vision. In Proceedings of the 8th Augmented Human International Conference (AH '17). ACM, New York, NY, USA, Article 29, 4 pages. Google ScholarDigital Library
- Andrii Matviienko, Andreas Löcken, Abdallah El Ali, Wilko Heuten, and Susanne Boll. 2016. NaviLight: Investigating Ambient Light Displays for Turn-by-turn Navigation in Cars. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '16). ACM, New York, NY, USA, 283-- 294. Google ScholarDigital Library
- Microsoft. 2018. Microsoft HoloLens | The Leader in Mixed Reality Technology. https://www.microsoft.com/en-us/hololensGoogle Scholar
- Heiko Müller, Andreas Löcken, Wilko Heuten, and Susanne Boll. 2014. Sparkle: An Ambient Light Display for Dynamic Off-screen Points of Interest. In Proceedings of the 8th Nordic Conference on HumanComputer Interaction: Fun, Fast, Foundational (NordiCHI '14). ACM, New York, NY, USA, 51--60. Google ScholarDigital Library
- Miguel A. Nacenta, Dzmitry Aliakseyeu, Sriram Subramanian, and Carl Gutwin. 2005. A Comparison of Techniques for Multi-display Reaching. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '05). ACM, New York, NY, USA, 371--380. Google ScholarDigital Library
- Miguel A. Nacenta, Mark Hancock, Carl Gutwin, and Sheelagh Carpendale. 2016. The Effects of Changing Projection Geometry on Perception of 3D Objects on and Around Tabletops. ACM Trans. Comput.-Hum. Interact. 23, 2, Article 11 (May 2016), 54 pages. Google ScholarDigital Library
- Miguel A. Nacenta, Satoshi Sakurai, Tokuo Yamaguchi, Yohei Miki, Yuichi Itoh, Yoshifumi Kitamura, Sriram Subramanian, and Carl Gutwin. 2007. E-conic: A Perspective-aware Interface for Multi-display Environments. In Proceedings of the 20th Annual ACM Symposium on User Interface Software and Technology (UIST '07). ACM, New York, NY, USA, 279--288. Google ScholarDigital Library
- Julian Petford, Miguel A. Nacenta, and Carl Gutwin. 2018. Pointing All Around You: Selection Performance of Mouse and Ray-Cast Pointing in Full-Coverage Displays. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 533, 14 pages. Google ScholarDigital Library
- Julian Petford, Miguel A. Nacenta, Carl Gutwin, Joseph Eremondi, and Cody Ede. 2016. The ASPECTA Toolkit: Affordable Full Coverage Displays. In Proceedings of the 5th ACM International Symposium on Pervasive Displays (PerDis '16). ACM, New York, NY, USA, 87--105. Google ScholarDigital Library
- Ioannis Politis, Stephen Brewster, and Frank Pollick. 2015. Languagebased Multimodal Displays for the Handover of Control in Autonomous Cars. In Proceedings of the 7th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI '15). ACM, New York, NY, USA, 3--10. Google ScholarDigital Library
- Luis C. Populin. 2008. Human sound localization: measurements in untrained, head-unrestrained subjects using gaze as a pointer. Experimental Brain Research 190, 1 (01 Sep 2008), 11--30.Google Scholar
- Kathrin Probst, Michael Haller, Kentaro Yasu, Maki Sugimoto, and Masahiko Inami. 2013. Move-it Sticky Notes Providing Active Physical Feedback Through Motion. In Proceedings of the 8th International Conference on Tangible, Embedded and Embodied Interaction (TEI '14). ACM, New York, NY, USA, 29--36. Google ScholarDigital Library
- Matti Rantanen, Antti Oulasvirta, Jan Blom, Sauli Tiitta, and Martti Mäntylä. 2004. InfoRadar: Group and Public Messaging in the Mobile Context. In Proceedings of the Third Nordic Conference on Humancomputer Interaction (NordiCHI '04). ACM, New York, NY, USA, 131-- 140. Google ScholarDigital Library
- Ramesh Raskar, Greg Welch, Matt Cutts, Adam Lake, Lev Stesin, and Henry Fuchs. 1998. The Office of the Future: A Unified Approach to Image-based Modeling and Spatially Immersive Displays. In Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '98). ACM, New York, NY, USA, 179--188. Google ScholarDigital Library
- Jun Rekimoto and Masanori Saitoh. 1999. Augmented Surfaces: A Spatially Continuous Work Space for Hybrid Computing Environments. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '99). ACM, New York, NY, USA, 378--385. Google ScholarDigital Library
- Massimo Scolari. 2012. Oblique drawing: A history of anti-perspective. MIT press.Google Scholar
- Saqib Shah. 2016. Facebook now lets you guide viewers around your 360-degree video. https://www.digitaltrends.com/social-media/ facebook-360-video-tools-analytics/Google Scholar
- A. Sheikh. 2016. Directing attention in 360-degree video. IET Conference Proceedings (January 2016), 29 (9 .)--29 (9 .)(1).Google ScholarCross Ref
- Teresa Siu and Valeria Herskovic. 2013. SidebARs: Improving Awareness of Off-screen Elements in Mobile Augmented Reality. In Proceedings of the 2013 Chilean Conference on Human - Computer Interaction (ChileCHI '13). ACM, New York, NY, USA, 36--41. Google ScholarDigital Library
- Richard Stoakley, Matthew J. Conway, and Randy Pausch. 1995. Virtual Reality on a WIM: Interactive Worlds in Miniature. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '95). ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, 265--272. Google ScholarDigital Library
- Norbert A. Streitz, Jörg Gei, Torsten Holmer, Shin'ichi Konomi, Christian Müller-Tomfelde, Wolfgang Reischl, Petra Rexroth, Peter Seitz, and Ralf Steinmetz. 1999. i-LAND: An Interactive Landscape for Creativity and Innovation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '99). ACM, New York, NY, USA, 120--127. Google ScholarDigital Library
- Peter Tarasewich, Christopher S. Campbell, Tian Xia, and Myra Dideles. 2003. Evaluation of Visual Notification Cues for Ubiquitous Computing. In UbiComp 2003: Ubiquitous Computing, Anind K. Dey, Albrecht Schmidt, and Joseph F. McCarthy (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 349--366.Google Scholar
- Matthias Trapp, Lars Schneider, Christine Lehmann, Norman Holz, and Jurgen Dollner. 2011. Strategies for Visualising 3D Points-ofinterest on Mobile Devices. J. Locat. Based Serv. 5, 2 (June 2011), 79--99. Google ScholarDigital Library
- Maarten van Dantzich, Daniel Robbins, Eric Horvitz, and Mary Czerwinski. 2002. Scope: Providing Awareness of Multiple Notifications at a Glance. In Proceedings of the Working Conference on Advanced Visual Interfaces (AVI '02). ACM, New York, NY, USA, 267--281. Google ScholarDigital Library
- Gina Venolia, Laura Dabbish, JJ Cadiz, and Anoop Gupta. 2001. Supporting Email Workflow. Technical Report. 8 pages. https://www.microsoft. com/en-us/research/publication/supporting-email-workflow/Google Scholar
- John Vilk, David Molnar, Benjamin Livshits, Eyal Ofek, Chris Rossbach, Alexander Moshchuk, Helen J. Wang, and Ran Gal. 2015. SurroundWeb: Mitigating Privacy Concerns in a 3D Web Browser. In Proceedings of the 2015 IEEE Symposium on Security and Privacy (SP '15). IEEE Computer Society, Washington, DC, USA, 431--446. Google ScholarDigital Library
- Amanda Williams, Shelly Farnham, and Scott Counts. 2006. Exploring Wearable Ambient Displays for Social Awareness. In CHI '06 Extended Abstracts on Human Factors in Computing Systems (CHI EA '06). ACM, New York, NY, USA, 1529--1534. Google ScholarDigital Library
- Andrew D. Wilson and Hrvoje Benko. 2016. Projected Augmented Reality with the RoomAlive Toolkit. In Proceedings of the 2016 ACM International Conference on Interactive Surfaces and Spaces (ISS '16). ACM, New York, NY, USA, 517--520. Google ScholarDigital Library
- Robert Xiao, Miguel A. Nacenta, Regan L. Mandryk, Andy Cockburn, and Carl Gutwin. 2011. Ubiquitous Cursor: A Comparison of Direct and Indirect Pointing Feedback in Multi-display Environments. In Proceedings of Graphics Interface 2011 (GI '11). Canadian Human-Computer Communications Society, School of Computer Science, University of Waterloo, Waterloo, Ontario, Canada, 135--142. http://dl.acm.org/citation.cfm?id=1992917.1992939 Google ScholarDigital Library
- Polle T. Zellweger, Jock D. Mackinlay, Lance Good, Mark Stefik, and Patrick Baudisch. 2003. City Lights: Contextual Views in Minimal Space. In CHI '03 Extended Abstracts on Human Factors in Computing Systems (CHI EA '03). ACM, New York, NY, USA, 838--839. Google ScholarDigital Library
- Leizhong Zhang, Nan Tu, and Dave Vronay. 2005. Info-lotus: A Peripheral Visualization for Email Notification. In CHI '05 Extended Abstracts on Human Factors in Computing Systems (CHI EA '05). ACM, New York, NY, USA, 1901--1904. Google ScholarDigital Library
Index Terms
- A Comparison of Notification Techniques for Out-of-View Objects in Full-Coverage Displays
Recommendations
Interaction techniques and applications for peephole displays
CHI EA '03: CHI '03 Extended Abstracts on Human Factors in Computing SystemsThis demonstration presents several interaction techniques enabled by Peephole Displays, an interface metaphor based on situating information in physical space and providing a movable window on the space. Using a Peephole Display, it is possible to ...
Mobile-based tangible interaction techniques for shared displays
MobileHCI '14: Proceedings of the 16th international conference on Human-computer interaction with mobile devices & servicesThis tutorial explores the possibility of using touchscreen-based mobile devices as active tangibles on an interactive tabletop surface. The tutorial starts with an open discussion about various aspects of tangible interaction, including an overview of ...
Tablet interaction techniques for viewport navigation on large displays
CHI EA '14: CHI '14 Extended Abstracts on Human Factors in Computing SystemsWhile a subset view on tablet devices allows users to observe in detail an area of the large display from a distance, interaction techniques are required to support viewport navigation around the display efficiently. We propose two dual-touch techniques ...
Comments