ABSTRACT
In this paper we present a floor-based user interface (UI) that allows multiple users to explore a spatial augmented reality (SAR) environment with both monoscopic and stereoscopic projections. Such environments are characterized by a low level of user instrumentation and the capability of providing a shared interaction space for multiple users. However, projector-based systems using stereoscopic display are usually single-user setups, since they can provide the correct perspective for only one tracked person. To address this problem, we developed a set of guidance cues, which are projected onto the floor in order to assist multiple users regarding (i) the interaction with the SAR system, (ii) the identification of regions of interest and ideal viewpoints, and (iii) the collaboration with each other. In a user study with 40 participants all cues were evaluated and a set of feedback elements, which are essential to guarantee an intuitive self-explaining interaction, was identified. The results of the study also indicate that the developed UI guides users to more favorable viewpoints and therefore is able to improve the experience in a multi-user SAR environment.
Supplemental Material
- Gregory D Abowd, Christopher G Atkeson, Jason Hong, Sue Long, Rob Kooper, and Mike Pinkerton. 1997. Cyberguide: A mobile context-aware tour guide. Wireless networks 3, 5 (1997), 421--433. Google ScholarDigital Library
- Matt Adcock, David Feng, and Bruce Thomas. 2013. Visualization of off-surface 3D viewpoint locations in spatial augmented reality. In Proc. of SUI. ACM, 1--8. Google ScholarDigital Library
- Thomas Augsten, Konstantin Kaefer, René Meusel, Caroline Fetzer, Dorian Kanitz, Thomas Stoff, Torsten Becker, Christian Holz, and Patrick Baudisch. 2010. Multitoe: high-precision interaction with back-projected floors based on high-resolution multi-touch input. In Proc. of UIST. ACM, 209--218. Google ScholarDigital Library
- Till Ballendat, Nicolai Marquardt, and Saul Greenberg. 2010. Proxemic interaction: designing for a proximity and orientation-aware environment. In Proc. of ITS. ACM, 121--130. Google ScholarDigital Library
- Hrvoje Benko, Andrew D Wilson, and Federico Zannier. 2014. Dyadic projected spatial augmented reality. In Pro. of UIST. ACM, 645--655. Google ScholarDigital Library
- Oliver Bimber, L Miguel Encarnacc ao, and Dieter Schmalstieg. 2003. The virtual showcase as a new platform for augmented reality digital storytelling. In Proc. of EGVE. ACM, 87--95. Google ScholarDigital Library
- Oliver Bimber and Ramesh Raskar. 2005. Spatial augmented reality: merging real and virtual worlds. CRC press. Google ScholarDigital Library
- Alan Br"anzel, Christian Holz, Daniel Hoffmann, Dominik Schmidt, Marius Knaust, Patrick Lühne, René Meusel, Stephan Richter, and Patrick Baudisch. 2013. GravitySpace: tracking users and their poses in a smart room using a pressure-sensing floor. In Proc. of CHI. ACM, 725--734. Google ScholarDigital Library
- John Brooke and others. 1996. SUS-A quick and dirty usability scale. Usability evaluation in industry 189, 194 (1996), 4--7.Google Scholar
- Barry Brown, Ian MacColl, Matthew Chalmers, Areti Galani, Cliff Randell, and Anthony Steed. 2003. Lessons from the lighthouse: collaboration in a shared mixed reality system. In Proc. of CHI. ACM, 577--584. Google ScholarDigital Library
- Seongju Chang, Sungil Ham, Seungbum Kim, Dongjun Suh, and Hyunseok Kim. 2010. Ubi-floor: Design and pilot implementation of an interactive floor system. In Proc. of IHMSC, Vol. 2. IEEE, 290--293. Google ScholarDigital Library
- Insook Choi and Carlos Ricci. 1997. Foot-mounted gesture detection and its application in virtual environments. In Proc. of SMC, Vol. 5. IEEE, 4248--4253.Google ScholarCross Ref
- Carolina Cruz-Neira, Daniel J Sandin, and Thomas A DeFanti. 1993. Surround-screen projection-based virtual reality: the design and implementation of the CAVE. In Proc. of SIGGRAPH. ACM, 135--142. Google ScholarDigital Library
- Kaj Grønbæk, Ole S Iversen, Karen Johanne Kortbek, Kaspar Rosengreen Nielsen, and Louise Aagaard. 2007. IGameFloor: a platform for co-located collaborative games. In Proc. of ACE. ACM, 64--71. Google ScholarDigital Library
- Marc Hassenzahl, Michael Burmester, and Franz Koller. 2003. AttrakDiff: Ein Fragebogen zur Messung wahrgenommener hedonischer und pragmatischer Qualit"at. In Mensch & Computer 2003. Springer, 187--196.Google Scholar
- Brett Jones, Rajinder Sodhi, Michael Murdock, Ravish Mehra, Hrvoje Benko, Andrew Wilson, Eyal Ofek, Blair MacIntyre, Nikunj Raghuvanshi, and Lior Shapira. 2014. RoomAlive: magical experiences enabled by scalable, adaptive projector-camera units. In Proc. of UIST. ACM, 637--644. Google ScholarDigital Library
- Brett R Jones, Hrvoje Benko, Eyal Ofek, and Andrew D Wilson. 2013. IllumiRoom: peripheral projected illusions for interactive experiences. In Proc. of CHI. ACM, 869--878. Google ScholarDigital Library
- Peter Krogh, Martin Ludvigsen, and Andreas Lykke-Olesen. 2004. " Help Me Pull That Cursor" A Collaborative Interactive Floor Enhancing Community Interaction. Australasian Journal of Information Systems 11, 2 (2004).Google ScholarCross Ref
- Alexander Kulik, André Kunert, Stephan Beck, Roman Reichel, Roland Blach, Armin Zink, and Bernd Froehlich. 2011. C1x6: a stereoscopic six-user display for co-located collaboration in shared virtual environments. In ACM Transactions on Graphics (TOG), Vol. 30. ACM, 188. Google ScholarDigital Library
- Joseph J LaViola Jr, Daniel Acevedo Feliz, Daniel F Keefe, and Robert C Zeleznik. 2001. Hands-free multi-scale navigation in virtual environments. In Proc. of I3D. ACM, 9--15. Google ScholarDigital Library
- Blair MacIntyre, Jay David Bolter, Emmanuel Moreno, and Brendan Hannigan. 2001. Augmented reality as a new media experience. In Proc. of ISAR. IEEE, 197--206. Google ScholarDigital Library
- Francesco Martino, Roberto Baù, Anna Spagnolli, and Luciano Gamberini. 2009. Presence in the age of social networks: augmenting mediated environments with feedback on group activity. Virtual reality 13, 3 (2009), 183--194. Google ScholarDigital Library
- Mark R Mine, Jeroen van Baar, Anselm Grundhofer, David Rose, and Bei Yang. 2012. Projection-based augmented reality in disney theme parks. Computer 45, 7 (2012), 32--40. Google ScholarDigital Library
- Tsutomu Miyashita, Peter Meier, Tomoya Tachikawa, Stephanie Orlic, Tobias Eble, Volker Scholz, Andreas Gapel, Oliver Gerl, Stanimir Arnaudov, and Sebastian Lieberknecht. 2008. An augmented reality museum guide. In Proc. of ISMAR. IEEE Computer Society, 103--106. Google ScholarDigital Library
- Claudio Pinhanez. 2001. The everywhere displays projector: A device to create ubiquitous graphical interfaces. In International Conference on Ubiquitous Computing. Springer, 315--331. Google ScholarDigital Library
- Ramesh Raskar, Greg Welch, Matt Cutts, Adam Lake, Lev Stesin, and Henry Fuchs. 1998. The office of the future: A unified approach to image-based modeling and spatially immersive displays. In Proc. of SIGGRAPH. ACM, 179--188. Google ScholarDigital Library
- Ramesh Raskar, Greg Welch, Kok-Lim Low, and Deepak Bandyopadhyay. 2001. Shader lamps: Animating real objects with image-based illumination. In Rendering Techniques 2001. Springer, 89--102. Google ScholarDigital Library
- Jun Rekimoto and Masanori Saitoh. 1999. Augmented surfaces: a spatially continuous work space for hybrid computing environments. In Proc. of CHI. ACM, 378--385. Google ScholarDigital Library
- Brett Ridel, Patrick Reuter, Jeremy Laviole, Nicolas Mellado, Nadine Couture, and Xavier Granier. 2014. The revealing flashlight: Interactive spatial augmented reality for detail exploration of cultural heritage artifacts. Journal on Computing and Cultural Heritage (JOCCH) 7, 2 (2014), 6. Google ScholarDigital Library
- Jeff Sauro. 2011. A practical guide to the system usability scale: Background, benchmarks & best practices. Measuring Usability LLC Denver, CO.Google Scholar
- Dieter Schmalstieg and Daniel Wagner. 2007. Experiences with handheld augmented reality. In Proc. of ISMAR. IEEE, 3--18. Google ScholarDigital Library
- Dominik Schmidt, Raf Ramakers, Esben W Pedersen, Johannes Jasper, Sven Köhler, Aileen Pohl, Hannes Rantzsch, Andreas Rau, Patrick Schmidt, Christoph Sterz, and others. 2014. Kickables: tangibles for feet. In Proc. of CHI. ACM, 3143--3152. Google ScholarDigital Library
- Susanne Schmidt, Gerd Bruder, and Frank Steinicke. 2015. A Layer-based 3D Virtual Environment for Architectural Collaboration. In Proc. of EuroVR.Google Scholar
- Susanne Schmidt and Frank Steinicke. 2017. A Projection-Based Augmented Reality Setup for Blended Museum Experiences. In Proc. of ICAT-EGVE (Poster). 5--6.Google Scholar
- Mel Slater, Amela Sadagic, Martin Usoh, and Ralph Schroeder. 2000. Small-group behavior in a virtual and real environment: A comparative study. Presence: Teleoperators & Virtual Environments 9, 1 (2000), 37--51. Google ScholarDigital Library
- Harrison Jesse Smith and Michael Neff. 2018. Communication Behavior in Embodied Virtual Reality. In Proc. of CHI. ACM, 289. Google ScholarDigital Library
- Yon Visell, Alvin Law, and Jeremy R Cooperstock. 2009. Touch is everywhere: Floor surfaces as ambient haptic interfaces. IEEE Transactions on Haptics 2, 3 (2009), 148--159. Google ScholarDigital Library
- Yon Visell, Severin Smith, and Jeremy R. Cooperstock. 2013. Interacting with Augmented Floor Surfaces. In Human Walking in Virtual Environments: Perception, Technology, and Applications, Frank Steinicke, Yon Visell, Jennifer Campos, and Anatole Lécuyer (Eds.). Springer, New York, NY, 377--399.Google Scholar
- Yon Visell, Severin Smith, Alvin Law, Rishi Rajalingham, and Jeremy R Cooperstock. 2010. Contact sensing and interaction techniques for a distributed, multimodal floor display. In Proc. of 3DUI. IEEE, 75--78. Google ScholarDigital Library
- Pierre Wellner. 1993. Interacting with paper on the DigitalDesk. Commun. ACM 36, 7 (1993), 87--96. Google ScholarDigital Library
Index Terms
- Floor-Projected Guidance Cues for Collaborative Exploration of Spatial Augmented Reality Setups
Recommendations
Dyadic projected spatial augmented reality
UIST '14: Proceedings of the 27th annual ACM symposium on User interface software and technologyMano-a-Mano is a unique spatial augmented reality system that combines dynamic projection mapping, multiple perspective views and device-less interaction to support face to face, or dyadic, interaction with 3D virtual objects. Its main advantage over ...
Collaborative Augmented Reality: Multi-user Interaction in Urban Simulation
IVIC '09: Proceedings of the 1st International Visual Informatics Conference on Visual Informatics: Bridging Research and PracticeAugmented reality (AR) environment allows user or multi-user to interact with 2D and 3D data. AR simply can provide a collaborative interactive AR environment for urban simulation, where users can interact naturally and intuitively. AR collaboration ...
reFrame: An Alternate Paradigm for Augmented Reality
SIGGRAPH '20: ACM SIGGRAPH 2020 Posters“reFrame” is an optically see-through Augmented Reality (AR) platform capable of displaying parallax-free images superimposed over physical objects and the scenery behind it. It uses head-tracking technology and off-axis perspective projection to ...
Comments