Martin Tomitsch
ABSTRACT
Handheld projectors represent an emerging type of pervasive display that can provide situated, personalised access to digital information. Beyond the projection of content such as photos or websites they can be used to augment physical everyday objects with digital information. This approach has several advantages compared to other augmented reality (AR) technologies. For example handheld projectors eliminate the need to wear head-mounted displays and provide a true integration of the virtual overlay with the physical environment. Yet little is known regarding user interaction with projection-based AR interfaces. The work described in this paper aims to fill this gap through an explorative comparison of four interaction techniques. The techniques were evaluated with two iterations of a projection-based interface that augments physical books with digital information. The interface was prototyped with a fixed projector and a depth-camera sensor to simulate handheld projection. The paper provides a discussion of the techniques along with insights regarding the interface design of projection-based AR interfaces.
- Beardsley, P., van Baar, J., Raskar, R., Forlines, C. 2005. Interaction using a handheld projector. Computer Graphics and Applications 25, 1, IEEE, 39--43. Google Scholar
Digital Library
- Blasko, G., Feiner, S., Coriand, F. 2005. Exploring Interaction with a Simulated Wrist-Worn Projection Display. In Proc. ISWC '05. IEEE Computer Society, 2--9. Google ScholarDigital Library
- Buxton, W. 2007. Sketching User Experiences. Morgan Kaufmann.Google Scholar
- Cao, X. Balakrishnan, R. 2006. Interacting with dynamically defined information spaces using a handheld projector and a pen. In Proc. UIST '06. ACM, 225--234. Google ScholarDigital Library
- Choi, J., Kim, G. 2012. Usability of one-handed interaction methods for handheld projection-based augmented reality. J. Personal and Ubiquitous Computing 16, 1, Springer. Google ScholarDigital Library
- Ericsson. 2011. The Social Web of Things. www.youtube.com/watch?v=i5AuzQXBsG4Google Scholar
- Google Goggles. http://www.google.com/mobile/gogglesGoogle Scholar
- Greaves, A. Rukzio, E. 2010. Interactive Phone Call: Exploring Interactions during Phone Calls using Projector Phones. MobileHCI'10 Workshop on Ensembles of On-Body Devices.Google Scholar
- Hang, A., Rukzio, E., Greaves, A. 2008. Projector Phone: A Study of Using Mobile Phones with Integrated Projector for Interaction with Maps. In Proc. MobileHCI'08. ACM, 207--216. Google ScholarDigital Library
- Harrison, C., Benko, H., Wilson, A. D. 2011. OmniTouch: Wearable Multitouch Interaction Everywhere. Proc. UIST '11. ACM, 441--450. Google ScholarDigital Library
- Kawsar, F., Rukzio, E., Kortuem, G. 2010. An explorative comparison of magic lens and personal projection for interacting with smart objects. In Proc. MobileHCI '10. ACM, 157--160. Google ScholarDigital Library
- Kuniavsky, M., Creech, A. 2009. Information Shadows: How Ubiquitous Computing Serializes Everyday Things. The Serials Librarian 56, 1--4, Taylor Francis, 65.78.Google ScholarCross Ref
- Leung, M., Tomitsch, M., Vande Moere, A. 2011. Designing a personal visualization projection of online social identity. In Proc. CHI EA'11. ACM, 1843--1848. Google ScholarDigital Library
- Mankoff, J., Dey, A. K., Hsieh, G., Kientz, J., Lederer, S., Ames, M. 2003. Heuristic evaluation of ambient displays. In Proc. CHI '03. ACM, 169--176. Google ScholarDigital Library
- Microsoft Office Labs, 2009. Vision for 2019. www.youtube.com/watch?v=XiqgmAYrd3cGoogle Scholar
- Nancel, M., Wagner, J., Pietriga, E., Chapuis, O., Mackay, W. 2011. Mid-air pan-and-zoom on wall-sized displays. In Proc. CHI '11. ACM, 177--186. Google ScholarDigital Library
- Olsen, Jr, D. R., Nielsen, T. 2001. Laser pointer interaction. In Proc. CHI '01. ACM, 17--22. Google ScholarDigital Library
- Raskar, R., Low, K.-L. 2001. Interacting with spatially augmented reality. In Proc. AFRIGRAPH '01. ACM, 101--108. Google ScholarDigital Library
- Rapp, S., Michelitsch, G., Osen, M., Williams, J., Barbisch, M., Bohan, R., Valsan, Z., Emele, M. 2004. Spotlight Navigation: Interaction with a Handheld Projection Device. In Proc. Pervasive'04.Google Scholar
- Rapp, S. Spotlight Navigation: a pioneering user interface for mobile projection. In Proc. Ubiprojection 2010, Workshop on Personal Projection at Pervasive'10.Google Scholar
- Rukzio, E., Holleis, P., Gellersen, H. 2011. Personal Projectors for Pervasive Computing. J. IEEE Pervasive Computing. Google ScholarDigital Library
- Schöning, J., Rohs, M., Kratz, S., Löchtefeld, M., Krüger, A. 2009. Map torchlight: a mobile augmented reality camera projector unit. In Proc. CHI EA'09. ACM, 3841--3846 Google ScholarDigital Library
- Weiser, M. 1991. The compter for the 21st century. Scientific American, 1991.Google ScholarCross Ref
- Willis, K. D. D., Poupyrev, I., Shiratori, T. 2011. Motionbeam: a metaphor for character interaction with handheld projectors. In Proc. CHI '11. ACM, 1031--1040. Google ScholarDigital Library
- Wisneski, C., Ishii, H., Dahley, A., Gorbet, M. G., Brave, S., Ullmer, B., Yarin, P. 1998. Ambient Displays: Turning Architectural Space into an Interface between People and Digital Information. In Proc. CoBuild '98. Springer, 22--32. Google ScholarDigital Library
Index Terms
- Designing for mobile interaction with augmented objects
Recommendations
User-elicited dual-hand interactions for manipulating 3D objects in virtual reality environments
Virtual reality technologies (VR) have advanced rapidly in the last few years. Prime examples include the Oculus RIFT and HTC Vive that are both head-worn/mounted displays (HMDs). VR HMDs enable a sense of immersion and allow enhanced natural interaction ...
A study on touch & hover based interaction for zooming
CHI EA '12: CHI '12 Extended Abstracts on Human Factors in Computing SystemsProximity is a useful medium for interaction with high interactive digital contents. It can be used in different contexts such as for navigation through depth in 3D space in zoomable interfaces. In this paper, we propose hover-based zoom interaction as ...
Using an Augmented Reality Cube-Like Interface and 3D Gesture-Based Interaction to Navigate and Manipulate Data
VINCI '18: Proceedings of the 11th International Symposium on Visual Information Communication and InteractionIn this paper we describe our work-in-progress to create an interface that enables users to browse and select data within an Augmented Reality environment, using a virtual cube object that can be interacted with through 3D gestural input. We present the ...
Comments