Tomohiro Tanikawa
ABSTRACT
Lately, mobile augmented reality (AR) has become very popular and is used for many commercial and product promotional activities. However, in almost all mobile AR applications, the user only views annotated information or the preset motion of the virtual object in an AR environment and is unable to interact with the virtual objects as if he/she were interacting with real objects in the real environment. In this paper, in an attempt to realize enhanced intuitive and realistic object manipulation in the mobile AR environment, we propose an integrated view-input AR interaction method, which integrates user device manipulation and virtual object manipulation. The method enables the user to hold a 3D virtual object by touching the displayed object on the 2D touch screen of a mobile device, and to move and rotate the object by moving and rotating the mobile device while viewing the held object by way of the 2D screen of the mobile device. Based on this concept, we implemented three types of integrated methods, namely the Rod, Center, and Touch methods, and conducted a user study to investigate the baseline performance metrics of the proposed method on an AR object manipulation task. The Rod method achieved the highest success rate (91%). Participants' feedback indicated that this is because the Rod method is the most natural, and evoked a fixed mental model that is conceivable in the real environment. These results indicated that visualizing the manipulation point on the screen and restricting the user's interactivity with virtual objects from the user's position of view based on a conceivable mental model would be able to aid the user to achieve precise manipulation.
Supplemental Material
- D. W. F Van Krevelen and R. Poelman. A survey of augmented reality technologies, applications and limitations. International Journal of Virtual Reality, Vol. 9, No. 2, p. 1, 2010.Google Scholar
Cross Ref
- Nintendo 3DS, AR Games. http://www.nintendo.co.jp/3ds/software/built-in/ar/. Accessed: 23/10/2014.Google Scholar
- Duy-Nguyen Ta Huynh, Karthik Raveendran, Yan Xu, Kimberly Spreen, and Blair MacIntyre. Art of defense: a collaborative handheld augmented reality board game. In Proceedings of the 2009 ACM SIGGRAPH Symposium on Video Games, Sandbox '09, New York, NY, USA, pp. 135.142, 2009. Google ScholarDigital Library
- T. Ha, W. Woo. An empirical evaluation of virtual hand techniques for 3D object manipulation in a tangible augmented reality environment. In Proceedings of the 2010 IEEE Symposium on 3D User Interfaces (3DUI '10). IEEE Computer Society, Washington, DC, USA, pp. 91.98, 2010 Google ScholarDigital Library
- M. BaldaufM, S. Zambanini, P. Fröhlich, P. Reichl. Markerless visual fingertip detection for natural mobile device interaction. In Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI '11). ACM, New York, NY, USA, pp. 539.544, 2011. Google ScholarDigital Library
- Wolfgang Hürst and Casper van Wezel. Gesture-based interaction via finger tracking for mobile augmented reality. Multimedia Tools and Applications, Vol. 62, No. 1, pp. 233.258, 2013.Google Scholar
- Wendy H Chun and Tobias Höllerer. Real-time hand interaction for augmented reality on mobile phones. In Proceedings of the 2013 international conference on Intelligent user interfaces, IUI '13, ACM, New York, NY, USA, pp. 307.314, 2013. Google ScholarDigital Library
- Anders Henrysson, Mark Billinghurst, and Mark Ollila. Face to face collaborative AR on mobile phones. In Mixed and Augmented Reality, 2005. Proceedings. Fourth IEEE and ACM International Symposium on, pp. 80.89, 2005. Google ScholarDigital Library
- Anders Henrysson, Mark Billinghurst, and Mark Ollila. Virtual object manipulation using a mobile phone. In Proceedings of the 2005 international conference on Augmented tele-existence, ACM, pp. 164.171, 2005. Google ScholarDigital Library
- Anders Henrysson, Mark Ollila, and Mark Billinghurst. Mobile phone based AR scene assembly. In Proceedings of the 4th international conference on Mobile and ubiquitous multimedia, ACM, pp. 95.102, 2005. Google ScholarDigital Library
- JENGA. http://www.takaratomy.co.jp/products/jenga. Accessed: 15/07/2013.Google Scholar
- Anatole Lécuyer. Simulating haptic feedback using vision: A survey of research and applications of pseudo-haptic feedback. Presence: Teleoperators and Virtual Environments, Vol. 18, No. 1, pp. 39.53, 2009. Google ScholarDigital Library
Index Terms
- Integrated view-input ar interaction for virtual object manipulation using tablets and smartphones
Recommendations
Virtual object manipulation using a mobile phone
ICAT '05: Proceedings of the 2005 international conference on Augmented tele-existenceAugmented Reality (AR) on mobile phones has reached a level of maturity where it can be used as a tool for 3D object manipulation. In this paper we look at user interface issues where an AR enabled mobile phone acts as an interaction device. We discuss ...
Miniature AR: Multi-view 6DOF Virtual Object Visualization for a Miniature Diorama
VRST '21: Proceedings of the 27th ACM Symposium on Virtual Reality Software and TechnologyWe describe a miniature diorama AR system called ‘Miniature AR’ which can be applied to a mechanical diorama to extend the content’s feasibility by overlapping virtual objects on the complex diorama structure. The previous AR researches for the diorama ...
A gesture control system for intuitive 3D interaction with virtual objects
VRCAI 08We present a system for interacting with 3D objects in a 3D virtual environment. Using the notion that a typical head-mounted display (HMD) does not cover the user's entire face, we use a fiducial marker placed on the HMD to locate the user's exposed ...
Comments