Ajune Wanis Ismail
ABSTRACT
In this paper, we describe a new interaction approach for intuitive 3D object handling in Augmented Reality (AR). Our method transforms the AR tracking pattern into a point-based representation and then uses this to perform object interaction such as translate, rotate, and clone. This is based on a robust real-time computer vision algorithm that constructs a 6DOF camera pose relative to a handheld paddle used for input. Using a point-by-point calculation of the camera pose relative to the paddle we can overlay 3D graphics on top of the paddle or a ground plane. This allows the user to inspect virtual objects from different viewing angles in the AR interface and perform interactions with the objects. In this paper, we first review related work and then briefly describe our system architecture and tracking method. We evaluate our approach with regard to speed and accuracy, and compare it to existing marker-based AR systems. Finally, we demonstrate the robustness and usefulness of our approach in an example AR application.
- Azuma, Y. Baillot, R. Behringer, S. Feiner, S. Julier, and B. MacIntyre. Recent advances in augmented reality. IEEE Computer Graphics & Applications, 21:6, 34--47, 2001. Google Scholar
Digital Library
- S. White, D. Feng, and S. Feiner, "Poster: Shake Menus: Activation and Placement Techniques for Prop-Based 3D Graphical Menus," in Proc. IEEE 3DUI, Lafayette, LA, pp. 129--130. 2009. Google ScholarDigital Library
- M. Billinghurst, H. Kato, and I. Poupyrev, "The Magic-Book -- Moving Seamlessly between Reality and Virtuality", IEEE Computer Graphics and Applications 21 (2001), no. 3, 6--8, ISSN 0272-1716, 2001. Google ScholarDigital Library
- C. Geiger, Leif Oppermann, Christian Reimann: 3D-Registered Interaction-Surfaces in Augmented Reality Space. In Proceedings of 2nd IEEE International Augmented Reality Toolkit Workshop (2003)Google Scholar
- K. Kiyokawa, Haruo Takemura, Naokazu Yokoya: A Collaboration Support Technique by Integrating a Shared Virtual Reality and a Shared Augmented Reality. In Proceedings of IEEE International Conference on Systems Man and Cybernetics (1999) 48--53Google Scholar
- H. Kato, M. Billinghurst, I. Poupyrev, N. Tetsutani, K. Tachibana: Tangible Augmented Reality for Human Computer Interaction. In Proceedings of Nicograph, Nagoya, Japan (2001)Google Scholar
- Zsolt Szalavari, Michael Gervautz: The Personal Interaction Panel -- A Two-Handed Interface for Augmented Reality. In Proceedings of EUROGRAPHICS, Computer Graphics Forum, Vol. 16, 3 (1997) 335--346.Google Scholar
- V. Buchmann, S. Violich, M. Billinghurst, and A. Cockburn, "FingARtips: gesture based direct manipulation in Augmented Reality," in Proc. 2nd International Conference on Computer Graphics and Interactive Techniques in Australasia and South East Asia, 2004, pp. 212--221. Google ScholarDigital Library
- F. Zhou, H. B.-L. Duh, and M. Billinghurst, "Trends in Augmented Reality Tracking, Interaction and Display: A Review of Ten Years of ISMAR " in Proc. IEEE ISMAR, Cambridge, UK, pp. 193--202, 2008. Google ScholarDigital Library
- Ismail A. W., Sunar M. S. and Yusof. C. S., Journal of Computing, Volume 3, Issue 1, January 2011, ISSN 2151-9617, "Single-point Interaction for 3D Object Handling in Augmented Reality" (2011)Google Scholar
- H. Ishii, B. Ullmer. Tangible bits: towards seamless interfaces between people, bits and atoms. In ACM CHI'97, pp. 234--241, 1997. Google ScholarDigital Library
- Kato, H., Billinghurst, M., Poupyrev, I., Imamoto, K., Tachibana, K.: Virtual Object Manipulation on a Table-Top AR Environment. In: Proceedings of the International Symposium on Augmented Reality (ISAR 2000), October 2000, pp. 111--119 (2000)Google ScholarCross Ref
- Irawati, S., Green, S., Billinghurst, M., Duenser, A., Ko, H.: An evaluation of an augmented reality multimodal interface using speech and paddle gestures. In: Pan, Z., Cheok, D.A.D., Haller, M., Lau, R., Saito, H., Liang, R. (eds.) ICAT 2006. LNCS, vol. 4282, pp. 272--283. Springer, Heidelberg (2006) Google ScholarDigital Library
- Henrysson, A., Billinghurst, M., Ollila, M.: Virtual object manipulation using a mobile phone. In: Proceedings of the 2005 international conference on Augmented tele-existence, Christchurch, New Zealand, December 5--8 (2005) Google ScholarDigital Library
- Lee, BS and Chun, JC, Interactive manipulation of augmented objects in marker-less AR using vision-based hand mouse, In Inn Conference on Information Technology(ITNG), (2010), pp.398--403. Google ScholarDigital Library
- Billinghurst, M., Poupyrev, I., Kato, H., May, R. (2000) Mixing Realities in Shared Space: An Augmented Reality Interface for Collaborative Computing. In Proceedings of the IEEE International Conference on Multimedia and Expo (ICME2000), July 30th - August 2, New York.Google Scholar
- M. Fiala, "ARTag, a fiducial marker system using digital techniques," in Proc. CVPR 2005, San Diego, CA, pp. 590--596. 2005. Google ScholarDigital Library
- T.Lee and T.Hollerer, Hand AR: Markerless Inspection of Augmented Reality Objects Using Fingertip Tracking, In Proc.IEEE ISWC '07,(2007), pp.83--90. Google ScholarDigital Library
- T.Lee and T.Hollerer, "Initializing Markerless Tracking Using a Simple Hand Gesture," In Proc.ACMIIEEE ISMAR '07, (2007), pp.1--2. Google ScholarDigital Library
- T.Lee and T.Hollerer, "Hybrid Feature Tracking and User Interaction for Markerless Augment Reality," In IEEE Int'I Conference on Virtual Reality'08 (2008), pp.145--152.Google Scholar
- K. Dorfmüller-Ulhaas and D. Schmalstieg. Finger tracking for interaction in augmented environments. In ISAR '01, pp. 55--64, 2001. Google ScholarDigital Library
- S. Malik, C. McDonald and G. Roth. Tracking for interactive pattern-based augmented reality. In ISMAR '02, pp. 117--126, 2002. Google ScholarDigital Library
- J. Park, B. Jiang and U. Neumann. Vision-based pose computation: robust and accurate augmented reality tracking. In IWAR '99, pp. 312, 1999. Google ScholarDigital Library
- G. Klein and T. Drummond. Robust visual tracking for non-instrumented augmented reality. In ISMAR '03, pp. 113--122, 2003. Google ScholarDigital Library
- M. Bajura and N. Ulrich. Dynamic registration correction in video-based augmented reality systems. IEEE Computer Graphics and Applications, 15:5 52--60, September 1995. Google ScholarDigital Library
- ARToolKit, http://www.hitl.washington.edu/artoolkitGoogle Scholar
- Sunar, M.S., Mohd Zin, A., Tengku Sembok, T.M.: Improved View Frustum Culling Technique for Real-Time Virtual Heritage Application. The International Journal of Virtual Reality 7(3), 43--48 (2008)Google Scholar
Index Terms
- Using the S-PI Algorithm for Interaction in Augmented Reality
Recommendations
Multimodal augmented reality: the norm rather than the exception
MVAR '16: Proceedings of the 2016 workshop on Multimodal Virtual and Augmented RealityAugmented reality (AR) is commonly seen as a technology that overlays virtual imagery onto a participant's view of the world. In line with this, most AR research is focused on what we see. In this paper, we challenge this focus on vision and make a case ...
Haptics in Augmented Reality
ICMCS '99: Proceedings of the IEEE International Conference on Multimedia Computing and Systems - Volume 2An augmented reality system merges synthetic sensory information into a user's perception of a three-dimensional environment. An important performance goal for an augmented reality system is that the user perceives a single seamless environment. In most ...
Resolving occlusion in augmented reality
I3D '95: Proceedings of the 1995 symposium on Interactive 3D graphicsCurrent state-of-the-art augmented reality systems simply overlay computer-generated visuals on the real-world imagery, for example via video or optical see-through displays. However, overlays are not effective when displaying data in three dimensions, ...
Comments