Abstract
Augmented reality AR is a relatively new technology that blends digital content such as information, sound, video, graphics, or GPS data into our real world.The natural interaction of users with virtual content is one of the big challenges of the AR application. In this paper, we present a new approach to natural interaction with virtual objects employing users’ hands and fingers. We use a real-time image processing system to track gestures from users as a first step and to convert the gestures’ shapes on object commands as a second step. The paper describes how these techniques were applied in an interactive AR heart visualization interface. Our aim is to provide an interactive learning tool that will help students to learn about the components of the heart. Experimental results showed the effectiveness of the proposed method.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Azuma, R.: A survey of augmented reality. Presence Teleoperators Virtual Env. 6, 355–385 (1997)
Azuma, R., Baillot, Y., Behringer, R., Feiner, S., Julier, S., MacIntyre, B.: Recent advances in augmented reality. IEEE Comput. Graph. Appl. 21(6), 34–47 (2001)
Zhou, F., Been-Lirn Duh, H., Billinghurst, M.: Trends in augmented reality tracking, interaction and display: a review of ten years of ISMAR. In: Proceedings of the 7th IEEE/ACM ISMAR, pp. 193–202 (2008)
Radkowski, R., Stritzke, C.: Interactive hand gesture-based assembly for augmented reality applications. In: Proceedings of the 2012 International Conference on Advances in Computer-Human Interactions, pp. 303–308 (2012)
Ejbali, R., Zaied, M., Ben Amar, C.H.: A computer control system using a virtual keyboard. In: ICMV (2015)
Piekarski, W., Thomas, B.H.: Using ARToolKit for 3D hand position tracking in mobile outdoor environments. In: Proceedings of 1st International Augmented Reality Toolkit Workshop (2003)
Buchmann, V., Violich, S., Billinghurst, M., Cockburn, A.: FingARtips: gesture based direct manipulation in augmented reality. In: Proceedings of the 2nd International Conference on Computer Graphics and Interactive Techniques in Australasia and South East Asia, GRAPHITE 2004, pp. 212–221. ACM, New York (2004)
Hurst, W., van Wezel, C.: Gesture-based interaction via finger tracking for mobile augmented reality. Multimedia Tools Appl. 62, 1–26 (2012)
Mistry, P., Maes, P., Chang, L.: WUW - Wear ur World: a wearable gestural interface. In: CHI 2009 Extended Abstracts on Human Factors in Computing Systems, pp. 4111–4116. ACM (2009)
Reifinger, S., Wallhoff, F., Ablassmeier, M., Poitschke, T., Rigoll, G.: Static and dynamic hand-gesture recognition for augmented reality applications. In: Jacko, J.A. (ed.) HCI 2007. LNCS, vol. 4552, pp. 728–737. Springer, Heidelberg (2007)
Kato, H., Billinghurst, M.: Marker tracking and HMD calibration for a video-based augmented reality conferencing system. In: Proceedings of the 2nd International Workshop on Augmented Reality, IWAR 1999 (1999)
Chitra, S., Balakrishnan, G.: Comparative study for two color spaces HSCbCr and YCbCr in skin color detection. Appl. Math. Sci. 6, 4229–4238 (2012)
Wang, Y., Yuan, B.: A novel approach for human face detection from color images under complex background. Pattern Recogn. 34(10), 1983–1992 (2001)
Segen, J., Kumar, S.: Fast and accurate 3D gesture recognition interface. IEEE International Conference on Pattern Recognition (1998)
Acknowledgements
The authors would like to acknowledge the financial support of this work by grants from General Direction of Scientific Research (DGRST), Tunisia, under the ARUB program.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Frikha, R., Ejbali, R., Zaied, M., Ben Amar, C. (2015). Natural Gesture Based Interaction with Virtual Heart in Augmented Reality. In: Jackowski, K., Burduk, R., Walkowiak, K., Wozniak, M., Yin, H. (eds) Intelligent Data Engineering and Automated Learning – IDEAL 2015. IDEAL 2015. Lecture Notes in Computer Science(), vol 9375. Springer, Cham. https://doi.org/10.1007/978-3-319-24834-9_53
Download citation
DOI: https://doi.org/10.1007/978-3-319-24834-9_53
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-24833-2
Online ISBN: 978-3-319-24834-9
eBook Packages: Computer ScienceComputer Science (R0)