Abstract
Mixed Reality (MR) opens a new dimension for Human Computer Interaction (HCI). Combined with computer vision (CV) techniques, it is possible to create advanced input devices. This paper describes a novel form of HCI for the MR environment that combines CV with MR to allow a MR user to interact with a floating virtual touch screen using their bare hands. The system allows the visualisation of the virtual interfaces and touch screen through a Head Mounted Display (HMD). Visual tracking and interpretation of the user’s hand and finger motion allows the detection of key presses on the virtual touch screen. We describe an implementation of this type of interfaces and demonstrate the results through a virtual keypad application.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Berard, F., Crowley, J., Coutaz, J.: Finger tracking as an input device for augmented reality. In: Proc. Int. Workshop Automatic Face and Gesture Recognition, pp. 195–200 (1995)
Robinson, P., Stafford-Fraser, Q.: BrightBoard:a video-augmented environment. In: Conference proceedings on Human factors in computing systems, pp. 134–141. ACM Press, New York (1996)
Segen, J., Kumar, S.: GestureVR: Vision-based 3d hand interface for spatial interaction. In: The Sixth ACM International Multimedia Conference (September 1998)
Saito, H., Abe, K., Ozawa, S.: 3-d drawing system via hand motion recognition from two cameras. In: Proceeding of the 6th Korea-Japan Joint Workshop on Computer Vision, January 2000, pp. 138–143 (2000)
Berard, F., Von Hardenberg, C.: Bare-hand human computer interaction. In: Proceedings of the ACM Workshop on Perceptive User Interfaces (2001)
Keaton, T., Dominguez, S.M., Sayed, A.H.: Robust finger tracking for wearable computer interfacing. In: Proc. Workshop on Perspective User Interfaces (November 2001)
Pingali, G., Pinhanez, C., et al.: Steerable interfaces for pervasive computing spaces. In: First IEEE International Conference on Pervasive Computing and Communications (PerCom 2003), p. 315 (2003)
Woo, W., Lee, M.: ARKB: 3d vision-based augmented reality keyboard. In: ICAT 2003 (International Conference on Artificial Reality and Telexistence), December 2003, pp. 54–57 (2003)
Sugimoto, Y.Y., Osawa, N.: Multimodal text input in an immersive environment. In: ICAT, December 4-6, pp. 85–93 (2002)
Silva, L., Rodriguez, R.: Biometric identification by dermatoglyphics. In: Proceedings of the 1996 IEEE International Conference on Image Processing (ICIP 1996), pp. 319–322 (1996)
Billinghurst, M., Kato, H.: Collaborative Mixed Reality. In: Proceedings of the First lnternational Symposium on Mixed Reality, pp. 261–284 (1999)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Tosas, M., Li, B. (2004). Virtual Touch Screen for Mixed Reality. In: Sebe, N., Lew, M., Huang, T.S. (eds) Computer Vision in Human-Computer Interaction. CVHCI 2004. Lecture Notes in Computer Science, vol 3058. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24837-8_6
Download citation
DOI: https://doi.org/10.1007/978-3-540-24837-8_6
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-22012-1
Online ISBN: 978-3-540-24837-8
eBook Packages: Springer Book Archive