Abstract
Concepts of 3-D human-computer interaction based on 2-D images of the user’s hand, obtained with a monocular vision system, are presented. From the images, 2-D parameters describing location and shape of the hand are extracted using moments and signatures. These parameters are mapped into 3-D movements to which intuitive metaphorical meanings are assigned. The resulting metaphors are evaluated using a network-distributed virtual squash game. Their effectiveness is compared with that of the space-ball, measuring the user’s ability to translate, rotate and accelerate for each input device/metaphor. As an application, a remote control system is described that allows presentations using HTML-pages that are controlled by hand gestures. The system shows a robust behavior even under the rather weak light conditions imposed by the darkness needed for the video beamers.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
R. Bolt and E. Herranz. Two-handed gesture in multi-modal natural dialog. In Symposium on User Interface Software and Technology, pages 7–14. ACM, 1992.
U. Bröckl, A. J. Klingert, and A. Schmitt. Towards standardized user interfaces for three-dimensional interaction: the development of 3D widgets based on PEX and motif. In Proceedings of the Fourth Annual Conference of the European X User Group (EXUG), 1992.
U. Bröckl-Fox. Untersuchung neuer, gestenbasierter Methoden für die SD- Interaktion. Verlag Shaker, Aachen, FRG, 1995.
U. Bröckl-Fox, L. Kettner, A. Klingert, and L. Kobbelt. Artificial Life and Virtual Reality, chapter XII, Using Three Dimensional Hand-Gesture Recognition as a New 3D Input Technique, pages 173–187. Wiley and Sons, 1994.
Michael Chen, S. Joy Mountford, and Abigail Sellen. A study in interactive 3-D rotation using 2-D control devices. Computer Graphics, 22 (4): 121–129, August 1988.
T. Darrell and A. Pentland. Space-time gestures. In IEEE Conference Computer Vision and Pattern Recognition, pages 294–299, New York City, June 15–17 1993.
Wolfgang Feiger. How interactive visualization can benefit from multidimensional input devices. In Proceedings of the SPIE - The International Society for Optical Engineering, volume 1668, Visual Data Interpretation, pages 15–24, 1992.
R. C. Gonzalez and P. Wintz. Digital Image Processing. Addison-Wesley, Reading, MA, 2 edition, 1987.
A. Goshtasby, F. Cheng, and B. A. Barsky. B-spline curves and surfaces viewed as digital filters. Computer Vision, Graphics, and Image Processing, 52: 264–275, 1990.
Andrew J. Hanson. The rolling ball. In David Kirk, editor, Graphics Gems III, pages 51–60. Academic Press, 1992.
H. Heuser. Lehrbuch der Analysis, Teil 2. B.G. Teubner Stuttgart, 1983.
X. Y. Jiang and H. Bunke. Ein konturbasierter Ansatz zur Berechnung von Mo-menten. In Informatik Fachberichte 290, pages 143–150. Bernd Radig, October 1991.
B. Klaus and P. Horn. Robot Vision. The MIT Press, McGraw-Hill Book Company, 1986.
M. Kohler and S. Schröter. Handgestenerkennung durch Computersehen. Inform-atik ’98. In this volume.
M. W. Krueger. Artificial Reality. Addison-Wesley, 1981.
J. S. C. Yuan. Mukundan. Estimation of quaternion parameters from two dimen-sional image moments. Graphical Models and Image Processing, 54: 345–350, 1992.
B. A. Myers and M. Rosson. Survey on User Interface Programming. Number (#77629) in RC 17624. IBM Research Division, January 1992.
M. Nadler. A note on coefficients of compass mask coefficients. Computer Vision, Graphic, and Image Processing, 51: 96–101, 1990.
P. Nahim. The theory of measurement of a silhouette description for image pro-cessing and recognition. Pattern Recognition, 6 (2): 85–95, 1974.
D. Rubine. Specifying gestures by example. Computer Graphics, 25 (4): 329–337, 1991.
C. Ware and S. Osborne. Exploration and virtual camera control in virtual three dimensional environments. In ACM Transactions On Computer Graphics, pages 175–183, Oct. 1990.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1998 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Bröckl-Fox, U. (1998). Real-Time 3-D Interaction from Monocular Video Image Flows. In: Dassow, J., Kruse, R. (eds) Informatik ’98. Informatik aktuell. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-72283-7_19
Download citation
DOI: https://doi.org/10.1007/978-3-642-72283-7_19
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-64938-0
Online ISBN: 978-3-642-72283-7
eBook Packages: Springer Book Archive