Abstract
To recognise gestures performed by people without disabilities during verbal communication —so-called coverbal gestures —a flexible system with task-oriented design is proposed. The issue of flexibility is addressed via different kinds of modules —grasped as agents —, which are grouped in different levels. They can be easily reconfigured or rewritten to suit another application. This system of layered agents uses an abstract body-model to transform the up-taken data from the sixdegree-of-freedom-sensors, and the data gloves, to a first-level symbolic description of gesture features. In a first integration step the first-level symbols are integrated to second-level symbols describing a whole gesture. Second-level symbolic gesture descriptions are the entities which can be integrated with speech tokens to form multi-modal utterances.
Scholarship granted by ”Graduiertenkolleg Aufgabenorientierte Kommunikation” of the Deutsche Forschungsgemeinschaft (DFG)
Preview
Unable to display preview. Download preview PDF.
References
Douglas E. Comer and David L. Stevens. Internetworking with TCP/IP: Client-Server Programming and Applications; BSD socket version, volume III. Prentice-Hall International., Englewood Cliffs, NJ, 1993.
Renato Contini. Body segment parameters, part ii. Artificial Limbs, 16(1):1–19, Spring 1972.
James L. Crowley and JoËlle Coutaz. Vision for man machine interaction. In Proceedings of Engineering Human Computer Interaction (EHCI’95 Grand Targhee, August 1995), pages 28–45, Chapman and Hall, London, August 1995.
H. Cruse and U. Steinkühler. Solutions of the direct and inverse kinematic problems by a common algorithm based on the mean of multiple computations. Biological Cybernetics, 69:345–351, 1993.
J. Denavit and R. S. Hartenberg. A kinematic notation for lower-pair mechanisms based on matrices. ASME Journal of Applied Mechanics, 77:215–221, 1955.
Philip A. Harling and Alistair D. N. Edwards. Hand tension as a gesture segmentation cue. In Philip A. Harling and Alistair D. N. Edwards, editors, Progress in Gestural Interaction: Proceedings of Gesture Workshop ’96, pages 75–87, Springer, Berlin et al., 1997.
Hyeongseok Ko. Kinematic and Dynamic Techniques for Analysing, Predicting, and Animating Human Locomotion. PhD thesis, University of Pennsylvania, 1994. 8. Marc Erich Latoschik and Ipke Wachsmuth. Exploiting distant pointing gestures for object selection in a virtual environment. same volume.
Jardan Lenarčič and Andreja Umek. Simple model of human arm reachable workspace. IEEE Transactions on Systems, Man, and Cybernetics, 24(8):1239–1246, August 1994.
Marvin Lee Minsky. The Society of Mind. Simon and Schuster, New York, NY, 1985.
NASA: U.S. National Aeronautics and Space Administration, Lyndon B. Johnson Space Center, Houston, TX Man-System Integration Standards (MSIS): NASA-STD-3000 I-III Revision B, August 1994.
Richard P. Paul. Robot Manipulators. MIT Press, Cambridge, MA, 1981.
Ernst Pöppel. A hierarchical model of temporal perception. Trends in Cognitive Sciences, 1(2):56–61, May 1997.
Siegmund Prillwitz, Regina Leven, Heiko Zienert, Thomas Hamke, and Jan Henning. HamNoSys Version 2.0: Hamburg Notation System for Sign Languages: An Introductory Guide, volume 5 of International Studies on Sign Language and Communication of the Deaf. Signum Press, Hamburg, 1989.
Ulrich Steinkühler. MMC-Modelle zur Lösung kinematischer Aufgabenstellungen eines redundanten Manipulators. Dissertation, Universität Bielefeld, Fakultät für Mathematik, 1994.
W. Richard Stevens. The Protocols, volume 1 of TCP/IP Illustrated. Addison-Wesley, Reading, MA, 1994.
Tsuneo Yoshikawa. Foundations of Robotics: analysis and control. MIT Press, Cambridge, MA, 1990.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1998 Springer-Verlag
About this paper
Cite this paper
Fröhlich, M., Wachsmuth, I. (1998). Gesture recognition of the upper limbs — From signal to symbol. In: Wachsmuth, I., Fröhlich, M. (eds) Gesture and Sign Language in Human-Computer Interaction. GW 1997. Lecture Notes in Computer Science, vol 1371. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0052998
Download citation
DOI: https://doi.org/10.1007/BFb0052998
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-64424-8
Online ISBN: 978-3-540-69782-4
eBook Packages: Springer Book Archive