Skip to main content

Gesture recognition of the upper limbs — From signal to symbol

  • Conference paper
  • First Online:
Gesture and Sign Language in Human-Computer Interaction (GW 1997)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 1371))

Included in the following conference series:

Abstract

To recognise gestures performed by people without disabilities during verbal communication —so-called coverbal gestures —a flexible system with task-oriented design is proposed. The issue of flexibility is addressed via different kinds of modules —grasped as agents —, which are grouped in different levels. They can be easily reconfigured or rewritten to suit another application. This system of layered agents uses an abstract body-model to transform the up-taken data from the sixdegree-of-freedom-sensors, and the data gloves, to a first-level symbolic description of gesture features. In a first integration step the first-level symbols are integrated to second-level symbols describing a whole gesture. Second-level symbolic gesture descriptions are the entities which can be integrated with speech tokens to form multi-modal utterances.

Scholarship granted by ”Graduiertenkolleg Aufgabenorientierte Kommunikation” of the Deutsche Forschungsgemeinschaft (DFG)

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Douglas E. Comer and David L. Stevens. Internetworking with TCP/IP: Client-Server Programming and Applications; BSD socket version, volume III. Prentice-Hall International., Englewood Cliffs, NJ, 1993.

    Google Scholar 

  2. Renato Contini. Body segment parameters, part ii. Artificial Limbs, 16(1):1–19, Spring 1972.

    Google Scholar 

  3. James L. Crowley and JoËlle Coutaz. Vision for man machine interaction. In Proceedings of Engineering Human Computer Interaction (EHCI’95 Grand Targhee, August 1995), pages 28–45, Chapman and Hall, London, August 1995.

    Google Scholar 

  4. H. Cruse and U. Steinkühler. Solutions of the direct and inverse kinematic problems by a common algorithm based on the mean of multiple computations. Biological Cybernetics, 69:345–351, 1993.

    Article  Google Scholar 

  5. J. Denavit and R. S. Hartenberg. A kinematic notation for lower-pair mechanisms based on matrices. ASME Journal of Applied Mechanics, 77:215–221, 1955.

    MathSciNet  Google Scholar 

  6. Philip A. Harling and Alistair D. N. Edwards. Hand tension as a gesture segmentation cue. In Philip A. Harling and Alistair D. N. Edwards, editors, Progress in Gestural Interaction: Proceedings of Gesture Workshop ’96, pages 75–87, Springer, Berlin et al., 1997.

    Google Scholar 

  7. Hyeongseok Ko. Kinematic and Dynamic Techniques for Analysing, Predicting, and Animating Human Locomotion. PhD thesis, University of Pennsylvania, 1994. 8. Marc Erich Latoschik and Ipke Wachsmuth. Exploiting distant pointing gestures for object selection in a virtual environment. same volume.

    Google Scholar 

  8. Jardan Lenarčič and Andreja Umek. Simple model of human arm reachable workspace. IEEE Transactions on Systems, Man, and Cybernetics, 24(8):1239–1246, August 1994.

    Article  Google Scholar 

  9. Marvin Lee Minsky. The Society of Mind. Simon and Schuster, New York, NY, 1985.

    Google Scholar 

  10. NASA: U.S. National Aeronautics and Space Administration, Lyndon B. Johnson Space Center, Houston, TX Man-System Integration Standards (MSIS): NASA-STD-3000 I-III Revision B, August 1994.

    Google Scholar 

  11. Richard P. Paul. Robot Manipulators. MIT Press, Cambridge, MA, 1981.

    Google Scholar 

  12. Ernst Pöppel. A hierarchical model of temporal perception. Trends in Cognitive Sciences, 1(2):56–61, May 1997.

    Article  Google Scholar 

  13. Siegmund Prillwitz, Regina Leven, Heiko Zienert, Thomas Hamke, and Jan Henning. HamNoSys Version 2.0: Hamburg Notation System for Sign Languages: An Introductory Guide, volume 5 of International Studies on Sign Language and Communication of the Deaf. Signum Press, Hamburg, 1989.

    Google Scholar 

  14. Ulrich Steinkühler. MMC-Modelle zur Lösung kinematischer Aufgabenstellungen eines redundanten Manipulators. Dissertation, Universität Bielefeld, Fakultät für Mathematik, 1994.

    Google Scholar 

  15. W. Richard Stevens. The Protocols, volume 1 of TCP/IP Illustrated. Addison-Wesley, Reading, MA, 1994.

    Google Scholar 

  16. Tsuneo Yoshikawa. Foundations of Robotics: analysis and control. MIT Press, Cambridge, MA, 1990.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Ipke Wachsmuth Martin Fröhlich

Rights and permissions

Reprints and permissions

Copyright information

© 1998 Springer-Verlag

About this paper

Cite this paper

Fröhlich, M., Wachsmuth, I. (1998). Gesture recognition of the upper limbs — From signal to symbol. In: Wachsmuth, I., Fröhlich, M. (eds) Gesture and Sign Language in Human-Computer Interaction. GW 1997. Lecture Notes in Computer Science, vol 1371. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0052998

Download citation

  • DOI: https://doi.org/10.1007/BFb0052998

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-64424-8

  • Online ISBN: 978-3-540-69782-4

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics