Skip to main content
SpringerLink
Log in

Labeling of Gestures in SmartKom - The Coding System

  • Conference paper
  • First Online:
Book cover Gesture and Sign Language in Human-Computer Interaction (GW 2001)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 2298))

Included in the following conference series:

Abstract

The SmartKom project is concerned with the development of an intelligent computer-user interface that allows almost natural communication and gesture input. For the training of the gesture analyzer, data is collected in so called Wizard-of-Oz experiments. Recordings of subjects are made and labeled off-line with respect to the gestures that were used. This article is concerned with the coding of these gestures. The presented concept is the first step in the development of a practical gesture coding system specifically designed for the description of communicative and non-communicative gestures that typically show up in human-machine dialogues. After a short overview over the development process and the special requirements for the project, the labels will be described in detail. We will conclude with a short outline of open points and differences to the well-known taxonomy for gestures of Ekman [1]. Keywords: Human-Machine interaction, annotation of corpora, multimodal dialogue systems, gesture coding system.

http://smartkom.dfki.de/index.html

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Ekman, P. (1999): Emotional and conversational nonverbal signals. In Messing, L. S., & Campbell, R. (Eds.), Gesture, speech and sign (p. 45–55). New York: Oxford University Press.

    Google Scholar 

  2. Faßnacht, G. (1979): Systematische Verhaltensbeobachtung. München: Reinhardt.

    Google Scholar 

  3. Beringer, N., Oppermann, D., & Burger, S. (2000): Transliteration spontan-sprachlicher Daten-Lexikon der Transliterationskonventionen. SmartKom Technisches Dokument Nr. 2.

    Google Scholar 

  4. Efron, D. (1941): Gesture and environment. Morningside Heights, NY: King’s Crown Press.

    Google Scholar 

  5. Bales, R. F. (1970):Personality and interpersonal behavior. New York: Holt.

    Google Scholar 

  6. McGrew, W. C. (1972):An ethological study of children’s behavior. New York: Academic Press.

    Google Scholar 

  7. Ekman, P., & Friesen, W. V. (1972): Hand movements. Journal of communication, 22, p.353–374.

    Article  Google Scholar 

  8. Wallbott, H. G. (1982): Bewegungsstil und Bewegungsqualität. Weinheim, Basel: Beltz.

    Google Scholar 

  9. McNeill, D. (1992): Hand and Mind: What Gestures Reveal about Thought. Chicago: University of Chicago Press.

    Google Scholar 

  10. Laban, R. (1956): Principles of Dance and Movement Notation. London.

    Google Scholar 

  11. Jönsson, A., & Dahlbäck, N. (1988): Talking to a computer is not like talking to your best friend. Proc. of the First Scandinavian Conference on Artificial Intelligence, Tromso, Norway, p. 297–307.

    Google Scholar 

  12. Krout, M. H. (1935): Autistic gestures: An experimental study in symbolic movement. Psychological Monographs, 46, p.119–120.

    Google Scholar 

  13. Rosenfeld, H. M. (1966): Instrumental affiliative functions of facial and gestural expressions. Journal of Personality and Social Psychology, 4, p. 65–72.

    Article  Google Scholar 

  14. Mahl, G. F. (1977): Body movement, ideation, and verbalization during psycho-analysis. In: N. Freedman & S. Grand (Eds.), Communicative structures and psychic structures. New York: Plenum Press, p. 291–310.

    Google Scholar 

  15. Freedman, N., Blass, T., Rifkin, A. & Quitkin, F. (1973): Body movement and the verbal encoding of aggressive affect. Journal of Personality and Social Psychology, p. 72–83.

    Google Scholar 

  16. Sainsbury, P., & Wood, E. (1977): Measuring gesture: Its cultural and clinical correlates. Psychological Medicine, 7, p. 63–72.

    Article  Google Scholar 

  17. Kendon, A. (1980): Gesticulation and speech: two aspects of the process. In M. R. Key (ed.), The Relation Between Verbal and Nonverbal Communication. The Hague: Mouton.

    Google Scholar 

  18. Dahlbäck, N., Jönsson A., & Ahrenberg, L. (1993): Wizard of Oz Studies-Why and How. Knowledge-Based Systems, 6 (4), p. 258–266.

    Article  Google Scholar 

  19. Friesen, W. V., Ekman, P., & Wallbott, H.G. (1979): Measuring hand movements. Journal of Nonverbal Behavior, 1, P. 97–112.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Institute of Phonetics and Speech Communication, Schellingstr. 3, 80799, Munich, Germany

    Silke Steininger, Bernd Lindemann & Thorsten Paetzold

Authors
  1. Silke Steininger
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Bernd Lindemann
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Thorsten Paetzold
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Technische Fakultät, Universität Bielefeld, 33594, Bielefeld, Germany

    Ipke Wachsmuth  & Timo Sowa  & 

Rights and permissions

Reprints and permissions

Copyright information

© 2002 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Steininger, S., Lindemann, B., Paetzold, T. (2002). Labeling of Gestures in SmartKom - The Coding System. In: Wachsmuth, I., Sowa, T. (eds) Gesture and Sign Language in Human-Computer Interaction. GW 2001. Lecture Notes in Computer Science(), vol 2298. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-47873-6_24

Download citation

  • DOI: https://doi.org/10.1007/3-540-47873-6_24

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-43678-2

  • Online ISBN: 978-3-540-47873-7

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation