Skip to main content
SpringerLink
Log in
Book cover

Analysis of Verbal and Nonverbal Communication and Enactment. The Processing Issues pp 309–315Cite as

Annotating Non-verbal Behaviours in Informal Interactions

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 6800))

Abstract

This paper deals with the annotations of non-verbal behaviours in a Danish multimodal corpus of naturally occurring interactions between people who are well-acquainted. The main goal of this work is to provide formally annotated data for describing and modelling various communicative phenomena in this corpus type. In the paper we describe the annotation model and present a first analysis of the annotated data focusing on feedback-related non-verbal behaviours. The data confirm that head movements are the most common feedback-related non-verbal behaviours, but they indicate also that there are differences in the way feedback is expressed in two-party and in three-party interactions.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Allwood, J., Lu, J.: Chinese and Swedish multimodal communicative feedback. In: Abstracts of the 5th Conference on Multimodality, Sydney, pp. 19–20 (2010)

    Google Scholar 

  2. Allwood, J., Cerrato, L., Jokinen, K., Navarretta, C., Paggio, P.: The MUMIN coding scheme for the annotation of feedback, turn management and sequencing phenomena. In: Martin, J.-C., et al. (eds.) Multimodal Corpora for Modelling Human Multimodal Behaviour, Special Issue of the International Journal of Language Resources and Evaluation, pp. 273–287. Springer, Heidelberg (2007)

    Google Scholar 

  3. Argyle, M.: Bodily Communication. Methuen, New York (1975)

    Google Scholar 

  4. Boersma, P., Weenink, D.: Praat: doing phonetics by computer (version 5.1.05), http://www.praat.org/ (retrieved May 1, 2009)

  5. Cerrato, L.: Investigating Communicative Feedback Phenomena across Languages and Modalities. Ph.D. thesis, Stockholm, KTH, Speech and Music Communication (2007)

    Google Scholar 

  6. Duncan, S.: Some signals and rules for taking speaking turns in conversations. Journal of Personality and Social Psychology 23, 283–292 (1972)

    Article  Google Scholar 

  7. Jokinen, K., Navarretta, C., Paggio, P.: Distinguishing the communicative functions of gestures. In: Proceedings of the 5th Joint Workshop on Machine Learning and Multimodal Interaction. Springer, Heidelberg (2008)

    Google Scholar 

  8. Kendon, A.: Gesture: Visible Action as Utterance. Cambridge University Press, Cambridge (2004)

    Book  Google Scholar 

  9. Kipp, M.: Gesture Generation by Imitation - From Human Behavior to Computer Character Animation. Ph.D. thesis, Saarland University, Saarbruecken, Germany, Boca Raton, Florida, dissertation.com (2004)

    Google Scholar 

  10. Koutsombogera, M., Touribaba, L., Papageorgiou, H.: Multimodality in Conversation Analysis: A Case of Greek TV Interviews. In: Proceedings of the LREC Workshop on Multimodal Coorpora from Models of Natural Interaction to Systems and Applications, Marrakesh, pp. 12–15 (2008)

    Google Scholar 

  11. MacWhinney, B.: The CHILDES Project: Tools for Analyzing Talk. Lawrence Erlbaum Associates, Mahwah (2000)

    Google Scholar 

  12. McClave, E.: Linguistic functions of head movements in the context of speech. Journal of Pragmatics 32, 855–878 (2000)

    Article  Google Scholar 

  13. McNeill, D.: Hand and mind: What gestures reveal about thought. University of Chicago Press, Chicago (2000)

    Google Scholar 

  14. Morency, L., Sidner, C., Lee, C., Darrell, T.: Contextual Recognition of Head Gestures. In: Proceedings of the International Conference on Multi-modal Interfaces (2005)

    Google Scholar 

  15. Navarretta, C., Ahlsn, E., Allwood, J., Jokinen, K., Paggio, P.: Creating Comparable Multimodal Corpora for Nordic Languages. In: Proceedings of the 18th Nordic Conference of Computational Linguistics (Nodalida 2011), Riga, Latvia, May 11-13, pp. 153–160 (2011)

    Google Scholar 

  16. Navarretta, C., Paggio, P.: Classification of Feedback Expressions in Multimodal Data. In: Proceedings of ACL 2010 Uppsala, Sweden, pp. 318–324 (2010)

    Google Scholar 

  17. Paggio, P., Navarretta, C.: Head movements, facial expressions and feedback in first encounters interactions. In: Proceedings of HCI 2011, Orlando Florida (to appear, July 2011)

    Google Scholar 

  18. Peirce, C.S.: Collected Papers of Charles Sanders Peirce. In: Hartshorne, C., Weiss, P., Burks, A. (eds.), vol. 8, Harvard University Press, Cambridge (1931-1958)

    Google Scholar 

  19. Poggi, I., Magno Caldognetto, E.: A score for the analysis of gestures in multimodal communication. In: Messing, L.(ed.) Proceedings of the Workshop on the Integration of Gesture and Language in Speech. Applied Science and Engineering Laboratories. Newark and Wilmington, Delaware, pp. 235–244 (1996)

    Google Scholar 

  20. Rehm, M., Nakano, Y., Andre, E., Nishida, T.: Culture-Specific First Meeting Encounters between Virtual Agents. In: Prendinger, H., Lester, J.C., Ishizuka, M. (eds.) IVA 2008. LNCS (LNAI), vol. 5208, pp. 223–236. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  21. Yngve, V.: On getting a word in edgewise. In: Papers from the sixth regional meeting of the Chicago Linguistic Society, pp. 567–578 (1970)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Centre for Language Technology, University of Copenhagen, Njalsgade 140, build. 25, 4., 2300, Copenhagen S, Denmark

    Costanza Navarretta

Authors
  1. Costanza Navarretta
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Dept. of Psychology and IIASS, International Institute for Advanced Scientific Studies, Second University of Naples, Vietri sul Mare, SA, Italy

    Anna Esposito

  2. School of Computing Science, University of Glasgow, Glasgow, UK

    Alessandro Vinciarelli

  3. Department of Telecommunication and Media Informatics, Laboratory of Speech Acoustics, Budapest University of Technology and Economics, 1117, Budapest, Hungary

    Klára Vicsi

  4. TELECOM ParisTech, CNRS-LTCI UMR 5141, 75014, Paris, France

    Catherine Pelachaud

  5. Faculty of Electrical Engineering, Mathematics and Computer Science, University of Twente, 7500 AE, Enschede, The Netherlands

    Anton Nijholt

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Navarretta, C. (2011). Annotating Non-verbal Behaviours in Informal Interactions. In: Esposito, A., Vinciarelli, A., Vicsi, K., Pelachaud, C., Nijholt, A. (eds) Analysis of Verbal and Nonverbal Communication and Enactment. The Processing Issues. Lecture Notes in Computer Science, vol 6800. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-25775-9_29

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-25775-9_29

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-25774-2

  • Online ISBN: 978-3-642-25775-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation