Skip to main content
SpringerLink
Log in

The analysis of embodied communicative feedback in multimodal corpora: a prerequisite for behavior simulation

  • Published:
Language Resources and Evaluation Aims and scope Submit manuscript

Abstract

Communicative feedback refers to unobtrusive (usually short) vocal or bodily expressions whereby a recipient of information can inform a contributor of information about whether he/she is able and willing to communicate, perceive the information, and understand the information. This paper provides a theory for embodied communicative feedback, describing the different dimensions and features involved. It also provides a corpus analysis part, describing a first data coding and analysis method geared to find the features postulated by the theory. The corpus analysis part describes different methods and statistical procedures and discusses their applicability and the possible insights gained with these methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  • Allwood, J. (1976). Linguistic communication as action and cooperation. Gothenburg monographs in linguistics 2. Göteborg University, Department of Linguistics.

  • Allwood, J. (2000). Structure of dialog. In M. Taylor, D. Bouwhuis, & F. Neel (Eds.), The structure of multimodal dialogue II (pp. 3–24). Amsterdam: Benjamins.

    Google Scholar 

  • Allwood, J., Cerrato, L., Dybjær, L., Jokinen, K., Navaretta, C., & Paggio, P. (2005). The MUMIN Multimodal Coding Scheme. NorFA Yearbook 2005.

  • Allwood, J., NivreJ., & Ahlsén, E. (1992). On the semantics and pragmatics of linguistic feedback. Journal of Semantics, 9(1), 1–26.

    Article  Google Scholar 

  • Bakeman, R., & Quera, V. (1995). Analyzing interaction: Sequential analysis with SDIS and GSEQ. New York: Cambridge University Press.

    Google Scholar 

  • Grammer K., Honda R., Schmitt A., & Jütte A. (1999). Fuzziness of nonverbal courtship communication. Unblurred by motion energy detection. Journal of Personality and Social Psychology, 77(3), 487–508.

    Article  Google Scholar 

  • Grammer K., Kruck K., Juette A., & Fink B. (2000): Non-verbal behavior as courtship signals: The role of control and choice in selecting partners. Evolution and Human Behavior, 21, 371–390.

    Article  Google Scholar 

  • Kopp, S., Gesellensetter, L., Krämer, N., & Wachsmuth, I. (2005): A conversational agents as museum guide: design and evaluation of a real-world application. In Panayiotopoulos et al. (Eds.) Intelligent Virtual Agents, LNAI 3661 (pp. 329–343). Berlin: Springer-Verlag.

  • Kopp, S., Allwood, J., Grammer, K., Ahlsen, E., & Stocksmeier, T. (2008): Modeling Embodied Feedback With Virtual Humans. In I. Wachsmuth & G. Knoblich (Eds.), Modeling embodied communication in robots and virtual humans, LNAI 4930. Springer-Verlag.

  • Magnusson, M. S. (1996). Hidden real-time patterns in intra- and inter-individual behavior: description and detection. European Journal of Psychology Assessment, 12, 112–123.

    Article  Google Scholar 

  • Magnusson, M. S. (2000). Discovering hidden time patterns in behavior: T-patterns and their detection. Behavior Research Methods and Instrumentation, 32, 93–110.

    Google Scholar 

  • Peirce, C. S. (1931). In C. Hartshorne, P. Weiss & A. Burks (Eds.), Collected Papers of Charles Sanders Peirce, 1931–1958, 8 vols. Cambridge, Mass.: Harvard University Press.

  • Popper, K. (1959). The logic of scientific discovery (trans. Logik der Forschung). London: Hutchinson.

  • Scherer, K. T. (1999). Appraisal theory. In T. Dalgleish & M. J. Power (Eds.), Handbook of emotion and cognition (pp. 637–663). Chichester: New York.

    Chapter  Google Scholar 

  • Ward, N., & Tsukahara, W. (2000). Prosodic features which cue back-channel responses in English and Japanese. Journal of Pragmatics, 32, 1177–1207.

    Article  Google Scholar 

  • Wiener, N. (1948). Cybernetics or control and communication in the animal and the machine. MIT Press.

Download references

Acknowledgements

We thank the Ludwig Boltzmann Institute for Urban Ethology in Vienna for help with data collection and transcription, the Department of Linguistics and SSKKII Center for Cognitive Science, Göteborg University, and the ZiF Center of Interdisciplinary Research in Bielefeld/Germany.

Author information

Authors and Affiliations

  1. Department of Linguistics, Göteborg University, Box 200, 40530, Göteborg, Sweden

    Jens Allwood & Elisabeth Ahlsén

  2. Artificial Intelligence Group, Bielefeld University, P.O. 100131, 33501, Bielefeld, Germany

    Stefan Kopp

  3. Ludwig Boltzmann Institute for Urban Ethology, Department of Anthropology, University of Vienna, Althanstrasse 14, 1090, Vienna, Austria

    Karl Grammer, Elisabeth Oberzaucher & Markus Koppensteiner

Authors
  1. Jens Allwood
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Stefan Kopp
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Karl Grammer
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Elisabeth Ahlsén
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Elisabeth Oberzaucher
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Markus Koppensteiner
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Elisabeth Oberzaucher.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Allwood, J., Kopp, S., Grammer, K. et al. The analysis of embodied communicative feedback in multimodal corpora: a prerequisite for behavior simulation. Lang Resources & Evaluation 41, 255–272 (2007). https://doi.org/10.1007/s10579-007-9056-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10579-007-9056-2

Keywords

Search

Navigation