Skip to main content

Multimodality and Gestures in the Teacher’s Communication

  • Conference paper
Gesture-Based Communication in Human-Computer Interaction (GW 2003)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 2915))

Included in the following conference series:

Abstract

The paper presents a research on the multimodal communication of teachers in the classroom. The “musical score”, a procedure for the analysis of multimodal communication, is used to analyse aspects of the signals produced and of the meanings conveyed by teachers while interacting with their pupils, by focusing not only on affective and interactional aspects, but also on the cognitive effects of nonverbal communication. Finally, the paper shows how, based on this procedure, it is possible to analyse chunks of teachers’ communication, and to distinguish different multimodal communicative styles among different teachers.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Flanders, N.A.: Interaction Analysis in the Classroom: A Manual for Observers. University of Michigan Press, Ann Arbor (1966)

    Google Scholar 

  2. Amidon, E., Hunter, E.: Improving Teaching. Holt, Rinehart & Winston, New York (1966)

    Google Scholar 

  3. Orletti, F.: La conversazione diseguale. Carocci, Roma (2000)

    Google Scholar 

  4. Rosenthal, R., Jacobson, L.: Pygmalion in the Classroom. Holt, Rinehart & Winston (1968)

    Google Scholar 

  5. De Landsheere, G., Delchambre, A.: Les comportements non verbaux de l’einsegnant. Labor, Bruxelles (1979)

    Google Scholar 

  6. Ekman, P., Friesen, W.: Facial Action Coding System. Consulting Psychologist Press, Inc., Palo Alto (1978)

    Google Scholar 

  7. Kendon, A.: Gesticulation and Speech: two aspects of the Process of Utterance. In: Key, M.R. (ed.) The relationship of Verbal and Nonverbal Communication, Mouton, The Hague (1980)

    Google Scholar 

  8. McNeill, D.: Hand and Mind. University of Chicago Press, Chicago (1992)

    Google Scholar 

  9. Poggi, I., Pelachaud, C.: Signals and meanings of gaze in Animated Faces. In: McKevitt, P., O’ Nuallàin, S., Mulvihill, C. (eds.) Language,Vision, and Music. Selected papers from the 8th International Workshop on the Cognitive Science of Natural Language Processing, Galway, 1999, pp. 133–144. John Benjamins, Amsterdam (2002)

    Google Scholar 

  10. Poggi, I.: Le sopracciglia dell’insegnante: un contributo al lessico della faccia. Atti delle XI Giornate di Studio del Gruppo di Fonetica Sperimentale. In: Multimodalità e Multimedialità nella Comunicazione, Padova, November 29- December 1, pp. 57–65. Unipress, Padova (2000)

    Google Scholar 

  11. Johnson, W., Rickel, J., Lester, J.C.: Animated pedagogical Agents: Face-to-face interaction in interactive learning environments. International Journal of Artificial Intelligence in Education 11, 47–78 (2000)

    Google Scholar 

  12. Cassell, J., Sullivan, J., Prevost, S., Churchill, E. (eds.): Embodied Conversational Agents. MIT Press, Cambridge (2000)

    Google Scholar 

  13. Multimodal Communication and Context in Embodied Agents. In: Pelachaud, C., Poggi, I. (eds.) Proceedings of the Workshop W7 at the 5th International Conference on Autonomous Agents, Montreal, Canada, May 29 (2001)

    Google Scholar 

  14. Poggi, I., Magno Caldognetto, E.: Mani che parlano. In: Gesti e Psicologia della comunicazione, Unipress, Padova (1997)

    Google Scholar 

  15. Poggi, I.: Mind Markers. In: Rector, M., Poggi, I., Trigo, N. (eds.) Gestures. Meaning and use, Universidad Fernando Pessoa, Porto (2003)

    Google Scholar 

  16. Mueller, C.: Conventional gestures in speech pauses. In: Mueller, C., Posner, R. (eds.) The semantics and pragmatics of everyday gestures. Berlin Verlag Arno Spitz, Berlin (2003)

    Google Scholar 

  17. Castelfranchi, C., Poggi, I.: Bugie, finzioni, sotterfugi. Per una scienza dell’inganno. Carocci, Roma (1998)

    Google Scholar 

  18. Austin, J.L.: How to do things with words. Oxford University Press, Oxford (1962)

    Google Scholar 

  19. Searle, J.: Speech Acts. Cambridge University Press, Cambridge (1969)

    Google Scholar 

  20. Poggi, I., Pelachaud, C.: Performative facial expressions in Animated Faces. In: Cassell, J., Sullivan, J., Prevost, S., Churchill, E. (eds.) Embodied Conversational Agents. MIT Press, Cambridge (2000)

    Google Scholar 

  21. Cassell, J., Nakano, Y., Bickmore, T., Sidner, C., Rich, C.: Annotating and Generating posture from Discourse Structure in Embodied Conversational Agents. In: Multimodal Communication and Context in Embodied Agents. Proceedings of the Workshop W7 at the 5th International Conference on Autonomous Agents, Montreal, Canada (May 29, 2001)

    Google Scholar 

  22. Payà Canals, M.: Incidental clauses in Spoken Catalan: Prosodic Characteristics and Pragmatic Function. In: Bel, B., Marlien, I. (eds.) Proceedings of the Speech Prosody 2002 Conference, April 11-13, pp. 559–562. Aix-en-Provence, Laboratoire Parole et Langage (2002)

    Google Scholar 

  23. Ekman, P., Friesen, W.: The repertoire of nonverbal behavior. Semiotica 1, 49–98 (1969)

    Google Scholar 

  24. Magno Caldognetto, E., Poggi, I.: Creative iconic gestures: some evidence from Aphasics. In: Simone, R. (ed.) Iconicity in Language, John Benjamins, Amsterdam (1995)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2004 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Merola, G., Poggi, I. (2004). Multimodality and Gestures in the Teacher’s Communication. In: Camurri, A., Volpe, G. (eds) Gesture-Based Communication in Human-Computer Interaction. GW 2003. Lecture Notes in Computer Science(), vol 2915. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24598-8_10

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-24598-8_10

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-21072-6

  • Online ISBN: 978-3-540-24598-8

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics