Skip to main content
SpringerLink
Log in

Conversational Involvement and Synchronous Nonverbal Behaviour

  • Conference paper
Cognitive Behavioural Systems

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 7403))

Abstract

Measuring the quality of an interaction by means of low-level cues has been the topic of many studies in the last couple of years. In this study we propose a novel method for conversation-quality-assessment. We first test whether manual ratings of conversational involvement and automatic estimation of synchronisation of facial activity are correlated. We hypothesise that the higher the synchrony the higher the involvement. We compare two different synchronisation measures. The first measure is defined as the similarity of facial activity at a given point in time. The second is based on dependence analyses between the facial activity time series of two interlocutors. We found that dependence measure correlates more with conversational involvement than similarity measure.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Altmann, U.: Investigation of Movement Synchrony Using Windowed Cross-Lagged Regression. In: Esposito, A. (ed.) Communication and Enactment 2010. LNCS, vol. 6800, pp. 335–345. Springer, Heidelberg (2011)

    Chapter  Google Scholar 

  2. Altmann, U.: Synchronization of nonverbal behavior and it’s identification with time series analysis – further development and application [Synchronisation nonverbalen Verhaltens –Weiterentwicklung und Anwendung zeitreihenanalytischer Identifikationsverfahren ]. Ph.D. thesis, Friedrich-Schiller-Universität Jena, Jena, Germany (2012)

    Google Scholar 

  3. Bernieri, F.J., Reznick, J.S., Rosenthal, R.: Synchrony, pseudosynchrony, and dissynchrony: Measuring the entrainment process in mother-infant dyads. Journal of Personality and Social Psychology 54(2), 243–253 (1988)

    Article  Google Scholar 

  4. Chartrand, T.L., Bargh, J.A.: The chameleon effect: The perception-behavior link and social interaction. Journal of Personality and Social Psychology 76(6), 893–910 (1999)

    Article  Google Scholar 

  5. Coker, D.A., Burgoon, J.K.: The nature of conversational involvement and nonverbal encoding patterns. Human Communication Research 13(4), 463–494 (1987)

    Article  Google Scholar 

  6. Coulston, R., Oviatt, S.L., Darves, C.: Amplitude convergence in children’s conversational speech with animated personas. In: Hansen, J., Pellom, B. (eds.) Proceedings of the International Conference on Spoken Language Processing, vol. 4, pp. 2689–2692. Casual Prod. Ltd. (2002)

    Google Scholar 

  7. De Looze, C., Oertel, C., Rauzy, S., Campbell, N.: Measuring dynamics of mimicry by means of prosodic cues in conversational speech. In: Lee, W.S., Zee, E. (eds.) Proceedings of the 17th International Congress of Phonetic Sciences (ICPhS XVII), pp. 1294–1297 (2011)

    Google Scholar 

  8. Edlund, J., Heldner, M., Hirschberg, J.: Pause and gap length in face-to-face interaction. In: Proceedings of INTERSPEECH 2009, Brighton, United Kingdom, pp. 2779–2782 (2009)

    Google Scholar 

  9. Feldman, R.: Parent-infant synchrony and the construction of shared timing; physiological precursors, developmental outcomes, and risk conditions. Journal of Child Psychology and Psychiatry 48(3/4), 329–354 (2007)

    Article  Google Scholar 

  10. Field, T.M., Greenwald, P., Morrow, C., Healy, B., Foster, T., Guthertz, M., Frost, P.: Behavior state matching during interactions of preadolescent friends versus acquaintances. Developmental Psychology 28(2), 242–250 (1992)

    Article  Google Scholar 

  11. Gottman, J.M., Ringland, J.T.: The analysis of dominance and bidirectionality in social development. Child Development 52(1), 393–412 (1981)

    Article  Google Scholar 

  12. Guéguen, N., Jacob, C., Martin, J.: Mimicry in social interaction: Its effect an human judgment and behavior. European Journal of Social Sciences 8(2), 253–259 (2009)

    Google Scholar 

  13. Guerrero, L.K.: Nonverbal involvement across interaction with same-sex friends, opposite-sex friends and romantic partners: Consistency or change? Journal of Social and Personal Relationships 14(1), 31–58 (1997)

    Article  Google Scholar 

  14. Harrist, A.W., Waugh, R.M.: Dyadic synchrony: Its structure and function in children’s development. Developmental Review 22(4), 555–592 (2002)

    Article  Google Scholar 

  15. Katsumata, G., Ogawa, H., Komori, M.: Evaluation of students’ interests using analysis of speech-driven body movement entrainment. Technical Report of The Institute of Electronics, Information and Communication Engineers 109(27), 107–112 (2009), http://ci.nii.ac.jp/naid/110007333873/en/

    Google Scholar 

  16. Kopp, S.: Social resonance and embodied coordination in face-to-face conversation with artificial interlocutors. Speech Communication 52(6), 587–597 (2010)

    Article  Google Scholar 

  17. Kupferberg, A., Glasauer, S., Huber, M., Rickert, M., Knoll, A., Brandt, T.: Biological movement increases acceptance of humanoid robots as human partners in motor interaction. AI & Society, Online First 26(4), 339–345 (2011)

    Article  Google Scholar 

  18. La France, M., Broadbent, M.: Group rapport: Posture sharing as a nonverbal indicator. Group & Organization Management 1(3), 328–333 (1976)

    Article  Google Scholar 

  19. Marin, L., Issartel, J., Chaminade, T.: Interpersonal motor coordination. From human-human to human-robot interactions. Interaction Studies 10(3), 479–504 (2009)

    Article  Google Scholar 

  20. Nagaoka, C., Komori, M.: Body movement synchrony in psychotherapeutic counseling: A study using the video-based quantification method. IEICE Transactions on Information and Systems E91-D(6), 1634–1640 (2008)

    Article  Google Scholar 

  21. Oertel, C.: Identification of cues for the automatic detection of hotspots, Universität Bielefeld (2010)

    Google Scholar 

  22. Oertel, C., Cummings, F., Campbell, N., Edlund, J., Wagner, P.: D64: A corpus of richly recorded conversational interaction. In: Kipp, M., Martin, J.C., Paggio, P., Heylen, D. (eds.) Proceedings of LREC 2010 Workshop on Multimodal Corpora: Advances in Capturing, Coding and Analyzing Multimodality, pp. 27–30 (2010)

    Google Scholar 

  23. Oertel, C., De Looze, C., Scherer, S., Windmann, A., Wagner, P., Campbell, N.: Towards the Automatic Detection of Involvement in Conversation. In: Esposito, A., Vinciarelli, A., Vicsi, K., Pelachaud, C., Nijholt, A. (eds.) Communication and Enactment 2010. LNCS, vol. 6800, pp. 163–170. Springer, Heidelberg (2011)

    Chapter  Google Scholar 

  24. Oertel, C., Scherer, S., Campbell, N.: On the use of multimodal cues for the prediction of involvement in spontaneous conversation. In: Proceedings of Interspeech 2011, Florence, Italy, pp. 1541–1544 (2011)

    Google Scholar 

  25. Patterson, M.L.: More Than Words: The Power of Nonverbal Communication. Aresta (2010)

    Google Scholar 

  26. Ramseyer, F., Tschacher, W.: Nonverbal synchrony in psychotherapy: Coordinated body-movement reects relationship quality and outcome. Journal of Consulting and Clinical Psychology 79(3), 284–295 (2011)

    Article  Google Scholar 

  27. Rasting, M., Beutel, M.E.: Dyadic affective interactive patterns in the int ake interview as a predictor of outcome. Psychotherapy Research 15(3), 188–198 (2005)

    Article  Google Scholar 

  28. Rogers, S.J., Hepburn, S.L., Stackhouse, T., Wehner, E.: Imitation performance in toddlers with autism and those with other developmental disorders. Journal of Child Psychology and Psychiatry 44(5), 763–781 (2003)

    Article  Google Scholar 

  29. de Roten, Y., Fivaz-Depeursinge, E., Stern, D.J., Darwish, J., Corboz-Warnery, A.: Body and gaze formations and the communicational alliance in couple-therapist triads. Psychotherapy Research 10, 30–46 (2000)

    Article  Google Scholar 

  30. Scherer, S., Campbell, N.: Multimodal laughter detection in atural discourses. In: Ritter, H., Sagerer, G., Steil, J. (eds.) Proceedings of the 3rd International Workshop on Human-centered Robotic Systems (HCRS 2009), pp. 111–121 (2009)

    Google Scholar 

  31. Viola, P., Jones, M.J.: Robust real-time face detection. International Journal of Computer Vision 57(2), 137–154 (2004)

    Article  Google Scholar 

  32. Yu, C., Aoki, P.M., Woodruff, A.: Detecting user engagement in everyday conversations. In: Proceedings of the 8th International Conference on Spoken Language Processing (ICSLP), pp. 1329–1332 (2004)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Institute of Psychology, Friedrich-Schiller-University Jena, Germany

    Uwe Altmann

  2. Speech Communication Lab, Trinity College, Dublin, Ireland

    Catharine Oertel & Nick Campbell

  3. Department of Speech, Music and Hearing, KTH, Sweden

    Catharine Oertel

Authors
  1. Uwe Altmann
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Catharine Oertel
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Nick Campbell
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Psychology, and IIASS, Seconda Università degli Studi di Napoli, Italy

    Anna Esposito

  2. Istituto Nazionale di Geofisica e Vulcanologia, sezione di Napoli Osservatorio Vesuviano, Napoli, Italy

    Antonietta M. Esposito

  3. School of Computing Science, University of Glasgow, Glasgow, UK

    Alessandro Vinciarelli

  4. Laboratory of Acoustics and Speech Communication, Technische Universität Dresden, 01062, Dresden, Germany

    Rüdiger Hoffmann

  5. Dept. of Humanities and Social Sciences, Anatolia College/ACT, P.O. Box 21021, 55510, Pylaia, Greece

    Vincent C. Müller

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Altmann, U., Oertel, C., Campbell, N. (2012). Conversational Involvement and Synchronous Nonverbal Behaviour. In: Esposito, A., Esposito, A.M., Vinciarelli, A., Hoffmann, R., Müller, V.C. (eds) Cognitive Behavioural Systems. Lecture Notes in Computer Science, vol 7403. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-34584-5_30

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-34584-5_30

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-34583-8

  • Online ISBN: 978-3-642-34584-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation