Skip to main content

Acoustic-Prosodic Entrainment in Multi-party Spoken Dialogues: Does Simple Averaging Extend Existing Pair Measures Properly?

  • Chapter
  • First Online:
Advanced Social Interaction with Agents

Part of the book series: Lecture Notes in Electrical Engineering ((LNEE,volume 510))

  • 971 Accesses

Abstract

Linguistic entrainment, the tendency of interlocutors to become similar to each other during spoken interaction, is an important characteristic of human speech. Implementing linguistic entrainment in spoken dialogue systems helps to improve the naturalness of the conversation, likability of the agents, and dialogue and task success. The first step toward implementation of such systems is to design proper measures to quantify entrainment. Multi-party entrainment and multi-party spoken dialogue systems have received less attention compared to dyads. In this study, we analyze an existing approach of extending pair measures to team-level entrainment measures, which is based on simple averaging of pairs. We argue that although simple averaging is a good starting point to measure team entrainment, it has several weaknesses in terms of capturing team-specific behaviors specifically related to convergence.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    The average absolute difference between the amplitudes of consecutive periods, divided by the average amplitude.

  2. 2.

    The average absolute difference between consecutive periods, divided by the average amplitude.

  3. 3.

    We included the gender of speakers in the plots. But, there is no significant effect of gender composition of the teams on convergence value.

References

  1. Boersma P, Heuven VV (2002) Praat, a system for doing phonetics by computer. Glot Int 5(9/10):341–345

    Google Scholar 

  2. Borrie SA, Lubold N, Pon-Barry H (2015) Disordered speech disrupts conversational entrainment: a study of acoustic-prosodic entrainment and communicative success in populations with communication challenges. Front Psychol 6

    Google Scholar 

  3. Brennan SE, Clark HH (1996) Conceptual pacts and lexical choice in conversation. J Exp Psychol Learn Memory Cogn 22(6):1482–1493

    Article  Google Scholar 

  4. Danescu-Niculescu-Mizil C, Gamon M, Dumais S (2011) Mark my words!: linguistic style accommodation in social media. In: Proceedings of the 20th international conference on world wide web, pp 745–754

    Google Scholar 

  5. Danescu-Niculescu-Mizil C, Lee L, Pang B, Kleinberg J (20120 Echoes of power: language effects and power differences in social interaction. In: Proceedings of WWW, pp 699–708

    Google Scholar 

  6. Foster ME, Gaschler A, Giuliani M, Isard A, Pateraki M, Petrick RP (2012) Two people walk into a bar: dynamic multi-party social interaction with a robot agent. In: Proceedings of the 14th ACM international conference on multimodal interaction, ICMI’12, pp 3–10

    Google Scholar 

  7. Friedberg H, Litman D, Paletz SBF (2012) Lexical entrainment and success in student engineering groups. In: Proceedings fourth IEEE workshop on spoken language technology (SLT). Miami, Florida

    Google Scholar 

  8. Gonzales AL, Hancock JT, Pennebaker JW (2009) Language style matching as a predictor of social dynamics in small groups. Commun Res

    Google Scholar 

  9. Hiraoka T, Georgila K, Nouri E, Traum D, Nakamura S (2015) Reinforcement learning in multi-party trading dialog. In: 16th annual meeting of the special interest group on discourse and dialogue, p 32

    Google Scholar 

  10. Lee CC, Katsamanis A, Black MP, Baucom BR, Georgiou PG, Narayanan S (2011) An analysis of PCA-based vocal entrainment measures in married couples’ affective spoken interactions. In: INTERSPEECH, pp 3101–3104

    Google Scholar 

  11. Levitan R (2013) Entrainment in spoken dialogue systems: adopting, predicting and influencing user behavior. In: HLT-NAACL, pp 84–90

    Google Scholar 

  12. Levitan R, Benuš Š, Gálvez RH, Gravano A, Savoretti F, Trnka M, Weise A, Hirschberg J (2016) Implementing acoustic-prosodic entrainment in a conversational avatar. Interspeech 2016:1166–1170

    Article  Google Scholar 

  13. Levitan R, Hirschberg J (2011) Measuring acoustic-prosodic entrainment with respect to multiple levels and dimensions. In: Interspeech

    Google Scholar 

  14. Litman D, Paletz S, Rahimi Z, Allegretti S, Rice C (2016)The teams corpus and entrainment in multi-party spoken dialogues. In: 2016 conference on empirical methods in natural language processing (EMNLP). Austin, Texas

    Google Scholar 

  15. Lopes J, Eskenazi M, Trancoso I (2013) Automated two-way entrainment to improve spoken dialog system performance. In: ICASSP, pp 8372–8376

    Google Scholar 

  16. Lopes J, Eskenazi M, Trancoso I (2015) From rule-based to data-driven lexical entrainment models in spoken dialog systems. Comput Speech Lang 31(1):87–112

    Google Scholar 

  17. Lubold N., Pon-Barry H (2014) Acoustic-prosodic entrainment and rapport in collaborative learning dialogues. In: Proceedings of the 2014 ACM workshop on multimodal learning analytics workshop and grand challenge. ACM, pp 5–12

    Google Scholar 

  18. Lubold N, Pon-Barry H, Walker E (2015) Naturalness and rapport in a pitch adaptive learning companion. In: 2015 IEEE workshop on automatic speech recognition and understanding (ASRU). IEEE, pp 103–110

    Google Scholar 

  19. Mitchell CM, Boyer KE, Lester JC (2012) From strangers to partners: Examining convergence within a longitudinal study of task-oriented dialogue. In: SIGDIAL Conference, pp 94–98

    Google Scholar 

  20. Nenkova A, Gravano A, Hirschberg J (2008) High frequency word entrainment in spoken dialogue. In: Proceedings of the 46th annual meeting of the association for computational linguistics on human language technologies: short papers, HLT-Short’08, pp 169–172

    Google Scholar 

  21. Porzel R, Scheffler A, Malaka R (2006) How entrainment increases dialogical effectiveness. In: Proceedings of the IUI’06 workshop on effective multimodal dialogue interaction, pp 35–42

    Google Scholar 

  22. Reitter D, Moore JD (2007) Predicting success in dialogue. In: Proceedings of the 45th meeting of the association of computational linguistics, pp 808–815

    Google Scholar 

Download references

Acknowledgements

This material is based upon work supported by the National Science Foundation under Grant Nos. 1420784 and 1420377. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the National Science Foundation.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Zahra Rahimi .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer International Publishing AG, part of Springer Nature

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Rahimi, Z., Litman, D., Paletz, S. (2019). Acoustic-Prosodic Entrainment in Multi-party Spoken Dialogues: Does Simple Averaging Extend Existing Pair Measures Properly?. In: Eskenazi, M., Devillers, L., Mariani, J. (eds) Advanced Social Interaction with Agents . Lecture Notes in Electrical Engineering, vol 510. Springer, Cham. https://doi.org/10.1007/978-3-319-92108-2_18

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-92108-2_18

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-92107-5

  • Online ISBN: 978-3-319-92108-2

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics