Abstract
Linguistic entrainment, the tendency of interlocutors to become similar to each other during spoken interaction, is an important characteristic of human speech. Implementing linguistic entrainment in spoken dialogue systems helps to improve the naturalness of the conversation, likability of the agents, and dialogue and task success. The first step toward implementation of such systems is to design proper measures to quantify entrainment. Multi-party entrainment and multi-party spoken dialogue systems have received less attention compared to dyads. In this study, we analyze an existing approach of extending pair measures to team-level entrainment measures, which is based on simple averaging of pairs. We argue that although simple averaging is a good starting point to measure team entrainment, it has several weaknesses in terms of capturing team-specific behaviors specifically related to convergence.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
The average absolute difference between the amplitudes of consecutive periods, divided by the average amplitude.
- 2.
The average absolute difference between consecutive periods, divided by the average amplitude.
- 3.
We included the gender of speakers in the plots. But, there is no significant effect of gender composition of the teams on convergence value.
References
Boersma P, Heuven VV (2002) Praat, a system for doing phonetics by computer. Glot Int 5(9/10):341–345
Borrie SA, Lubold N, Pon-Barry H (2015) Disordered speech disrupts conversational entrainment: a study of acoustic-prosodic entrainment and communicative success in populations with communication challenges. Front Psychol 6
Brennan SE, Clark HH (1996) Conceptual pacts and lexical choice in conversation. J Exp Psychol Learn Memory Cogn 22(6):1482–1493
Danescu-Niculescu-Mizil C, Gamon M, Dumais S (2011) Mark my words!: linguistic style accommodation in social media. In: Proceedings of the 20th international conference on world wide web, pp 745–754
Danescu-Niculescu-Mizil C, Lee L, Pang B, Kleinberg J (20120 Echoes of power: language effects and power differences in social interaction. In: Proceedings of WWW, pp 699–708
Foster ME, Gaschler A, Giuliani M, Isard A, Pateraki M, Petrick RP (2012) Two people walk into a bar: dynamic multi-party social interaction with a robot agent. In: Proceedings of the 14th ACM international conference on multimodal interaction, ICMI’12, pp 3–10
Friedberg H, Litman D, Paletz SBF (2012) Lexical entrainment and success in student engineering groups. In: Proceedings fourth IEEE workshop on spoken language technology (SLT). Miami, Florida
Gonzales AL, Hancock JT, Pennebaker JW (2009) Language style matching as a predictor of social dynamics in small groups. Commun Res
Hiraoka T, Georgila K, Nouri E, Traum D, Nakamura S (2015) Reinforcement learning in multi-party trading dialog. In: 16th annual meeting of the special interest group on discourse and dialogue, p 32
Lee CC, Katsamanis A, Black MP, Baucom BR, Georgiou PG, Narayanan S (2011) An analysis of PCA-based vocal entrainment measures in married couples’ affective spoken interactions. In: INTERSPEECH, pp 3101–3104
Levitan R (2013) Entrainment in spoken dialogue systems: adopting, predicting and influencing user behavior. In: HLT-NAACL, pp 84–90
Levitan R, Benuš Š, Gálvez RH, Gravano A, Savoretti F, Trnka M, Weise A, Hirschberg J (2016) Implementing acoustic-prosodic entrainment in a conversational avatar. Interspeech 2016:1166–1170
Levitan R, Hirschberg J (2011) Measuring acoustic-prosodic entrainment with respect to multiple levels and dimensions. In: Interspeech
Litman D, Paletz S, Rahimi Z, Allegretti S, Rice C (2016)The teams corpus and entrainment in multi-party spoken dialogues. In: 2016 conference on empirical methods in natural language processing (EMNLP). Austin, Texas
Lopes J, Eskenazi M, Trancoso I (2013) Automated two-way entrainment to improve spoken dialog system performance. In: ICASSP, pp 8372–8376
Lopes J, Eskenazi M, Trancoso I (2015) From rule-based to data-driven lexical entrainment models in spoken dialog systems. Comput Speech Lang 31(1):87–112
Lubold N., Pon-Barry H (2014) Acoustic-prosodic entrainment and rapport in collaborative learning dialogues. In: Proceedings of the 2014 ACM workshop on multimodal learning analytics workshop and grand challenge. ACM, pp 5–12
Lubold N, Pon-Barry H, Walker E (2015) Naturalness and rapport in a pitch adaptive learning companion. In: 2015 IEEE workshop on automatic speech recognition and understanding (ASRU). IEEE, pp 103–110
Mitchell CM, Boyer KE, Lester JC (2012) From strangers to partners: Examining convergence within a longitudinal study of task-oriented dialogue. In: SIGDIAL Conference, pp 94–98
Nenkova A, Gravano A, Hirschberg J (2008) High frequency word entrainment in spoken dialogue. In: Proceedings of the 46th annual meeting of the association for computational linguistics on human language technologies: short papers, HLT-Short’08, pp 169–172
Porzel R, Scheffler A, Malaka R (2006) How entrainment increases dialogical effectiveness. In: Proceedings of the IUI’06 workshop on effective multimodal dialogue interaction, pp 35–42
Reitter D, Moore JD (2007) Predicting success in dialogue. In: Proceedings of the 45th meeting of the association of computational linguistics, pp 808–815
Acknowledgements
This material is based upon work supported by the National Science Foundation under Grant Nos. 1420784 and 1420377. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the National Science Foundation.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer International Publishing AG, part of Springer Nature
About this chapter
Cite this chapter
Rahimi, Z., Litman, D., Paletz, S. (2019). Acoustic-Prosodic Entrainment in Multi-party Spoken Dialogues: Does Simple Averaging Extend Existing Pair Measures Properly?. In: Eskenazi, M., Devillers, L., Mariani, J. (eds) Advanced Social Interaction with Agents . Lecture Notes in Electrical Engineering, vol 510. Springer, Cham. https://doi.org/10.1007/978-3-319-92108-2_18
Download citation
DOI: https://doi.org/10.1007/978-3-319-92108-2_18
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-92107-5
Online ISBN: 978-3-319-92108-2
eBook Packages: EngineeringEngineering (R0)