Abstract
As Voice User Interfaces (VUIs) become increasingly embedded in a wide range of activities in our everyday life, it falls to the conversation designer to ensure that the user experience is a satisfactory one. Embedding qualities of natural speech in the design output is considered one way to achieve this. Conversation Analysis (CA), the study of naturally-occurring talk and interaction, has been proposed as a useful tool in developing VUIs. However, little practical advice is currently available for how conversation designers can leverage CA for improving the VUI user experience. Drawing on a collaboration between Conversation Analysts and conversation designers, this paper outlines a step-by-step workflow of conversation design procedures that allow designers greater opportunities to link the study of natural talk with the conversational design output. This enables designers to build on general insights from CA as well as specific instances of human-human interactional data, modelling the VUI design on naturally-occurring patterns for carrying out equivalent interactional activities. In the examples, we highlight such features as word choice, intonation contouring, stress, and pitch, to show how naturally-occurring interactional data can provide a platform on which to develop the design of a conversational agent.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
There are other genres, for example verbatim theatre and post-dramatic theatre, which do draw more closely on the features of actual social interaction.
References
Clark, L., et al.: The state of speech in HCI: trends, themes and challenges. Interact. Comput. 31(4), 349–371 (2020). https://doi.org/10.1093/iwc/iwz016
Murad, C., et al.: Let’s talk about CUIs: putting conversational user interface design into practice. In: Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems (CHI EA 2021), Article 98, pp. 1–6 (2021). https://doi.org/10.1145/3411763.3441336
Murad, C., Munteanu, C.: “I don't know what you're talking about, HALexa”: the case for voice user interface guidelines. In: Proceedings of the 1st International Conference on Conversational User Interfaces (CUI 2019), Article 9, pp. 1–3 (2019). https://doi.org/10.1145/3342775.3342795
Murad, C., Munteanu, C.: “Voice-first interfaces in a GUI-first design world”: barriers and opportunities to supporting VUI designers on-the-job. In: 4th Conference on Conversational User Interfaces (2022). https://doi.org/10.1145/3543829.3543842
Kim, Y., Reza, M., Mcgrenere, J., Yoon, D.: Designers characterize naturalness in voice user interfaces: their goals, practices, and challenges. In: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI 2021), Article 242, pp. 1–13 (2021). https://doi.org/10.1145/3411764.3445579
Google: Conversation Design. https://developers.google.com/assistant/conversation-design/welcome. Accessed 20 June 2023
Housley, W., Albert, S., Stokoe, E.: Natural action processing. In: Proceedings of the Halfway to the Future Symposium 2019 (HTTF 2019). Article 34, pp. 1–4 (2019). https://doi.org/10.1145/3363384.3363478
Moore, R.J., An, S., Ren, G.: The IBM natural conversation framework: a new paradigm for conversational UX design. Hum.-Comput. Interact. 3(3–4), 168–193 (2023). https://doi.org/10.1080/07370024.2022.2081571
Moore, R.J., Arar, R.: Conversational UX Design: A Practitioner's Guide to the Natural Conversation Framework. Association for Computing Machinery, New York (2019)
Stokoe, E., Albert, S, Parslow, S., Pearl, C.: Conversation Design and Conversation Analysis: Where the Moonshots Are. Medium (2021). https://elizabeth-stokoe.medium.com/conversation-design-and-conversation-analysis-c2a2836cb042
Brandt, A., Hazel, S., McKinnon, R., Sideridou, K., Tindale, J., Ventoura, N.: From writing dialogue to designing conversation: considering the potential of conversation analysis for voice user interfaces. In: ACM Conference on Conversational User Interfaces (2023). https://doi.org/10.1145/3571884.3603758
Schegloff, E.A., Sacks, H.: Opening up closings. Semiotica 8, 289–327 (1973). https://doi.org/10.1515/semi.1973.8.4.289
McCulloch, B.: Conversation Design: Paralanguage. Medium (2019). https://medium.com/voice-tech-podcast/conversation-design-paralanguage-73ef042c0117
Bradford, B.: Upspeak in British English. English Today 13(3), 29–36 (1997). https://doi.org/10.1017/S0266078400009810
Nycum, R.: In defense of valley girl English. Compass 1(5), 23–29 (2018). https://scholarworks.arcadia.edu/thecompass/vol1/iss5/4
Sacks, H.: Notes on methodology. In: Atkinson, J.M., Heritage, J. (eds.) Structures of Social Action: Studies in Conversation Analysis, pp. 21–27. Cambridge University Press, Cambridge (1984)
Allain, P., Harvie, J.: The Routledge Companion to Theatre and Performance. Routledge, Abingdon (2006)
Culpeper, J., Short, M., Verdonk, P.: Exploring the Language of Drama: From Text to Context. Routledge, London (1998)
Herman, V.: Dramatic Dialogue and the Systematics of Turn-Taking. Semiotica 83(1–2), 97–121 (1991)
Herman, V.: Dramatic Discourse: Dialogue as Interaction in Plays. Routledge, Abingdon (1995). https://doi.org/10.1515/semi.1991.83.1-2.97
Burns, E.: Theatricality: A Study of Convention in the Theatre and in Social Life. Longman, London (1972)
Hazel, S.: Acting, interacting, enacting. Akademisk Kvarter 12, 44–64 (2015). https://doi.org/10.5278/ojs.academicquarter.v0i12.2727
Lefebvre, A.: Reading and embodying the script during the theatrical rehearsal. Lang. Dialog. 8(2), 261–288 (2018). https://doi.org/10.1075/ld.00015.lef
Crow, B.K.: Conversational performance and the performance of conversation. TDR (Drama Rev.) 32(3), 23–54 (1988). https://doi.org/10.2307/1145905
Norrthon, S.: To stage an overlap: the longitudinal, collaborative and embodied process of staging eight lines in a professional theatre rehearsal process. J. Pragmat. 142, 171–184 (2019). https://doi.org/10.1016/j.pragma.2019.01.015
Bell, A., Gibson, A.: Staging language: an introduction to the sociolinguistics of performance. J. Socioling. 15, 555–572 (2011). https://doi.org/10.1111/j.1467-9841.2011.00517.x
Johnstone, B.: Dialect enregisterment in performance. J. Socioling. 15, 657–679 (2011). https://doi.org/10.1111/j.1467-9841.2011.00512.x
Lemon, A.M.: “Form” and “Function” in Soviet Stage Romani: modeling metapragmatics through performance institutions. Lang. Soc. 31(1), 29–64 (2002). https://doi.org/10.1017/S0047404502001021
Schegloff, E.A.: The routine as achievement. Hum. Stud. 9(2), 111–151 (1986). https://doi.org/10.1007/BF00148124
Sikveland, R., Stokoe, E., Symonds, J.: Patient burden during appointment-making telephone calls to GP practices. Patient Educ. Couns. 99(8), 1310–1318 (2016). https://doi.org/10.1016/j.pec.2016.03.025
Houtkoop-Steenstra, H.: Opening sequences in Dutch telephone conversations. In: Boden, D., Zimmerman, D.H. (eds.) Talk and Social Structure: Studies in Ethnomethodology and Conversation Analysis, pp. 232–50. Polity, Cambridge (1991)
Laurier, E.: Why people say where they are during mobile phone calls. Environ. Plan. D Soc. Space 19(4), 485–504 (2001). https://doi.org/10.1068/d228t
Humă, B., Stokoe, E.: The anatomy of first-time and subsequent business-to-business “Cold” calls. Res. Lang. Soc. Interact. 53(2), 271–294 (2020). https://doi.org/10.1080/08351813.2020.1739432
Jefferson, G.: List-construction as a Task and a Resource. In: Psathas, G. (ed.) Interaction Competence, pp. 63–92. University Press of America (1990)
Jefferson, G.: Glossary of transcript symbols with an introduction. In: Lerner, G.H. (ed.) Conversation Analysis: Studies from the First Generation, pp. 13–31. Benjamins, Amsterdam (2004)
Khavandi, S., et al.: User-acceptability of an automated telephone call for post-operative follow-up after uncomplicated cataract surgery. Eye (2022). https://doi.org/10.1038/s41433-022-02289-8
Clark, L., et al.: What makes a good conversation? Challenges in designing truly conversational agents. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI 2019), Paper 475, pp. 1–12 (2019). https://doi.org/10.1145/3290605.3300705
Acknowledgements
This project was supported by a British Academy Innovation Fellowship (IF2223/230141).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Hazel, S., Brandt, A. (2023). Enhancing the Natural Conversation Experience Through Conversation Analysis – A Design Method. In: Kurosu, M., et al. HCI International 2023 – Late Breaking Papers. HCII 2023. Lecture Notes in Computer Science, vol 14054. Springer, Cham. https://doi.org/10.1007/978-3-031-48038-6_6
Download citation
DOI: https://doi.org/10.1007/978-3-031-48038-6_6
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-48037-9
Online ISBN: 978-3-031-48038-6
eBook Packages: Computer ScienceComputer Science (R0)