Skip to main content

Artificial Speech is Culture:

Conversational UX Designers and the Work of Usable Conversational Voice Assistants

  • Conference paper
  • First Online:
Culture and Computing (HCII 2022)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 13324))

Included in the following conference series:

Abstract

As conversational voice assistants (CVAs) like Alexa, Siri, and Google Home have become ubiquitous in some parts of the world, lab-based reception studies have captured perceived failures in their usability or accounted for ways that these devices reproduce problematic (often racialized and gendered) cultural conditions. But examining these devices solely as end products fails to account for the ways that UX design, like other expert labor, is a social practice born of daily workplace negotiations and inevitable compromises. This U.S. and Japan-based study argues that anthropological methods are critical to our understanding of conversation design and device training processes and explores why we must go beyond quantifying device usability to examine the work of the usability professionals themselves. For the conversational user experience (CUX) designers and researchers I interviewed and with whom I am conducting ongoing fieldwork, current technology frustrates their capacity to design for systems that go beyond being tools to also be enjoyable conversation partners. In some cases, the process of creating this category of AI turns the canonical literature on computers as social actors on its head, by identifying conscious intentions on the part of designers to replicate human personality and use it to drive the interactions we have with CVAs. It also suggests that the end users who most successfully adopt these tools are frequently those who best reproduce the culture of UX designers themselves.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 69.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 89.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    All names used are pseudonyms, to allow my collaborators to speak freely about workplace challenges. Where possible, I have also tried to obscure their workplace.

References

  1. Feng, S., Kudina, O., Halpern, B.M.S., Scharenborg, O.: Quantifying bias in automatic speech recognition (2021)

    Google Scholar 

  2. Abercrombie, G., Curry, A.C., Pandya, M., Rieser, V.: Alexa, Google, Siri: what are your pronouns? Gender and anthropomorphism in the design and perception of conversational assistants. arXiv preprint arXiv:2106.02578 (2021)

  3. Schreuter, D., van der Putten, P., Lamers, M.H.: Trust me on this one: conforming to conversational assistants. Mind. Mach. 31(4), 535–562 (2021). https://doi.org/10.1007/s11023-021-09581-8

    Article  Google Scholar 

  4. Günel, G., Varma, S., Watanabe, C.: A manifesto for patchwork ethnography (2020). https://culanth.org/fieldsights/a-manifesto-for-patchwork-ethnography. Accessed 4 July 2020

  5. Forsythe, D.E.: Studying Those Who Study Us: An Anthropologist in the World of Artificial Intelligence. Stanford University Press, Palo Alto (2002)

    Book  Google Scholar 

  6. Kelty, C.: Geeks, social imaginaries, and recursive publics. Cult. Anthropol. 20(2), 185–214 (2005)

    Article  Google Scholar 

  7. White, D., Katsuno, H.: Toward an affective sense of life: artificial intelligence, animacy, and amusement at a robot pet memorial service in Japan. Cult. Anthropol. 36(2), 222–251 (2021)

    Article  Google Scholar 

  8. Robertson, J.: Gendering humanoid robots: robo-sexism in Japan. Body Soc. 16(2), 1–36 (2010)

    Article  Google Scholar 

  9. Otsuki, G.J.: Frame, game, and circuit: truth and the human in Japanese human-machine interface research. Ethnos. 86(4), 712–729 (2021)

    Google Scholar 

  10. Hine, C.: Strategies for reflexive ethnography in the smart home: autoethnography of silence and emotion. Sociology 54(1), 22–36 (2020). https://doi.org/10.1177/0038038519855325

    Article  Google Scholar 

  11. Chan, J.K.: Design ethics: reflecting on the ethical dimensions of technology, sustainability, and responsibility in the anthropocene. Des. Stud. 54, 184–200 (2018)

    Article  Google Scholar 

  12. Ylipulli, J., Luusua, A.: Broadening horizons of design ethics? Importing concepts from applied anthropology. Nordes: Nord. Design Res. 8, 1–5 (2019)

    Google Scholar 

  13. Katagiri, Y., Nass, C., Takeuchi, Y.: Cross-cultural studies of the computers are social actors paradigm: the case of reciprocity. Usabil. Eval. Interface Design: Cogn. Eng. Intell. Agents Virtual Reality 1558–1562 (2001)

    Google Scholar 

  14. Richardson, K.: An Anthropology of Robots and AI: Annihilation Anxiety and Machines. Routledge, New York (2015)

    Book  Google Scholar 

  15. Robertson, J.: Robo sapiens japanicus: humanoid robots and the posthuman family. Crit. Asian Stud. 39(3), 369–398 (2007)

    Article  Google Scholar 

  16. Fuwa, R.: Searching for ownership and usage of smart speakers (Sumātosupīkā no shoyū riyō jōkyō o saguru) (2020). https://news.yahoo.co.jp/byline/fuwaraizo/20201024-00203730. Accessed 10 Jan 2021

  17. Nielsen, J.: A 100-year view of user experience (2017). https://www.nngroup.com/articles/100-years-ux/. Accessed 25 Jan 2021

  18. Norman, D., Miller, J., Henderson, A.: What you see, some of what’s in the future, and how we go about doing it. In: CHI 1995. ACM Press (1995)

    Google Scholar 

  19. de Jong, M.D.T.: The quest for a usability theory. Tech. Commun. 61(3), 145–146 (2014)

    Google Scholar 

  20. Getto, G., Beecher, F.: Toward a model of UX education: training UX designers within the academy. IEEE Trans. Prof. Commun. 59(2), 153–164 (2016)

    Article  Google Scholar 

  21. Rodwell, E.A.: A Pedagogy of its own: building a UX research program. Pract. Anthropol. 43(2), 17–21 (2021)

    Article  Google Scholar 

  22. Kou, Y., Gray, C.M.: A practice-led account of the conceptual evolution of UX knowledge. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, Paper 49 (2019)

    Google Scholar 

  23. Coleman, G.: Hacker, Hoaxer, Whistleblower, Spy: The Many Faces of Anonymous. Verso, New York (2014)

    Google Scholar 

  24. Richardson, K.: Technological animism: the uncanny personhood of humanoid machines. Soc. Anal.: Int. J. Soc. Cult. Pract. 60(1), 110–128 (2016)

    Article  Google Scholar 

  25. Masco, J.: The Nuclear Borderlands: The Manhattan Project in Post-Cold War New Mexico. Princeton University Press, Princeton (2006)

    Book  Google Scholar 

  26. Gusterson, H.: Nuclear Rites: A Weapons Laboratory at the End of the Cold War. University of California Press, Berkeley and Los Angeles (1998)

    Google Scholar 

  27. Ho, K.: Liquidated: An Ethnography of Wall Street. Duke University Press, Durham (2009)

    Book  Google Scholar 

  28. Boyer, D.: The Life Informatic: Newsmaking in the Digital Era. Cornell University Press, Ithaca (2013)

    Book  Google Scholar 

  29. Traweek, S.: Beamtimes and Lifetimes: The World of High Energy Physicists. Harvard University Press, Cambridge (1988)

    Google Scholar 

  30. Nader, L.: Up the anthropologist: perspectives gained from studying up. In: Hymes, D. (ed.) Reinventing Anthropology, pp. 284–311. Vintage Books, New York (1972)

    Google Scholar 

  31. Gusterson, H.: Studying up revisited. PoLAR: Polit. Legal Anthropol. Rev. 20(1), 114–119 (1997)

    Article  Google Scholar 

  32. Ortner, S.B.: Studying sideways: ethnographic access in hollywood. In: Mayer, V., Banks, M.J., Caldwell, J.T. (eds.) Production Studies: Cultural Studies of Media Industries, pp. 183–197. Routledge, New York (2009)

    Google Scholar 

  33. Cefkin, M.: Ethnography and the Corporate Encounter: Reflections on Research in and of Corporations. Berghahn Books (2010)

    Google Scholar 

  34. Denny, R.M., Sunderland, P.L.: Doing Anthropology in Consumer Research. Routledge, New York and London (2016)

    Google Scholar 

  35. Ladner, S.: Practical Ethnography: A Guide to Doing Ethnography in the Private Sector. Left Coast Press, Walnut Creek (2014)

    Google Scholar 

  36. Feine, J., Gnewuch, U., Morana, S., Maedche, A.: A taxonomy of social cues for conversational agents. Int. J. Hum. Comput. Stud. 132, 138–161 (2019)

    Article  Google Scholar 

  37. Moore, R.J., Arar, R.: Conversational UX Design: A Practitioner’s Guide to the Natural Conversation Framework, vol. #27. ACM Books (2019)

    Google Scholar 

  38. Moore, R.J., Liu, E.Y., Mishra, S., Ren, G.-J.: Design systems for conversational UX. In: CUI 2020: the 2nd Conference on Conversational User Interfaces. ACM (2020)

    Google Scholar 

  39. Kuligowska, K.: Commercial chatbot: performance evaluation, usability metrics and quality standards of embodied conversational agents (2015)

    Google Scholar 

  40. Robinson, J., Lanius, C., Weber, R.: The past, present, and future of UX empirical research. Commun. Design Q. 5(3), 10–23 (2018)

    Article  Google Scholar 

  41. Udupa, S., et al.: AI, extreme speech and the challenges of online content moderation. In: Project AD. LMU, Munich (2021)

    Google Scholar 

  42. Lima, L., Furtado, V., Furtado, E., Almeida, V.: Empirical analysis of bias in voice-based personal assistants. In: Companion Proceedings of the 2019 World Wide Web Conference. Association for Computing Machinery, San Francisco, pp. 533–538 (2019)

    Google Scholar 

  43. MyVoice: [Survey on smart speakers] About 8% of people use smart speakers by themselves, and more than 10% use them by themselves or their families. Intention to use is less than 20%, intention not to use is about 45% ([Sumātosupīkā ni kansuru chōsa] sumātosupīkā o jibun de riyōshiteiru hito wa yaku 8%, jibun matawa kazoku ga riyōshiteiru hito wa 1 warikyō. Riyō ikō wa 2 warijaku, hi riyō ikō wa yaku 45-pāsento) (2021). https://prtimes.jp/main/html/rd/p/000001038.000007815.html. Accessed November 2021

  44. Nielsen, J.: 10 Usability Heuristics for User Interface Design (1994). https://www.nngroup.com/articles/ten-usability-heuristics/. Accessed 15 Jan 2021

  45. Curry, A.C., Robertson, J., Rieser, V.: Conversational assistants and gender stereotypes: public perceptions and desiderata for voice personas. In: Workshop on Gender Bias in Natural Language Processing, pp. 72–78. Creative Commons, Barcelona (2020)

    Google Scholar 

  46. Gambino, A., Fox, J., Ratan, R.A.: Building a stronger CASA: extending the computers are social actors paradigm. Hum.-Mach. Commun. 1(1), 5 (2020)

    Google Scholar 

  47. Beldad, A., Hegner, S., Hoppen, J.: The effect of virtual sales agent (VSA) gender – product gender congruence on product advice credibility, trust in VSA and online vendor, and purchase intention. Comput. Hum. Behav. 60, 62–72 (2016)

    Article  Google Scholar 

  48. Strengers, Y., Kennedy, J.: The Smart Wife: Why Siri, Alexa, and Other Smart Home Devices Need a Feminist Reboot. The MIT Press, Cambridge (2020)

    Book  Google Scholar 

  49. Faber, L.W.: The Computer’s Voice: From Star Trek to Siri. University of Minnesota Press, Minneapolis (2020)

    Book  Google Scholar 

  50. Martinez, C., Morana, S.: Conversational UX Design #5 - social aspects of human-chatbot interaction. In: Martinez, C. Conversational UX Design (2021). https://www.meetup.com/conversational-ux-design/events/277488536/

  51. Mori, M.: Bukimi no tani [The Uncanny Valley]. Energy. 74, 33–35 (1970)

    Google Scholar 

  52. Thompson, C.: May A.I. Help You? (2018). https://www.nytimes.com/interactive/2018/11/14/magazine/tech-design-ai-chatbot.html. Accessed 1 Dec 2020

  53. Gong, L.: How social is social responses to computers? The function of the degree of anthropomorphism in computer representations. Comput. Hum. Behav. 24(4), 1494–1509 (2008). https://doi.org/10.1016/j.chb.2007.05.007

    Article  Google Scholar 

  54. Manikonda, L., Deotale, A., Kambhampati, S.: What’s up with privacy? User preferences and privacy concerns in intelligent personal assistants. In: Proceedings of the 2018 AAAI/ACM Conference on AI, Ethics, and Society, pp. 229–235 (2018)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Elizabeth Rodwell .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Rodwell, E. (2022). Artificial Speech is Culture:. In: Rauterberg, M. (eds) Culture and Computing. HCII 2022. Lecture Notes in Computer Science, vol 13324. Springer, Cham. https://doi.org/10.1007/978-3-031-05434-1_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-05434-1_9

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-05433-4

  • Online ISBN: 978-3-031-05434-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics