Abstract
As conversational voice assistants (CVAs) like Alexa, Siri, and Google Home have become ubiquitous in some parts of the world, lab-based reception studies have captured perceived failures in their usability or accounted for ways that these devices reproduce problematic (often racialized and gendered) cultural conditions. But examining these devices solely as end products fails to account for the ways that UX design, like other expert labor, is a social practice born of daily workplace negotiations and inevitable compromises. This U.S. and Japan-based study argues that anthropological methods are critical to our understanding of conversation design and device training processes and explores why we must go beyond quantifying device usability to examine the work of the usability professionals themselves. For the conversational user experience (CUX) designers and researchers I interviewed and with whom I am conducting ongoing fieldwork, current technology frustrates their capacity to design for systems that go beyond being tools to also be enjoyable conversation partners. In some cases, the process of creating this category of AI turns the canonical literature on computers as social actors on its head, by identifying conscious intentions on the part of designers to replicate human personality and use it to drive the interactions we have with CVAs. It also suggests that the end users who most successfully adopt these tools are frequently those who best reproduce the culture of UX designers themselves.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
All names used are pseudonyms, to allow my collaborators to speak freely about workplace challenges. Where possible, I have also tried to obscure their workplace.
References
Feng, S., Kudina, O., Halpern, B.M.S., Scharenborg, O.: Quantifying bias in automatic speech recognition (2021)
Abercrombie, G., Curry, A.C., Pandya, M., Rieser, V.: Alexa, Google, Siri: what are your pronouns? Gender and anthropomorphism in the design and perception of conversational assistants. arXiv preprint arXiv:2106.02578 (2021)
Schreuter, D., van der Putten, P., Lamers, M.H.: Trust me on this one: conforming to conversational assistants. Mind. Mach. 31(4), 535–562 (2021). https://doi.org/10.1007/s11023-021-09581-8
Günel, G., Varma, S., Watanabe, C.: A manifesto for patchwork ethnography (2020). https://culanth.org/fieldsights/a-manifesto-for-patchwork-ethnography. Accessed 4 July 2020
Forsythe, D.E.: Studying Those Who Study Us: An Anthropologist in the World of Artificial Intelligence. Stanford University Press, Palo Alto (2002)
Kelty, C.: Geeks, social imaginaries, and recursive publics. Cult. Anthropol. 20(2), 185–214 (2005)
White, D., Katsuno, H.: Toward an affective sense of life: artificial intelligence, animacy, and amusement at a robot pet memorial service in Japan. Cult. Anthropol. 36(2), 222–251 (2021)
Robertson, J.: Gendering humanoid robots: robo-sexism in Japan. Body Soc. 16(2), 1–36 (2010)
Otsuki, G.J.: Frame, game, and circuit: truth and the human in Japanese human-machine interface research. Ethnos. 86(4), 712–729 (2021)
Hine, C.: Strategies for reflexive ethnography in the smart home: autoethnography of silence and emotion. Sociology 54(1), 22–36 (2020). https://doi.org/10.1177/0038038519855325
Chan, J.K.: Design ethics: reflecting on the ethical dimensions of technology, sustainability, and responsibility in the anthropocene. Des. Stud. 54, 184–200 (2018)
Ylipulli, J., Luusua, A.: Broadening horizons of design ethics? Importing concepts from applied anthropology. Nordes: Nord. Design Res. 8, 1–5 (2019)
Katagiri, Y., Nass, C., Takeuchi, Y.: Cross-cultural studies of the computers are social actors paradigm: the case of reciprocity. Usabil. Eval. Interface Design: Cogn. Eng. Intell. Agents Virtual Reality 1558–1562 (2001)
Richardson, K.: An Anthropology of Robots and AI: Annihilation Anxiety and Machines. Routledge, New York (2015)
Robertson, J.: Robo sapiens japanicus: humanoid robots and the posthuman family. Crit. Asian Stud. 39(3), 369–398 (2007)
Fuwa, R.: Searching for ownership and usage of smart speakers (Sumātosupīkā no shoyū riyō jōkyō o saguru) (2020). https://news.yahoo.co.jp/byline/fuwaraizo/20201024-00203730. Accessed 10 Jan 2021
Nielsen, J.: A 100-year view of user experience (2017). https://www.nngroup.com/articles/100-years-ux/. Accessed 25 Jan 2021
Norman, D., Miller, J., Henderson, A.: What you see, some of what’s in the future, and how we go about doing it. In: CHI 1995. ACM Press (1995)
de Jong, M.D.T.: The quest for a usability theory. Tech. Commun. 61(3), 145–146 (2014)
Getto, G., Beecher, F.: Toward a model of UX education: training UX designers within the academy. IEEE Trans. Prof. Commun. 59(2), 153–164 (2016)
Rodwell, E.A.: A Pedagogy of its own: building a UX research program. Pract. Anthropol. 43(2), 17–21 (2021)
Kou, Y., Gray, C.M.: A practice-led account of the conceptual evolution of UX knowledge. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, Paper 49 (2019)
Coleman, G.: Hacker, Hoaxer, Whistleblower, Spy: The Many Faces of Anonymous. Verso, New York (2014)
Richardson, K.: Technological animism: the uncanny personhood of humanoid machines. Soc. Anal.: Int. J. Soc. Cult. Pract. 60(1), 110–128 (2016)
Masco, J.: The Nuclear Borderlands: The Manhattan Project in Post-Cold War New Mexico. Princeton University Press, Princeton (2006)
Gusterson, H.: Nuclear Rites: A Weapons Laboratory at the End of the Cold War. University of California Press, Berkeley and Los Angeles (1998)
Ho, K.: Liquidated: An Ethnography of Wall Street. Duke University Press, Durham (2009)
Boyer, D.: The Life Informatic: Newsmaking in the Digital Era. Cornell University Press, Ithaca (2013)
Traweek, S.: Beamtimes and Lifetimes: The World of High Energy Physicists. Harvard University Press, Cambridge (1988)
Nader, L.: Up the anthropologist: perspectives gained from studying up. In: Hymes, D. (ed.) Reinventing Anthropology, pp. 284–311. Vintage Books, New York (1972)
Gusterson, H.: Studying up revisited. PoLAR: Polit. Legal Anthropol. Rev. 20(1), 114–119 (1997)
Ortner, S.B.: Studying sideways: ethnographic access in hollywood. In: Mayer, V., Banks, M.J., Caldwell, J.T. (eds.) Production Studies: Cultural Studies of Media Industries, pp. 183–197. Routledge, New York (2009)
Cefkin, M.: Ethnography and the Corporate Encounter: Reflections on Research in and of Corporations. Berghahn Books (2010)
Denny, R.M., Sunderland, P.L.: Doing Anthropology in Consumer Research. Routledge, New York and London (2016)
Ladner, S.: Practical Ethnography: A Guide to Doing Ethnography in the Private Sector. Left Coast Press, Walnut Creek (2014)
Feine, J., Gnewuch, U., Morana, S., Maedche, A.: A taxonomy of social cues for conversational agents. Int. J. Hum. Comput. Stud. 132, 138–161 (2019)
Moore, R.J., Arar, R.: Conversational UX Design: A Practitioner’s Guide to the Natural Conversation Framework, vol. #27. ACM Books (2019)
Moore, R.J., Liu, E.Y., Mishra, S., Ren, G.-J.: Design systems for conversational UX. In: CUI 2020: the 2nd Conference on Conversational User Interfaces. ACM (2020)
Kuligowska, K.: Commercial chatbot: performance evaluation, usability metrics and quality standards of embodied conversational agents (2015)
Robinson, J., Lanius, C., Weber, R.: The past, present, and future of UX empirical research. Commun. Design Q. 5(3), 10–23 (2018)
Udupa, S., et al.: AI, extreme speech and the challenges of online content moderation. In: Project AD. LMU, Munich (2021)
Lima, L., Furtado, V., Furtado, E., Almeida, V.: Empirical analysis of bias in voice-based personal assistants. In: Companion Proceedings of the 2019 World Wide Web Conference. Association for Computing Machinery, San Francisco, pp. 533–538 (2019)
MyVoice: [Survey on smart speakers] About 8% of people use smart speakers by themselves, and more than 10% use them by themselves or their families. Intention to use is less than 20%, intention not to use is about 45% ([Sumātosupīkā ni kansuru chōsa] sumātosupīkā o jibun de riyōshiteiru hito wa yaku 8%, jibun matawa kazoku ga riyōshiteiru hito wa 1 warikyō. Riyō ikō wa 2 warijaku, hi riyō ikō wa yaku 45-pāsento) (2021). https://prtimes.jp/main/html/rd/p/000001038.000007815.html. Accessed November 2021
Nielsen, J.: 10 Usability Heuristics for User Interface Design (1994). https://www.nngroup.com/articles/ten-usability-heuristics/. Accessed 15 Jan 2021
Curry, A.C., Robertson, J., Rieser, V.: Conversational assistants and gender stereotypes: public perceptions and desiderata for voice personas. In: Workshop on Gender Bias in Natural Language Processing, pp. 72–78. Creative Commons, Barcelona (2020)
Gambino, A., Fox, J., Ratan, R.A.: Building a stronger CASA: extending the computers are social actors paradigm. Hum.-Mach. Commun. 1(1), 5 (2020)
Beldad, A., Hegner, S., Hoppen, J.: The effect of virtual sales agent (VSA) gender – product gender congruence on product advice credibility, trust in VSA and online vendor, and purchase intention. Comput. Hum. Behav. 60, 62–72 (2016)
Strengers, Y., Kennedy, J.: The Smart Wife: Why Siri, Alexa, and Other Smart Home Devices Need a Feminist Reboot. The MIT Press, Cambridge (2020)
Faber, L.W.: The Computer’s Voice: From Star Trek to Siri. University of Minnesota Press, Minneapolis (2020)
Martinez, C., Morana, S.: Conversational UX Design #5 - social aspects of human-chatbot interaction. In: Martinez, C. Conversational UX Design (2021). https://www.meetup.com/conversational-ux-design/events/277488536/
Mori, M.: Bukimi no tani [The Uncanny Valley]. Energy. 74, 33–35 (1970)
Thompson, C.: May A.I. Help You? (2018). https://www.nytimes.com/interactive/2018/11/14/magazine/tech-design-ai-chatbot.html. Accessed 1 Dec 2020
Gong, L.: How social is social responses to computers? The function of the degree of anthropomorphism in computer representations. Comput. Hum. Behav. 24(4), 1494–1509 (2008). https://doi.org/10.1016/j.chb.2007.05.007
Manikonda, L., Deotale, A., Kambhampati, S.: What’s up with privacy? User preferences and privacy concerns in intelligent personal assistants. In: Proceedings of the 2018 AAAI/ACM Conference on AI, Ethics, and Society, pp. 229–235 (2018)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Rodwell, E. (2022). Artificial Speech is Culture:. In: Rauterberg, M. (eds) Culture and Computing. HCII 2022. Lecture Notes in Computer Science, vol 13324. Springer, Cham. https://doi.org/10.1007/978-3-031-05434-1_9
Download citation
DOI: https://doi.org/10.1007/978-3-031-05434-1_9
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-05433-4
Online ISBN: 978-3-031-05434-1
eBook Packages: Computer ScienceComputer Science (R0)