Benett Axtell
ABSTRACT
Speech is now common in daily interactions with our devices, thanks to voice user interfaces (VUIs) like Alexa. Despite their seeming ubiquity, designs often do not match users’ expectations. Science fiction, which is known to influence design of new technologies, has included VUIs for decades. Star Trek: The Next Generation is a prime example of how people envisioned ideal VUIs. Understanding how current VUIs live up to Star Trek’s utopian technologies reveals mismatches between current designs and user expectations, as informed by popular fiction. Combining conversational analysis and VUI user analysis, we study voice interactions with the Enterprise’s computer and compare them to current interactions. Independent of futuristic computing power, we find key design-based differences: Star Trek interactions are brief and functional, not conversational, they are highly multimodal and context-driven, and there is often no spoken computer response. From this, we suggest paths to better align VUIs with user expectations.
- Joachim Allgaier. 2018. “Ready To Beam Up”: Star Trek and its Interactions with Science, Research and Technology. In Set Phasers to Teach!: Star Trek in Research and Teaching, Stefan Rabitsch, Martin Gabriel, Wilfried Elmenreich and John N.A. Brown (eds.). Springer International Publishing, Cham, 83–93. https://doi.org/10.1007/978-3-319-73776-8_8Google Scholar
Cross Ref
- Tawfiq Ammari, Jofish Kaye, Janice Y. Tsai, and Frank Bentley. 2019. Music, search, and IoT: How people (really) use voice assistants. ACM Transactions on Computer-Human Interaction (TOCHI) 26, 3: 1–28.Google ScholarDigital Library
- Isaac Asimov. 1950. I, Robot.Google Scholar
- Benett Axtell, Christine Murad, Benjamin R. Cowan, Cosmin Munteanu, Leigh Clark, and Phillip Doyle. 2018. Hey Computer, Can We Hit the Reset Button on Speech? In Proc. of SIGCHI 2018 Extended Abstracts.Google Scholar
- Erin Beneteau, Ashley Boone, Yuxing Wu, Julie A. Kientz, Jason Yip, and Alexis Hiniker. 2020. Parenting with Alexa: Exploring the Introduction of Smart Speakers on Family Dynamics. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, 1–13.Google ScholarDigital Library
- Cliff Bole. 1990. Remember Me. Star Trek: The Next Generation.Google Scholar
- Richard A. Bolt. 1980. “Put-that-there”: Voice and gesture at the graphics interface. ACM.Google Scholar
- Rob Bowman. 1988. Datalore. Star Trek: The Next Generation.Google Scholar
- Rob Bowman. 1989. Manhunt. Star Trek: The Next Generation.Google Scholar
- Sergey Brin and Denis Diderot. 2017. Building the Star Trek Computer. In What Algorithms Want: Imagination in the Age of Computing. 57.Google Scholar
- Fabio Catania, Micol Spitale, Giulia Cosentino, and Franca Garzotto. 2020. What is the Best Action for Children to" Wake Up" and" Put to Sleep" a Conversational Agent? A Multi-Criteria Decision Analysis Approach. In Proceedings of the 2nd Conference on Conversational User Interfaces, 1–10.Google ScholarDigital Library
- José Coelho, Carlos Duarte, Pradipta Biswas, and Patrick Langdon. 2011. Developing Accessible TV Applications. In The Proceedings of the 13th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS ’11), 131–138. https://doi.org/10.1145/2049536.2049561Google ScholarDigital Library
- Eric Corbett and Astrid Weber. 2016. What can I say? Addressing user experience challenges of a mobile voice user interface for accessibility. Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services - MobileHCI ’16: 72–82. https://doi.org/10.1145/2935334.2935386Google ScholarDigital Library
- Abide Coskun-Setirek and Sona Mardikyan. 2017. Understanding the Adoption of Voice Activated Personal Assistants. Int. J. E-Services Mob. Appl. 9, 3: 1–21. https://doi.org/10.4018/IJESMA.2017070101Google ScholarDigital Library
- Benjamin R. Cowan. 2014. Understanding speech and language interactions in HCI: The importance of theory-based human-human dialogue research. In Designing speech and language interactions workshop, ACM conference on human factors in computing systems, CHI.Google Scholar
- Benjamin R. Cowan, Nadia Pantidi, David Coyle, Kellie Morrissey, Peter Clarke, Sara Al-Shehri, David Earley, and Natasha Bandeira. 2017. “What Can I Help You with?”: Infrequent Users’ Experiences of Intelligent Personal Assistants. In Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI ’17), 43:1-43:12. https://doi.org/10.1145/3098279.3098539Google ScholarDigital Library
- Joshua Cuneo. 2011. “Hello Computer”: The Interplay of Star Trek and Modern Computer. In Science Fiction and Computing: Essays on Interlinked Domains. McFarland.Google Scholar
- Paul Dourish and Genevieve Bell. 2014. “Resistance is futile”: reading science fiction alongside ubiquitous computing. Personal and Ubiquitous Computing 18, 4: 769–778. https://doi.org/10.1007/s00779-013-0678-7Google ScholarDigital Library
- Jens Edlund, Joakim Gustafson, Mattias Heldner, and Anna Hjalmarsson. 2008. Towards human-like spoken dialogue systems. Speech communication 50, 8–9: 630–645.Google Scholar
- Jonathon Frakes. 1992. The Quality of Life. Star Trek: The Next Generation.Google Scholar
- Anne Galloway. 2013. Emergent Media Technologies, Speculation, Expectation, and Human/Nonhuman Relations. Journal of Broadcasting & Electronic Media 57, 1: 53–65. https://doi.org/10.1080/08838151.2012.761705Google ScholarCross Ref
- Emer Gilmartin, Marine Collery, Ketong Su, Yuyun Huang, Christy Elias, Benjamin R. Cowan, and Nick Campbell. 2017. Social talk: making conversation with people and machine. In Proceedings of the 1st ACM SIGCHI International Workshop on Investigating Social Interactions with Artificial Agents, 31–32.Google ScholarDigital Library
- Emer Gilmartin, Benjamin R. Cowan, Carl Vogel, and Nick Campbell. 2017. Exploring Multiparty Casual Talk for Social Human-Machine Dialogue. In Speech and Computer (Lecture Notes in Computer Science), 370–378. https://doi.org/10.1007/978-3-319-66429-3_36Google ScholarCross Ref
- Ido Guy. 2016. Searching by Talking: Analysis of Voice Queries on Mobile Web Search. In Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval (SIGIR ’16), 35–44. https://doi.org/10.1145/2911451.2911525Google ScholarDigital Library
- Philipp Jordan and Brent Auernheimer. 2017. The fiction in computer science: a qualitative data analysis of the ACM digital library for traces of star trek. In International Conference on Applied Human Factors and Ergonomics, 508–520.Google Scholar
- Philipp Kirschthaler, Martin Porcheron, and Joel E. Fischer. 2020. What Can I Say? Effects of Discoverability in VUIs on Task Performance and User Experience. In Proceedings of the 2nd Conference on Conversational User Interfaces, 1–9.Google Scholar
- Stanley Kubrick. 1968. 2001: A Space Odyssey.Google Scholar
- Michael R. Levin. 2016. Amazon Echo - What We Know Now. HuffPost. Retrieved September 19, 2019 from https://www.huffpost.com/entry/amazon-echo–what-we-know_b_9802834Google Scholar
- Irene Lopatovska, Katrina Rink, Ian Knight, Kieran Raines, Kevin Cosenza, Harriet Williams, Perachya Sorsche, David Hirsch, Qi Li, and Adrianna Martinez. 2018. Talk to me: Exploring user interactions with the Amazon Alexa. Journal of Librarianship and Information Science: 0961000618759414. https://doi.org/10.1177/0961000618759414Google ScholarCross Ref
- Silvia Lovato and Anne Marie Piper. 2015. “Siri, is This You?”: Understanding Young Children's Interactions with Voice Input Systems. In Proceedings of the 14th International Conference on Interaction Design and Children (IDC ’15), 335–338. https://doi.org/10.1145/2771839.2771910Google ScholarDigital Library
- Ewa Luger and Abigail Sellen. 2016. Like having a really bad PA: the gulf between user expectation and experience of conversational agents. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, 5286–5297.Google ScholarDigital Library
- Teena Maddox. 2017. Tech leaders share how Star Trek inspired them to pursue a career in technology. TechRepublic. Retrieved September 20, 2019 from https://www.techrepublic.com/article/tech-leaders-share-how-star-trek-inspired-them-to-pursue-a-career-in-technology/Google Scholar
- Donald McMillan, Barry Brown, Ikkaku Kawaguchi, Razan Jaber, Jordi Solsona Belenguer, and Hideaki Kuzuoka. 2019. Designing with Gaze: Tama – a Gaze Activated Smart-Speaker. Proceedings of the ACM on Human-Computer Interaction 3, CSCW: 176:1-176:26. https://doi.org/10.1145/3359278Google ScholarDigital Library
- T. Daniel Midgley, Shelly Harrison, and Cara MacNish. 2006. Empirical Verification of Adjacency Pairs Using Dialogue Segmentation. In Proceedings of the 7th SIGdial Workshop on Discourse and Dialogue (SigDIAL ’06), 104–108. Retrieved September 20, 2019 from http://dl.acm.org/citation.cfm?id=1654595.1654615Google ScholarCross Ref
- Christine Murad. 2019. Tools to Support Voice User Interface Design. In Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI ’19), 1–5. https://doi.org/10.1145/3338286.3344424Google ScholarDigital Library
- Jakob Nielsen. 2003. Voice Interfaces: Assessing the Potential. Nielsen Norman Group. Retrieved September 20, 2019 from https://www.nngroup.com/articles/voice-interfaces-assessing-the-potential/Google Scholar
- Adam Nimoy. 1992. Rascals. Star Trek: The Next Generation.Google Scholar
- Steve North. 2019. Imaginary Studies: A Science Fiction Autoethnography Concerning the Design, Implementation and Evaluation of a Fictional Quantitative Study to Evaluate the Umamimi Robotic Horse Ears. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems, alt03.Google ScholarDigital Library
- Amy Packham. 2018. Amazon's Alexa Will Reward Kids For Saying “Please” And “Thank You” | HuffPost Canada. HuffPost. Retrieved September 20, 2019 from https://www.huffingtonpost.ca/entry/amazon-alexa-kids-please-thank-you_uk_5ae19610e4b02baed1b6dadaGoogle Scholar
- Martin Porcheron, Joel E. Fischer, Stuart Reeves, and Sarah Sharples. 2018. Voice Interfaces in Everyday Life. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI ’18), 640:1-640:12. https://doi.org/10.1145/3173574.3174214Google ScholarDigital Library
- Daniel M. Russell and Svetlana Yarosh. 2018. Can we look to science fiction for innovation in HCI? interactions 25, 2: 36–40.Google Scholar
- Emanuel A. Schegloff and Harvey Sacks. 1973. Opening up closings. Semiotica 8, 4: 289–327.Google ScholarCross Ref
- Alex Sciuto, Arnita Saini, Jodi Forlizzi, and Jason I. Hong. 2018. Hey Alexa, What's Up?: A mixed-methods studies of in-home conversational agent usage. In Proceedings of the 2018 Designing Interactive Systems Conference, 857–868.Google Scholar
- Petra-Maria Strauß, Holger Hoffmann, Wolfgang Minker, Heiko Neumann, Günther Palm, Stefan Scherer, Friedhelm Schwenker, Harald C. Traue, Welf Walter, and Ulrich Weidenbacher. 2006. Wizard-of-Oz Data Collection for Perception and Interaction in Multi-User Environments. In LREC, 2014–2017.Google Scholar
- Aaron Suplizio, Cherian Abraham, and Ben Bajarin. 2016. Unpacking the Breakout Success of the Amazon Echo. Experian. Retrieved September 19, 2019 from https://www.experian.com/innovation/thought-leadership/amazon-echo-consumer-survey.jspGoogle Scholar
- Janice Y Tsai, Jofish Kaye, Tawfiq Ammari, and Abraham Wallin. 2018. Alexa, play some music: Categorization of Alexa Commands. Voice-based Conversational UX Studies and Design Wokrshop at CHI: 4.Google Scholar
- Gokhan Tur, Dilek Hakkani-Tür, and Larry Heck. 2010. What is left to be understood in ATIS? In 2010 IEEE Spoken Language Technology Workshop, 19–24.Google ScholarCross Ref
- Brenda K. Wiederhold. 2018. “Alexa, Are You My Mom?” The Role of Artificial Intelligence in Child Development. Mary Ann Liebert, Inc. 140 Huguenot Street, 3rd Floor New Rochelle, NY 10801 USA.Google Scholar
- Stacy L Wood. 2002. Future fantasies: a social change perspective of retailing in the 21st century☆ ☆Stacy L. Wood is assistant professor of marketing at The Moore School of Business, University of South Carolina, Columbia, SC, 29208; Phone (803) 777-4920; Email [email protected]. The author would like to thank Bruce Money, Sherry Roberts, Danny Wadden, and Georgiana Craciun for their assistance with this research. Journal of Retailing 78, 1: 77–83. https://doi.org/10.1016/S0022-4359(01)00069-0Google ScholarCross Ref
- Linda Wulf, Markus Garschall, Julia Himmelsbach, and Manfred Tscheligi. 2014. Hands Free - Care Free: Elderly People Taking Advantage of Speech-only Interaction. In Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational (NordiCHI ’14), 203–206. https://doi.org/10.1145/2639189.2639251Google ScholarDigital Library
- Victor Zue, Stephanie Seneff, James R. Glass, Joseph Polifroni, Christine Pao, Timothy J. Hazen, and Lee Hetherington. 2000. JUPlTER: a telephone-based conversational interface for weather information. IEEE Transactions on speech and audio processing 8, 1: 85–96.Google ScholarCross Ref
- The hottest thing in technology is your voice - Technology & Science - CBC News. Retrieved February 1, 2018 from http://www.cbc.ca/news/technology/brunhuber-ces-voice-activated-1.4483912Google Scholar
- Memory Alpha. Retrieved from https://memory-alpha.fandom.com/wiki/Portal:Main. Retrieved September 20, 2019 from https://memory-alpha.fandom.com/wiki/Portal:MainGoogle Scholar
Index Terms
- Tea, Earl Grey, Hot: Designing Speech Interactions from the Imagined Ideal of Star Trek
Index terms have been assigned to the content through auto-classification.
Recommendations
Design guidelines for hands-free speech interaction
MobileHCI '18: Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services AdjunctAs research on speech interfaces continues to grow in the field of HCI, there is a need to develop design guidelines that help solve usability and learnability issues that exist in hands-free speech interfaces. While several sets of established ...
Towards a human-computer interaction model for voice user interfaces
CLIHC '19: Proceedings of the IX Latin American Conference on Human Computer InteractionThe user interaction with computer systems has evolved over the years, from Command Line Interfaces (CLIs), Graphics User Interfaces (GUIs), Natural User Interfaces (NUIs) and actually Voice User Interfaces (VUIs). The use of VUIs is increasingly common,...
Multimodal interfaces design issues: the fusion of well-designed voice and graphical user interfaces
SIGDOC '08: Proceedings of the 26th annual ACM international conference on Design of communicationThis poster describes a novel approach that is intended to combine graphical user interfaces (GUI) and voice interaction in the Web throughout the design and the development of intuitive and user-friendly multimodal interfaces. We are considering the ...
Comments