Skip to main content
SpringerLink
Log in
SpringerLink
Log in

Just a Natural Talk? The Rise of Intelligent Personal Assistants and the (Hidden) Legacy of Ubiquitous Computing

  • Conference paper
  • First Online:
Design, User Experience, and Usability. Design for Contemporary Interactive Environments (HCII 2020)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 12201))

Included in the following conference series:

Abstract

In this paper we trace the connection between the paradigm of disappearing computers and the design of today’s Intelligent Personal Assistants (IPAs). We show how the concept of natural interaction stems from the emergence of a specific interpretation of the idea of disappearing computers (ubicomp). This interpretation has emerged as a technology centred perspective, losing the link with the complex philosophical principles which inspired the founders of UbiComp. As a result, the dominant understanding of natural interaction reflects this loss of complexity, influencing the way IPAs are currently developed. To better understand the implications of having adopted this paradigm, we carried out a literature review of recent academic studies on the use of IPAs. Using a three-lenses framework helped us identify six major assumptions behind the design of IPAs. The paper ends with a discussion of the emerging design challenges in the field of voice-activated devices and how these relate to the dominant paradigm of natural interaction.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Lima, L., Furtado, E., Furtado, V., Almeida, V.: Empirical analysis of bias in voice-based personal assistants. In: Companion Proceedings of the 2019 World Wide Web Conference, WWW 2019 (2019)

    Google Scholar 

  2. Weiser, M.: The computer for the 21st century. Sci. Am. 265(3), 94–104 (1991)

    Article  Google Scholar 

  3. Takayama, L.: The motivations of ubiquitous computing: revisiting the ideas behind and beyond the prototypes. Pers. Ubiquit. Comput. 21(3), 557–569 (2017)

    Article  Google Scholar 

  4. Poslad, S.: Ubiquitous Computing. Smart Devices, Environments and Interactions, p. 473 (2009)

    Google Scholar 

  5. Dey, A.K., Ljungstrand, P., Schmidt, A.: Distributed and disappearing user interfaces in ubiquitous computing. In: CHI 2001 Extended Abstracts on Human Factors in Computing Systems, CHI EA 2001 (2001)

    Google Scholar 

  6. Streitz, N.: From cognitive compatibility to the disappearing computer: experience design for smart environments. In: Proceedings of the 15th European Conference on Cognitive Ergonomics: The Ergonomics of Cool Interaction, ECCE 2008 (2008)

    Google Scholar 

  7. Lim, Y.K.: Disappearing interfaces. Interactions 19(5), 36–39 (2012)

    Article  Google Scholar 

  8. van Dam, A.: User interfaces: disappearing, dissolving, and evolving. Commun. ACM 44(3), 50–52 (2001)

    Article  Google Scholar 

  9. Hui, T.K., Sherratt, R.S.: Towards disappearing user interfaces for ubiquitous computing: human enhancement from sixth sense to super senses. J. Ambient Intell. Hum. Comput. 8(3), 449–465 (2017)

    Article  Google Scholar 

  10. Ryan, S.E.: Re-visioning the interface: technological fashion as critical media. In: ACM SIGGRAPH 2009 Art Gallery, SIGGRAPH 2009, vol. 42, no. 4, pp. 307–313 (2009)

    Google Scholar 

  11. Norman, D.A.: Natural user interfaces are not natural. Interactions 17(3), 6–10 (2010)

    Article  Google Scholar 

  12. Hansen, L.K., Dalsgaard, P.: Note to self: stop calling interfaces “natural”. In: Proceedings of the Fifth Decennial Aarhus Conference on Critical Alternatives, CA 2015 (2015)

    Google Scholar 

  13. Hara, K.O., Harper, R., Mentis, H., Sellen, A., Taylor, A.: On the naturalness of touchless: putting the “interaction” back into NUI. ACM Trans. Comput.-Hum. Interact. (TOCHI) 20(1), 1–27 (2013)

    Article  Google Scholar 

  14. Murad, C., Munteanu, C.: I don’t know what you’re talking about, HALexa”: the case for voice user interface guidelines. In: Proceedings of the 1st International Conference on Conversational User Interfaces (2019)

    Google Scholar 

  15. Porcheron, M., Fischer, J.E., Reeves, S., Sharples, S.: Voice interfaces in everyday life. In: Proceedings of the Conference on Human Factors in Computing Systems (2018)

    Google Scholar 

  16. Baber, C.: “Speech output,” in developing interactive speech technology. In: Baber, C., Noyes, J.M. (eds.) Interactive Speech Technology: Human Factors Issues in the Application of Speech Input/Output to Computers, pp. 1–18. Taylor & Francis (2002)

    Google Scholar 

  17. Branham, S.M., Roy, A.R.M.: Reading between the guidelines: how commercial voice assistant guidelines hinder accessibility for blind users. In: 21st International ACM SIGACCESS Conference on Computers and Accessibility, ASSETS 2019 (2019)

    Google Scholar 

  18. Lee, S.S., Lee, J., Lee, K.P.: Designing intelligent assistant through user participations. In: Proceedings of the 2017 ACM Conference on Designing Interactive Systems, DIS 2017 (2017)

    Google Scholar 

  19. Purington, A., Taft, J.G., Sannon, S., Bazarova, N.N., Taylor, S.H.: “Alexa is my new BFF”: social roles, user satisfaction, and personification of the Amazon Echo. In: Proceedings of the Conference on Human Factors in Computing Systems, vol. Part F1276, pp. 2853–2859 (2017)

    Google Scholar 

  20. Bhattacherjee, A.: Understanding information systems continuance: an expectation-confirmation model. MIS Q. 25(3), 351–370 (2001)

    Article  Google Scholar 

  21. Kocielnik, R., Amershi, S., Bennett, P.N.: Will you accept an imperfect AI? Exploring designs for adjusting end-user expectations of AI systems. In: Proceedings of the Conference on Human Factors in Computing Systems, Glasgow, UK (2019)

    Google Scholar 

  22. Mitev, R., Miettinen, M., Sadeghi, A.R.: Alexa lied to me: skill-based man-in-the-middle attacks on virtual assistants. In: Proceedings of the 2019 ACM Asia Conference on Computer and Communications Security, ASIACCS 2019 (2019)

    Google Scholar 

  23. Pradhan, A., Findlater, L., Lazar, A.: “Phantom friend” or “just a box with information”: personification and ontological categorization of smart speaker-based voice assistants by older adults. In: Proceedings of the ACM on Human-Computer Interaction, vol. 3, no. CSCW, p. Art No. 214 (2019)

    Google Scholar 

  24. Lovato, S., Marie Piper, A.: “Siri, is this you?”: Understanding young children’s interactions with voice input systems. In: Proceedings of IDC 2015: The 14th International Conference on Interaction Design and Children (2015)

    Google Scholar 

  25. Bhalla, A.: An exploratory study understanding the appropriated use of voice-based Search and Assistants. In: Proceedings of the 9th Indian Conference on Human Computer Interaction, IndiaHCI 2018 (2018)

    Google Scholar 

  26. Lopatovska, I., Williams, H.: Personification of the Amazon Alexa: BFF or a mindless companion? In: Proceedings of the 2018 Conference on Human Information Interaction and Retrieval, CHIIR 2018 (2018)

    Google Scholar 

  27. Velkovska, J., Zouinar, M.: The illusion of natural conversation: interacting with smart assistants in home settings. In: CHI 2018 Extended Abstracts (2018)

    Google Scholar 

  28. Cambre, J., Kulkarni, C.: One voice fits all? Social implications and research challenges of designing voices for smart devices. In: Proceedings of the ACM on Human-Computer Interaction, vol. 3, no. CSCW, pp. 223:1–223:19 (2019)

    Google Scholar 

  29. Doyle, P.R., Edwards, J., Dumbleton, O., Clark, L., Cowan, B.R.: Mapping perceptions of humanness in intelligent personal assistant interaction. In: Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services, MobileHCI 2019 (2019)

    Google Scholar 

  30. Cowan, B.R., et al.: “What can i help you with?”: Infrequent users’ experiences of intelligent personal assistants. In: Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services, MobileHCI 2017 (2017)

    Google Scholar 

  31. Furqan, A., Myers, C., Zhu, J.: Learnability through adaptive discovery tools in voice user interfaces. In: Proceedings of the Conference on Human Factors in Computing Systems (2017)

    Google Scholar 

  32. Ghosh, D., Foong, P.S., Zhang, S., Zhao, S.: Assessing the utility of the system usability scale for evaluating voice-based user interfaces. In: Proceedings of the Sixth International Symposium of Chinese CHI, ChineseCHI 2018 (2018)

    Google Scholar 

  33. Søndergaard, M.L.J., Hansen, L.K.: Intimate futures: staying with the trouble of digital personal assistants through design fiction. In: Proceedings of the 2018 Designing Interactive Systems Conference, DIS 2018 (2018)

    Google Scholar 

  34. Habler, F., Schwind, V., Henze, N.: Effects of smart virtual assistants’ gender and language. In: ACM International Conference Proceeding Series, pp. 469–473 (2019)

    Google Scholar 

  35. Kahn, P.H., Gary, H.E., Shen, S.: Children’s social relationships with current and near-future robots. Child. Dev. Perspect. 7(1), 32–37 (2013)

    Article  Google Scholar 

  36. Aylett, M.P., Clark, L., Cowan, B.R.: Siri, echo and performance: you have to suffer darling. In: Proceedings of the Conference on Human Factors in Computing Systems (2019)

    Google Scholar 

  37. Braun, M., Alt, F.: Affective assistants: a matter of states and traits. In: Proceedings of the Conference on Human Factors in Computing Systems (2019)

    Google Scholar 

  38. Gürkök, H., Hakvoort, G., Poel, M., Nijholt, A.: User expectations and experiences of a speech and thought controlled computer game. In: Proceedings of the 8th International Conference on Advances in Computer Entertainment Technology, ACE 2011 (2011)

    Google Scholar 

  39. Azmandian, M., Arroyo-Palacios, J., Osman, S.: Guiding the behavior design of virtual assistants. In: Proceedings of the 19th ACM International Conference on Intelligent Virtual Agents, IVA 2019 (2019)

    Google Scholar 

  40. Krippendorf, K.: The Semantic Turn. A New Foundation for Design, p. 368. CRC Press, Boca Raton (2005)

    Book  Google Scholar 

  41. Kim, S., Row,Y.K., Nam, T.J.: Thermal interaction with a voice-based intelligent agent. In: Proceedings of the Conference on Human Factors in Computing Systems (2018)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Politecnico di Milano, Dipartimento di Design, Milan, Italy

    Gabriele Barzilai & Lucia Rampino

Authors
  1. Gabriele Barzilai
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Lucia Rampino
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Lucia Rampino .

Editor information

Editors and Affiliations

  1. Aaron Marcus and Associates, Berkeley, CA, USA

    Aaron Marcus

  2. World Usability Day and Bentley User Experience Center, Newton Center, MA, USA

    Elizabeth Rosenzweig

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Barzilai, G., Rampino, L. (2020). Just a Natural Talk? The Rise of Intelligent Personal Assistants and the (Hidden) Legacy of Ubiquitous Computing. In: Marcus, A., Rosenzweig, E. (eds) Design, User Experience, and Usability. Design for Contemporary Interactive Environments. HCII 2020. Lecture Notes in Computer Science(), vol 12201. Springer, Cham. https://doi.org/10.1007/978-3-030-49760-6_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-49760-6_2

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-49759-0

  • Online ISBN: 978-3-030-49760-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation