Sanju Ahuja
ABSTRACT
Virtual assistants (VA) such as Alexa, Siri and Google Assistant are becoming increasingly popular. Recent literature has argued that VAs may raise ethical concerns for users’ autonomy. However, there is a lack of frameworks which can unite the wide range of autonomy concerns discussed in literature, as well as help designers envision the ethical implications of emerging VA technologies. This paper argues that designers and policymakers need to be sensitive to the ethical side of the future of virtual assistants, and systematic frameworks are required to aid their moral imagination. The paper proposes a framework to help designers imagine potential ethical concerns pertaining to users’ autonomy. We demonstrate the usefulness of the proposed framework by showing how existing ethical concerns can be situated within the framework. We also use the framework to imagine ethical concerns with emerging VA technologies. The proposed framework can aid in systematic identification of autonomy related ethical concerns within human computer interactions.
- João Santos, Joel J. P. C. Rodrigues, Bruno M. C. Silva, João Casal, Kashif Saleem, and Victor Denisov. 2016. An IoT-based mobile gateway for intelligent personal assistants on mobile health environments. Journal of Network and Computer Applications 71, 194–204. https://doi.org/10.1016/j.jnca.2016.03.014Google Scholar
Digital Library
- Arsénio Reis, Dennis Paulino, Hugo Paredes, and João Barroso. 2017. Using Intelligent Personal Assistants to Strengthen the Elderlies’ Social Bonds. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 10279, 593–602. https://doi.org/10.1007/978-3-319-58700-4_48Google ScholarCross Ref
- Umair Saad, Usama Afzal, Ahmad El-Issawi, and Mohamad Eid. 2017. A model to measure QoE for virtual personal assistant. Multimedia Tools and Applications 76, 12517-12537. https://doi.org/10.1007/s11042-016-3650-5Google ScholarDigital Library
- Sangyeal Han and Heetae Yang. 2018. Understanding adoption of intelligent personal assistants: A parasocial relationship perspective. Industrial Management and Data Systems 118, 3, 618–636. https://doi.org/10.1108/IMDS-05-2017-0214Google ScholarCross Ref
- Qian Hu, Zhao Pan, and Jingwen Liu. 2019. The Duality of Autonomy on Continuous Usage of Intelligent Personal Assistants (IPAs): From Agency Perspective. In PACIS 2019 Proceedings 96. https://aisel.aisnet.org/pacis2019/96Google Scholar
- William Seymour, Reuben Binns, Petr Slovak, Max Van Kleek, and Nigel Shadbolt. 2020. Strangers in the Room: Unpacking Perceptions of 'Smartness' and Related Ethical Concerns in the Home. In Proceedings of the 2020 ACM Designing Interactive Systems Conference (DIS ’20), 841–854. https://doi.org/10.1145/3357236.3395501Google ScholarDigital Library
- Peter-Paul Verbeek. 2006. Persuasive Technology and Moral Responsibility Toward an ethical framework for persuasive technologies. Paper for Persuasive 06.Google Scholar
- Lachlan Urquhart, Dominic Reedman-Flint, and Natalie Leesakul. 2019. Responsible domestic robotics: exploring ethical implications of robots in the home. Journal of Information, Communication and Ethics in Society 17, 2, 246-272. https://doi.org/10.1108/JICES-12-2018-0096Google ScholarCross Ref
- Josephine Lau, Benjamin Zimmerman, and Florian Schaub. 2018. Alexa, Are You Listening? Privacy Perceptions, Concerns and Privacy-seeking Behaviors with Smart Speakers. In Proceedings of the ACM on Human Computer Interaction 2, CSCW, Article 102 (November 2018), 31 pages. https://doi.org/10.1145/3274371Google ScholarDigital Library
- Jongkeon Kim and Jeongyun Heo. 2021. Please Stop Listening While I Make a Private Call: Context-Aware In-Vehicle Mode of a Voice-Controlled Intelligent Personal Assistant with a Privacy Consideration. In: Moallem, A. (eds) HCII 2021: HCI for Cybersecurity, Privacy and Trust, 177-193. https://doi.org/10.1007/978-3-030-77392-2_12Google ScholarDigital Library
- Cherie Lacey and Catherine Caudwell. (2019). Cuteness as a ‘Dark Pattern’ in Home Robots. 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI ‘19), Daegu, South Korea, 374-381. https://doi.org/10.1109/HRI.2019.8673274Google ScholarCross Ref
- Hilde A. M. Voorveld and Theo Araujo. How Social Cues in Virtual Assistants Influence Concerns and Persuasion: The Role of Voice and a Human Name. Cyberpsychology, Behavior, and Social Networking 23, 10, 689-696. https://doi.org/10.1089/cyber.2019.0205Google ScholarCross Ref
- Heather Suzanne Woods. 2018. Asking more of Siri and Alexa: feminine persona in service of surveillance capitalism. Critical Studies in Media Communication 35, 4, 334-349. https://doi.org/10.1080/15295036.2018.1488082Google ScholarCross Ref
- Anastasia Vugts, Mariëtte van den Hoven, Emely de Vet, and Marcel Verweij. 2020. How autonomy is understood in discussions on the ethics of nudging. Behavioural Public Policy 4, 1, 108-123. https://doi.org/10.1017/bpp.2018.5Google ScholarCross Ref
- Arunesh Mathur, Jonathan Mayer, and Mihir Kshirsagar. 2021. What Makes a Dark Pattern...Dark?: Design Attributes, Normative Considerations, and Measurement Methods. CHI Conference on Human Factors in Computing Systems (CHI ’21), Article 360 (May 2021), 18 pages, Yokohama, Japan. https://doi.org/10.1145/3411764.3445610Google ScholarDigital Library
- Orsolya Friedrich, Eric Racine, Steffen Steinert, Johannes Pömsl, and Ralf J. Jox. 2018. An analysis of the impact of brain-computer interfaces on autonomy. Neuroethics 14, 17-29. https://doi.org/10.1007/s12152-018-9364-9Google ScholarCross Ref
- Dimitrios Rafailidis and Yannis Manolopoulos. 2019. Can Virtual Assistants Produce Recommendations? In Proceedings of the 9th International Conference on Web Intelligence, Mining and Semantics (WIMS2019), Article 4 (June 2019), 6 pages. https://doi.org/10.1145/3326467.3326468Google ScholarDigital Library
- Michael Nagenborg. 2014. Surveillance and persuasion. Ethics and Information Technology 16, 43–49. https://doi.org/10.1007/s10676-014-9339-4Google ScholarDigital Library
- Pelle Guldborg Hansen and Andreas Maaløe Jespersen (2013). Nudge and the Manipulation of Choice: A Framework for the Responsible Use of the Nudge Approach to Behaviour Change in Public Policy. European Journal of Risk Regulation 1, 3-28. https://ssrn.com/abstract=2555337Google ScholarCross Ref
- Jack W. Brehm. 1966. A theory of psychological reactance. Academic Press.Google Scholar
- Peter-Paul Verbeek. 2009. Ambient Intelligence and Persuasive Technology: The Blurring Boundaries Between Human and Technology. Nanoethics 3, 232-242. https://doi.org/10.1007/s11569-009-0077-8Google ScholarCross Ref
- Colin M. Gray, Shruthi Sai Chivukula, and Ahreum Lee. 2020. What Kind of Work Do "Asshole Designers" Create? Describing Properties of Ethical Concern on Reddit. ACM Designing Interactive Systems Conference (DIS ’20), Eindhoven, Netherlands. https://doi.org/10.1145/3357236.3395486Google ScholarDigital Library
- Saul Greenberg, Sebastian Boring, Jo Vermeulen, and Jakub Dostal. 2014. Dark Patterns in Proxemic Interactions: A Critical Perspective. ACM Designing Interactive Systems Conference (DIS ’14), Vancouver, BC, Canada. https://doi.org/10.1145/2598510.2598541Google ScholarDigital Library
- Chris Lewis. 2014. Irresistible Apps: Motivational Design Patterns for Apps, Games, and Web-based Communities. Apress.Google ScholarCross Ref
- Monika Betzler. 2009. Authenticity and self-governance. In Emotions, ethics, and authenticity, ed. Mikko Salmela and Verena Mayer, 51–68. John Benjamins Publishing Company.Google Scholar
- Sasha Burwell, Matthew Sample, and Eric Racine. 2017. Ethical aspects of brain computer interfaces: a scoping review. BMC Medical Ethics 18, Article 60, 11 pages. https://doi.org/10.1186/s12910-017-0220-yGoogle ScholarCross Ref
- Eli Pariser. 2017. The Filter Bubble: What the Internet Is Hiding from You. Penguin Books, London, UK.Google Scholar
- Daniel Susser, Beate Roessler, and Helen Nissenbaum. 2019. Technology, autonomy, and manipulation. Internet Policy Review 8, 2. https://doi.org/10.14763/2019.2.1410Google ScholarCross Ref
- Alisha Pradhan, Kanika Mehta, and Leah Findlater. 2018. Accessibility Came by Accident: Use of Voice-Controlled Intelligent Personal Assistants by People with Disabilities. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, Article 459, 13 pages. http://dx.doi.org/10.1145/3173574.3174033Google ScholarDigital Library
- Christopher Frauenberger, Katta Spiel, and Julia Makhaeva. 2019. Thinking OutsideTheBox - Designing Smart Things with Autistic Children. International Journal of Human–Computer Interaction 35, 8 (2019), 666–678. http://dx.doi.org/10.1080/10447318.2018.1550177Google ScholarCross Ref
- Jamie Sanders and Aqueasha Martin-Hammond. 2019. Exploring autonomy in the design of an intelligent health assistant for older adults. In Proceedings of the 24th International Conference on Intelligent User Interfaces: Companion (IUI '19), 95–96. https://doi.org/10.1145/3308557.3308713Google ScholarDigital Library
Index Terms
- Assistant or Master: Envisioning the User Autonomy Implications of Virtual Assistants
Recommendations
Collaborating with Virtual Assistants in Organizations: Analyzing Social Loafing Tendencies and Responsibility Attribution
AbstractOrganizations increasingly introduce collaborative technologies in form of virtual assistants (VAs) to save valuable resources, especially when employees are assisted with work-related tasks. However, the effect of VAs on virtual teams and ...
From ethics washing to ethics bashing: a view on tech ethics from within moral philosophy
FAT* '20: Proceedings of the 2020 Conference on Fairness, Accountability, and TransparencyThe word 'ethics' is under siege in technology policy circles. Weaponized in support of deregulation, self-regulation or handsoff governance, "ethics" is increasingly identified with technology companies' self-regulatory efforts and with shallow ...
Mind and machine: ethical and epistemological implications for research
Special Issue: Ethics and Aesthetics of TechnologiesTechnologies are significant in research not only as instruments for gathering data and analyzing information; they also provide a valuable resource for the development of theory—in terms of what has been called the “tools to theory heuristic.” Focusing ...
Comments