Audrey Desjardins
ABSTRACT
Responding to concerns such as privacy, surveillance, and the commodification of personal data with regards to voice assistants, this artistic research focuses on creating performative artifacts and vignettes that challenge artificial intelligence (AI) and machine learning (ML) technologies. By allowing AI voice assistants to listen to our most private conversations, we become receptive to their mediated care, while forgetting or ignoring how much these automated interactions have been pre-scripted. With our project Voices and Voids, we reclaim, examine, and ultimately transcode these voice assistant data through interdisciplinary performance and Post-Internet Art. In this paper, we thematically describe 12 vignettes which represent embodied and sonic experiments using a combination of design, data-driven art, cyber crafts, found-object and traditional percussion instruments, spoken word, and movement. We conclude with a discussion of how the experiments worked as a multifaceted whole, and how we used interdisciplinary methods as a central approach.
- Ashraf Abdul, Jo Vermeulen, Danding Wang, Brian Y. Lim, and Mohan Kankanhalli. 2018. Trends and Trajectories for Explainable, Accountable and Intelligible Systems: An HCI Research Agenda. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–18. Retrieved February 15, 2021 from http://doi.org/10.1145/3173574.3174156Google Scholar
Digital Library
- Hazim Almuhimedi, Florian Schaub, Norman Sadeh, Idris Adjerid, Alessandro Acquisti, Joshua Gluck, Lorrie Faith Cranor, and Yuvraj Agarwal. 2015. Your Location has been Shared 5,398 Times! A Field Study on Mobile App Privacy Nudging. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 787–796. Retrieved February 15, 2021 from http://doi.org/10.1145/2702123.2702210Google ScholarDigital Library
- Maryanne Amacher. Maryanne Amacher - Monoskop. Retrieved February 17, 2021 from https://monoskop.org/Maryanne_AmacherGoogle Scholar
- Tawfiq Ammari, Jofish Kaye, Janice Y. Tsai, and Frank Bentley. 2019. Music, Search, and IoT: How People (Really) Use Voice Assistants. ACM Trans. Comput.-Hum. Interact. 26, 3 (April 2019), 1–28. DOI:https://doi.org/10.1145/3311956Google ScholarDigital Library
- Annette Arlander, Bruce Barton, Melanie Dreyer-Lude, and Ben Spatz (Eds.). 2017. Performance as Research: Knowledge, methods, impact (1st edition ed.). Routledge, New York.Google Scholar
- Frank Bentley, Chris Luvogt, Max Silverman, Rushani Wirasinghe, Brooke White, and Danielle Lottrjdge. 2018. Understanding the Long-Term Use of Smart Speaker Assistants. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 2, 3 (September 2018), 1–24. DOI:https://doi.org/10.1145/3264901Google ScholarDigital Library
- Heidi R. Biggs, Cayla Key, Audrey Desjardins, and Afroditi Psarra. 2021. Moving Design Research: GIFs as Research Tools. In Proceedings of the 2021 Designing Interactive Systems Conference (DIS’21), ACM Press, 1–14.Google ScholarDigital Library
- Simone Browne. 2015. Dark Matters: On the Surveillance of Blackness (Illustrated edition ed.). Duke University Press Books, Durham.Google ScholarCross Ref
- John Cage. 2015. John Cage: Diary: How to Improve the World (1965)ghost (n edition ed.). Siglio, Los Angeles, Calif.Google Scholar
- Julia Cambre, Samantha Reig, Queenie Kravitz, and Chinmay Kulkarni. 2020. “All Rise for the AI Director”: Eliciting Possible Futures of Voice Technology through Story Completion. In Proceedings of the 2020 ACM Designing Interactive Systems Conference. Association for Computing Machinery, New York, NY, USA, 2051–2064. Retrieved January 25, 2021 from http://doi.org/10.1145/3357236.3395479Google ScholarDigital Library
- Linda Candy and Ernest Edmonds (Eds.). 2012. Interacting: Art, Research and the Creative Practitioner. Libri Publishing.Google Scholar
- Eugene Cho. 2019. Hey Google, Can I Ask You Something in Private? In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI ’19), Association for Computing Machinery, New York, NY, USA, 1–9. DOI:https://doi.org/10.1145/3290605.3300488Google ScholarDigital Library
- James Coupe. JAMES COUPE | Time-Clock. Retrieved February 9, 2021 from http://jamescoupe.com/?p=2476Google Scholar
- James Coupe. JAMES COUPE | Let Us Pray. Retrieved February 9, 2021 from http://jamescoupe.com/?p=2439Google Scholar
- James Coupe. JAMES COUPE | General Intellect. Retrieved February 9, 2021 from http://jamescoupe.com/?p=2093Google Scholar
- Kate Crawford and Vladan Joler. 2018. Anatomy of an AI System. Anatomy of an AI System. Retrieved February 21, 2021 from http://www.anatomyof.aiGoogle Scholar
- Audrey Desjardins, Heidi R. Biggs, Cayla Key, and Jeremy E. Viny. 2020. IoT Data in the Home: Observing Entanglements and Drawing New Encounters. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI ’20), Association for Computing Machinery, Honolulu, HI, USA, 1–13. DOI:https://doi.org/10.1145/3313831.3376342Google ScholarDigital Library
- Catherine D'Ignazio and Lauren F. Klein. 2020. Data Feminism. MIT Press.Google Scholar
- Stefania Druga, Randi Williams, Cynthia Breazeal, and Mitchel Resnick. 2017. “Hey Google is it OK if I eat you?”: Initial Explorations in Child-Agent Interaction. In Proceedings of the 2017 Conference on Interaction Design and Children (IDC ’17), Association for Computing Machinery, New York, NY, USA, 595–600. DOI:https://doi.org/10.1145/3078072.3084330Google ScholarDigital Library
- Justin Edwards and Elaheh Sanoubari. 2019. A need for trust in conversational interface research. In Proceedings of the 1st International Conference on Conversational User Interfaces (CUI ’19), Association for Computing Machinery, New York, NY, USA, 1–3. DOI:https://doi.org/10.1145/3342775.3342809Google ScholarDigital Library
- William Gaver. 2012. What should we expect from research through design? In Proceedings of the 2012 ACM annual conference on Human Factors in Computing Systems (CHI ’12), ACM, New York, NY, USA, 937–946. DOI:https://doi.org/10.1145/2208516.2208538Google ScholarCross Ref
- Wesley Goatley. Chthonic Rites | Wesley Goatley. Retrieved February 9, 2021 from https://www.wesleygoatley.com/chthonic-rites/Google Scholar
- Mary L. Gray and Siddharth Suri. 2019. Ghost Work: How to Stop Silicon Valley from Building a New Global Underclass (Illustrated edition ed.). Houghton Mifflin Harcourt, Boston.Google Scholar
- Garnet Hertz. Experiments in Surveillance Capitalism. Retrieved February 9, 2021 from http://conceptlab.com/surveillancecapitalism/Google Scholar
- Joseph Lindley, Haider Ali Akmal, Franziska Pilling, and Paul Coulton. 2020. Researching AI Legibility through Design. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI ’20), Association for Computing Machinery, New York, NY, USA, 1–13. DOI:https://doi.org/10.1145/3313831.3376792Google ScholarDigital Library
- Ilan Manouach. Harvested – Ilan Manouach. Retrieved February 9, 2021 from https://ilanmanouach.com/project/harvested/Google Scholar
- Ilan Manouach. The Cubicle Island – Ilan Manouach. Retrieved February 9, 2021 from https://ilanmanouach.com/project/cubicleisland/Google Scholar
- Lauren Lee McCarthy. SOMEONE — Lauren Lee McCarthy. Retrieved February 9, 2021 from https://lauren-mccarthy.com/SOMEONEGoogle Scholar
- Nicholas Micallef, Mike Just, Lynne Baillie, and Maher Alharby. 2017. Stop annoying me! an empirical investigation of the usability of app privacy notifications. In Proceedings of the 29th Australian Conference on Computer-Human Interaction (OZCHI ’17), Association for Computing Machinery, New York, NY, USA, 371–375. DOI:https://doi.org/10.1145/3152771.3156139Google ScholarDigital Library
- Iohanna Nicenboim, Elisa Giaccardi, Marie Louise Juul Søndergaard, Anuradha Venugopal Reddy, Yolande Strengers, James Pierce, and Johan Redström. 2020. More-Than-Human Design and AI: In Conversation with Agents. In Companion Publication of the 2020 ACM Designing Interactive Systems Conference (DIS’ 20 Companion), Association for Computing Machinery, New York, NY, USA, 397–400. DOI:https://doi.org/10.1145/3393914.3395912Google ScholarDigital Library
- Emmi Parviainen and Marie Louise Juul Søndergaard. 2020. Experiential Qualities of Whispering with Voice Assistants. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–13. Retrieved January 25, 2021 from http://doi.org/10.1145/3313831.3376187Google ScholarDigital Library
- James Pierce. 2019. Smart Home Security Cameras and Shifting Lines of Creepiness: A Design-Led Inquiry. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI ’19), ACM, New York, NY, USA, 45:1-45:14. DOI:https://doi.org/10.1145/3290605.3300275Google ScholarDigital Library
- James Pierce, Sarah Fox, Nick Merrill, Richmond Wong, and Carl DiSalvo. 2018. An Interface Without A User: An Exploratory Design Study of Online Privacy Policies and Digital Legalese. In Proceedings of the 2018 Designing Interactive Systems Conference (DIS ’18), ACM, New York, NY, USA, 1345–1358. DOI:https://doi.org/10.1145/3196709.3196818Google ScholarDigital Library
- Martin Porcheron, Joel E. Fischer, Stuart Reeves, and Sarah Sharples. 2018. Voice Interfaces in Everyday Life. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI ’18), Association for Computing Machinery, New York, NY, USA, 1–12. DOI:https://doi.org/10.1145/3173574.3174214Google ScholarDigital Library
- Matt Ratto. 2011. Critical Making: Conceptual and Material Studies in Technology and Social Life. The Information Society 27, 4 (July 2011), 252–260. DOI:https://doi.org/10.1080/01972243.2011.583819Google ScholarDigital Library
- Stuart Reeves. 2019. Conversation considered harmful? In Proceedings of the 1st International Conference on Conversational User Interfaces (CUI ’19), Association for Computing Machinery, New York, NY, USA, 1–3. DOI:https://doi.org/10.1145/3342775.3342796Google ScholarDigital Library
- Jonathan Reus. Anatomies of Intelligence. Retrieved February 9, 2021 from https://jonathanreus.com/portfolio/anatomies-of-intelligence/Google Scholar
- Jon Rogers, Loraine Clarke, Martin Skelly, Nick Taylor, Pete Thomas, Michelle Thorne, Solana Larsen, Katarzyna Odrozek, Julia Kloiber, Peter Bihr, Anab Jain, Jon Arden, and Max von Grafenstein. 2019. Our Friends Electric: Reflections on Advocacy and Design Research for the Voice Enabled Internet. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI ’19), ACM, New York, NY, USA, 114:1-114:13. DOI:https://doi.org/10.1145/3290605.3300344Google ScholarDigital Library
- Kurt Schwitters. URSONATE de Kurt Schwitters. Retrieved February 19, 2021 from https://www.costis.org/x/schwitters/ursonate.htmGoogle Scholar
- William Seymour. 2018. How loyal is your Alexa? Imagining a Respectful Smart Assistant. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (CHI EA ’18), Association for Computing Machinery, New York, NY, USA, 1–6. DOI:https://doi.org/10.1145/3170427.3180289Google ScholarDigital Library
- Ben Shneiderman. 2020. Human-Centered Artificial Intelligence: Reliable, Safe & Trustworthy. International Journal of Human–Computer Interaction 36, 6 (April 2020), 495–504. DOI:https://doi.org/10.1080/10447318.2020.1741118Google Scholar
- Stephen Snow, Awais Hameed Khan, Stephen Viller, Ben Matthews, Scott Heiner, James Pierce, Ewa Luger, Richard Gomer, and Dorota Filipczuk. 2020. Speculative Designs for Emergent Personal Data Trails: Signs, Signals and Signifiers. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (CHI EA ’20), Association for Computing Machinery, New York, NY, USA, 1–8. DOI:https://doi.org/10.1145/3334480.3375173Google ScholarDigital Library
- Hildegard Westerkamp. Hildegard Westerkamp. Hildegard Westerkamp. Retrieved February 17, 2021 from http://www.hildegardwesterkamp.ca/main/index.phpGoogle Scholar
- Jordan Wirfs-Brock, Sarah Mennicken, and Jennifer Thom. 2020. Giving Voice to Silent Data: Designing with Personal Music Listening History. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI ’20), Association for Computing Machinery, New York, NY, USA, 1–11. DOI:https://doi.org/10.1145/3313831.3376493Google ScholarDigital Library
- Christian Wolff. Christian Wolff:: Foundation for Contemporary Arts. Retrieved February 17, 2021 from https://www.foundationforcontemporaryarts.org/recipients/christian-wolffGoogle Scholar
- Richmond Y. Wong, Ellen Van Wyk, and James Pierce. 2017. Real-Fictional Entanglements: Using Science Fiction and Design Fiction to Interrogate Sensing Technologies. In Proceedings of the 2017 Conference on Designing Interactive Systems (DIS ’17), ACM, New York, NY, USA, 567–579. DOI:https://doi.org/10.1145/3064663.3064682Google ScholarDigital Library
- John Zimmerman, Jodi Forlizzi, and Shelley Evenson. 2007. Research through design as a method for interaction design research in HCI. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’07), ACM, New York, NY, USA, 493–502. DOI:https://doi.org/10.1145/1240624.1240704Google ScholarDigital Library
- Shoshana Zuboff. 2019. The Age of Surveillance Capitalism: The Fight for a Human Future at the New Frontier of Power (1st edition ed.). PublicAffairs, New York.Google Scholar
Recommendations
Variations: an interactive musical sculpture
C&C '05: Proceedings of the 5th conference on Creativity & cognitionVariations is an ongoing exploration of multi-channel and interactive music experienced through a sculptural interface. The interface functions as a means by which participants can create their own mix of the music by interacting with elements of a ...
Music for Various Groups of Performers (After Lucier): An Improvised Electroencephalographic Group Performance
C&C '17: Proceedings of the 2017 ACM SIGCHI Conference on Creativity and CognitionMusic for Various Groups of Performers (After Lucier) (MfVGoP) is an experimental audio-visual improvised group performance employing sonified electroencephalographic (EEG) signals and computer music. The data generated by performers' brain waves are ...
Musical creativity in collaborative virtual environments
A review of musical creativity in collaborative virtual environments (CVE) shows recurring interaction metaphors that tend from precise control of individual parameters to higher level gestural influence over whole systems. Musical performances in CVE ...
Comments