Sara Irma Parnell
ABSTRACT
As conversational user interfaces (CUIs) are increasingly integrated into daily life, ethical and societal concerns about integrated content filtering algorithms emerge. In addressing these concerns, it is essential to know how aware and knowledgeable society is of the algorithms it encounters using CUIs and the extent to which this impacts the attitude towards these technologies. In this survey study, we made a first attempt to measure and compare participants’ algorithm awareness of chatbots and voice assistants. Further, we assessed the effect of algorithm literacy on the attitude towards CUIs and possible interaction effects with technology acceptance. Lastly, we compared previous and future usage purposes for chatbots and voice assistants. We found higher algorithm awareness for voice assistants than for chatbots. No correlation between algorithm literacy and attitude towards either chatbots or voice assistants was found. An additional personal-level factor, technology acceptance, did not affect this relationship. The results show that participants preferred using voice assistants for task completion and social purposes over chatbots, while getting information was equally preferred between chatbots and voice assistants. Considering its societal relevance, we want to encourage more research on algorithmic awareness and understanding in the field of CUI and its cognitive and behavioral effects.
- Ritu Agarwal and Mani Wadhwa. 2020. Review of State-of-the-Art Design Techniques for Chatbots. SN COMPUT. SCI. 1, 5, 1–12. DOI: https://doi.org/10.1007/s42979-020-00255-3.Google Scholar
Digital Library
- Theo Araujo, Natali Helberger, Sanne Kruikemeier, and Claes H. de Vreese. 2020. In AI we trust? Perceptions about automated decision-making by artificial intelligence. AI & Soc 35, 3, 611–623. DOI: https://doi.org/10.1007/s00146-019-00931-w.Google ScholarDigital Library
- Jasmin Bernotat and Friederike Eyssel. 2018. Can(‘t) Wait to Have a Robot at Home? - Japanese and German Users’ Attitudes Toward Service Robots in Smart Homes. In IEEE RO-MAN 2018. The 27th IEEE International Symposium on Robot and Human Interactive Communication. IEEE, Piscataway, NJ, 15–22. DOI: https://doi.org/10.1109/ROMAN.2018.8525659.Google ScholarDigital Library
- Petter B. Brandtzaeg and Asbjørn Følstad. 2017. Why People Use Chatbots. In Internet science. 4th international conference, INSCI 2017, Thessaloniki, Greece, November 22-24, 2017: proceedings, Yiannis Kompatsiaris, Ed. Lecture Notes in Computer Science, 10673. Springer, Cham, 377–392. DOI: https://doi.org/10.1007/978-3-319-70284-1_30.Google ScholarDigital Library
- Petter B. Brandtzaeg and Asbjørn Følstad. 2018. Chatbots: changing user needs and motivations. interactions 25, 5, 38–43. DOI: https://doi.org/10.1145/3236669.Google ScholarDigital Library
- Fred D. Davis. 1989. Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology. MIS Quarterly 13, 3, 319–340. DOI: https://doi.org/10.2307/249008.Google ScholarDigital Library
- Michael A. DeVito, Darren Gergle, and Jeremy Birnholtz. 2017. “Algorithms ruin everything”: #RIPTwitter, Folk Theories, and Resistance to Algorithmic Change in Social Media. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM Digital Library. ACM, New York, NY, 3163–3174. DOI: https://doi.org/10.1145/3025453.3025659.Google ScholarDigital Library
- Leyla Dogruel. 2021. Folk theories of algorithmic operations during Internet use: A mixed methods study. The Information Society 37, 5, 287–298. DOI: https://doi.org/10.1080/01972243.2021.1949768.Google ScholarCross Ref
- Leyla Dogruel, Dominique Facciorusso, and Birgit Stark. 2020. ‘I'm still the master of the machine.’ Internet users’ awareness of algorithmic decision-making and their perception of its effect on their autonomy. Information, Communication & Society, 1–22. DOI: https://doi.org/10.1080/1369118X.2020.1863999.Google ScholarCross Ref
- Leyla Dogruel, Philipp Masur, and Sven Joeckel. 2021. Development and Validation of an Algorithm Literacy Scale for Internet Users. Communication Methods and Measures, 1–19. DOI: https://doi.org/10.1080/19312458.2021.1968361.Google ScholarCross Ref
- Motahhare Eslami, Aimee Rickman, Kristen Vaccaro, Amirhossein Aleyasen, Andy Vuong, Karrie Karahalios, Kevin Hamilton, and Christian Sandvig. 2015. “I always assumed that I wasn't really that close to [her]”: Reasoning about Invisible Algorithms in News Feeds. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM Digital Library. ACM, New York, NY, 153–162. DOI: https://doi.org/10.1145/2702123.2702556.Google ScholarDigital Library
- Tarleton Gillespie. 2014. The Relevance of Algorithms. In Media technologies. Essays on communication, materiality, and society, Tarleton Gillespie, Pablo J. Boczkowski and Kirsten A. Foot, Eds. Inside technology. The MIT Press, Cambridge, Massachusetts, 167–193.Google Scholar
- Emer Gilmartin and Christian Saam. 2020. Pragmatics Research and Non-task Dialog Technology. In Proceedings of the 2nd Conference on Conversational User Interfaces. ACM Digital Library. Association for Computing Machinery, New York, NY, United States, 1–3. DOI: https://doi.org/10.1145/3405755.3406142.Google ScholarDigital Library
- Anne-Britt Gran, Peter Booth, and Taina Bucher. 2021. To be or not to be algorithm aware: a question of a new digital divide? Information, Communication & Society 24, 12, 1779–1796. DOI: https://doi.org/10.1080/1369118X.2020.1736124.Google ScholarCross Ref
- Jonathan Gruber, Eszter Hargittai, Gökçe Karaoglu, and Lisa Brombach. 2021. Algorithm awareness as an important internet skill: the case of voice assistants. DOI: https://doi.org/10.5167/UZH-204503.Google ScholarCross Ref
- Clara Hendrickson and William A. Galston. 2019. Big tech threats: Making sense of the backlash against online platforms (28 May 2019). Retrieved March 15, 2022 from https://www.brookings.edu/research/big-tech-threats-making-sense-of-the-backlash-against-online-platforms/.Google Scholar
- Matthew B. Hoy. 2018. Alexa, Siri, Cortana, and More: An Introduction to Voice Assistants. Medical reference services quarterly 37, 1, 81–88. DOI: https://doi.org/10.1080/02763869.2018.1404391.Google ScholarCross Ref
- Chin-Lung Hsu and Judy C.-C. Lin. 2016. Effect of perceived value and social influences on mobile app stickiness and in-app purchase intention. Technological Forecasting and Social Change 108, 42–53. DOI: https://doi.org/10.1016/j.techfore.2016.04.012.Google ScholarCross Ref
- IBM. 2020. Conversational AI (31 August 2020). Retrieved March 22, 2022 from https://www.ibm.com/cloud/learn/conversational-ai.Google Scholar
- Yvonne Kammerer, Saskia Brand-Gruwel, and Halszka Jarodzka. 2018. The Future of Learning by Searching the Web: Mobile, Social, and Multimodal. FLR 6, 2, 81–91. DOI: https://doi.org/10.14786/flr.v6i2.343.Google ScholarCross Ref
- Rafal Kocielnik, Raina Langevin, James S. George, Shota Akenaga, Amelia Wang, Darwin P. Jones, Alexander Argyle, Callan Fockele, Layla Anderson, Dennis T. Hsieh, Kabir Yadav, Herbert Duber, Gary Hsieh, and Andrea L. Hartzler. 2021. Can I Talk to You about Your Social Needs? Understanding Preference for Conversational User Interface in Health. In CUI 2021 - 3rd Conference on Conversational User Interfaces. ACM Digital Library. Association for Computing Machinery, New York, NY, United States, 1–10. DOI: https://doi.org/10.1145/3469595.3469599.Google ScholarDigital Library
- Lin Li, Kyung Y. Lee, Emmanuel Emokpae, and Sung-Byung Yang. 2021. What makes you continuously use chatbot services? Evidence from chinese online travel agencies. Electron Markets 31, 3, 575–599. DOI: https://doi.org/10.1007/s12525-020-00454-z.Google ScholarCross Ref
- Irene Lopatovska, Katrina Rink, Ian Knight, Kieran Raines, Kevin Cosenza, Harriet Williams, Perachya Sorsche, David Hirsch, Qi Li, and Adrianna Martinez. 2018. Talk to me: Exploring user interactions with the Amazon Alexa. Journal of Librarianship and Information Science 51, 4, 984–997. DOI: https://doi.org/10.1177/0961000618759414.Google ScholarCross Ref
- Rory Mulcahy, Kate Letheren, Ryan McAndrew, Charmaine Glavas, and Rebekah Russell-Bennett. 2019. Are households ready to engage with smart home technology? Journal of Marketing Management 35, 15-16, 1370–1400. DOI: https://doi.org/10.1080/0267257X.2019.1680568.Google ScholarCross Ref
- Tom Nadarzynski, Oliver Miles, Aimee Cowie, and Damien Ridge. 2019. Acceptability of artificial intelligence (AI)-led chatbot services in healthcare: A mixed-methods study. Digital health 5, 2055207619871808. DOI: https://doi.org/10.1177/2055207619871808.Google ScholarCross Ref
- F. J. J. Neyer, J. Felber, and C. Gebhardt. 2012. Kurzskala. Technikbereitschaft (TB)[Technology commitment]. ZIS-Zusammenstellung sozialwissenschaftlicher Items und Skalen (ed.). DOI: https://doi.org/10.1026/0012-1924/a000067.Google ScholarCross Ref
- Anne Oeldorf-Hirsch and German Neubaum. 2021. What Do We Know about Algorithmic Literacy? The Status Quo and a Research Agenda for a Growing Field. DOI: https://doi.org/10.31235/osf.io/2fd4j.Google ScholarCross Ref
- Rohit Prasad. 2021. “Ambient intelligence” will accelerate advances in general AI. Alexa's chief scientist on how customer-obsessed science is accelerating general intelligence. (21 December 2021). Retrieved March 17, 2022 from https://www.amazon.science/blog/ambient-intelligence-will-accelerate-advancements-in-general-ai.Google Scholar
- PWC. 2018. Consumer Intelligence Series: Prepare for the voice revolution (2018). Retrieved March 15, 2022 from https://www.pwc.com/us/en/services/consulting/library/consumer-intelligence-series/voice-assistants.html.Google Scholar
- Jon T. S. Quah and Y. W. Chua. 2019. Chatbot Assisted Marketing in Financial Service Industry. In Services Computing - SCC 2019. 16th International Conference, Held as Part of the Services Conference Federation, SCF 2019, San Diego, CA, USA, June 25–30, 2019, Proceedings, Joao E. Ferreira, Aibek Musaev and Liang-Jie Zhang, Eds. Springer eBooks Computer Science, 11515. Springer, Cham, 107–114. DOI: https://doi.org/10.1007/978-3-030-23554-3_8.Google ScholarDigital Library
- Emilee Rader and Rebecca Gray. 2015. Understanding User Beliefs About Algorithmic Curation in the Facebook News Feed. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM Digital Library. ACM, New York, NY, 173–182. DOI: https://doi.org/10.1145/2702123.2702174.Google ScholarDigital Library
- Natalia Reich-Stiebert and Friederike Eyssel. 2015. Learning with Educational Companion Robots? Toward Attitudes on Education Robots, Predictors of Attitudes, and Application Potentials for Education Robots. Int J of Soc Robotics 7, 5, 875–888. DOI: https://doi.org/10.1007/s12369-015-0308-9.Google ScholarCross Ref
- Alan M. Rubin. 2009. The uses-and-gratifications perspective of media effects. In Media effects. Advances in theory and research, Jennings Bryant, Ed. Communication series. Routledge, New York, 165–182.Google Scholar
- Kambiz Saffarizadeh, Maheshwar Boodraj, and Tawfiq M. and Alashoor. 2017. Conversational Assistants: Investigating Privacy Concerns, Trust, and Self-Disclosure. ICIS 2017 Proceedings. AIS eLibrary. Retrieved from http://aisel.aisnet.org/cgi/viewcontent.cgi?article=1112&context=icis2017.Google Scholar
- Supraja Sankaran, Chao Zhang, Mathias Funk, Henk Aarts, and Panos Markopoulos. 2020. Do I have a say?: Using conversational agents to re-imagine human-machine autonomy. In Proceedings of the 2nd Conference on Conversational User Interfaces. ACM Digital Library. Association for Computing Machinery, New York,NY,United States, 1–3. DOI: https://doi.org/10.1145/3405755.3406135.Google ScholarDigital Library
- Shruti Sannon, Brett Stoll, Dominic DiFranzo, Malte F. Jung, and Natalya N. Bazarova. 2020. “I just shared your responses”: Extending Communication Privacy Management Theory to Interactions with Conversational Agents. Proc. ACM Hum.-Comput. Interact. 4, GROUP, 1–18. DOI: https://doi.org/10.1145/3375188.Google ScholarDigital Library
- Ayat Shukairy. 2021. Chatbots In Customer Service – Statistics and Trends [Infographic] (2021). Retrieved from https://www.invespcro.com/blog/chatbots-customer-service/.Google Scholar
- Heung-Yeung Shum, Xiao-dong He, and Di Li. 2018. From Eliza to XiaoIce: challenges and opportunities with social chatbots. Frontiers Inf Technol Electronic Eng 19, 1, 10–26. DOI: https://doi.org/10.1631/FITEE.1700826.Google ScholarCross Ref
- Ignacio Siles González and Ariana Meléndez Moran. 2021. “The most aggressive of algorithms”: User awareness of and attachment to TikTok's content personalization. Paper Presented at the 71st International Communication Association (ICA) Conference (27 June 2021). Retrieved March 22, 2022 from https://www.kerwa.ucr.ac.cr/handle/10669/83230.Google Scholar
- Stefanie Sohn. 2019. Can Conversational User Interfaces Be Harmful? The Undesirable Effects on Privacy Concern. ICIS 2019 Proceedings. 29. AIS eLibrary. https://aisel.aisnet.org/icis2019/cyber_security_privacy_ethics_IS/cyber_security_privacy/29.Google Scholar
- Statista. 2021. Size of chatbot in banking, financial services and insurance (BFSI) market worldwide in 2019 and 2030 (02 July 2021). Retrieved March 22, 2022 from https://www.statista.com/statistics/1256242/worldwide-chabot-in-bfsi-revenues/.Google Scholar
- Philip Weber and Thomas Ludwig. 2020. (Non-)Interacting with conversational agents. In Proceedings of the Conference on Mensch und Computer. ACM, New York, NY, USA, 321–331. DOI: https://doi.org/10.1145/3404983.3405513.Google ScholarDigital Library
- Anbang Xu, Zhe Liu, Yufan Guo, Vibha Sinha, and Rama Akkiraju. 2017. A New Chatbot for Customer Service on Social Media. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM Digital Library. ACM, New York, NY, 3506–3510. DOI: https://doi.org/10.1145/3025453.3025496.Google ScholarDigital Library
- Michael Yeomans, Anuj Shah, Sendhil Mullainathan, and Jon Kleinberg. 2019. Making sense of recommendations. J Behav Dec Making 32, 4, 403–414. DOI: https://doi.org/10.1002/bdm.2118.Google ScholarCross Ref
- Brahim Zarouali, Sophie C. Boerman, and Claes H. de Vreese. 2021. Is this recommended by an algorithm? The development and validation of the algorithmic media content awareness scale (AMCA-scale). Telematics and Informatics 62, 101607. DOI: https://doi.org/10.1016/j.tele.2021.101607.Google ScholarCross Ref
Index Terms
- Do we know and do we care? Algorithms and Attitude towards Conversational User Interfaces: Comparing Chatbots and Voice Assistants
Index terms have been assigned to the content through auto-classification.
Recommendations
User Expectations of Conversational Chatbots Based on Online Reviews
DIS '21: Proceedings of the 2021 ACM Designing Interactive Systems ConferenceOpen-domain chatbots that can engage in a conversation on any topic received significant attention in the last several years, which opened opportunities for studying user interaction with them. Drawing from reviews of chatbots posted on Google Play, we ...
Evaluating and Informing the Design of Chatbots
DIS '18: Proceedings of the 2018 Designing Interactive Systems ConferenceText messaging-based conversational agents (CAs), popularly called chatbots, received significant attention in the last two years. However, chatbots are still in their nascent stage: They have a low penetration rate as 84% of the Internet users have not ...
Embodied conversational agents for voice-biometric interfaces
ICMI '08: Proceedings of the 10th international conference on Multimodal interfacesIn this article we present a research scheme which aims to analyze the use of Embodied Conversational Agent (ECA) technology to improve the robustness and acceptability of speaker enrolment and verification dialogues designed to provide secure access ...
Comments