Abstract
As Conversational AI systems evolve, their user base widens to encompass individuals with varying cognitive abilities, including older adults facing cognitive challenges like Mild Cognitive Impairment (MCI). Current systems, like smart speakers, struggle to provide effective explanations for their decisions or responses. This paper argues that the expectations and requirements for AI explanations for older adults with MCI differ significantly from conventional Explainable AI (XAI) research goals. Drawing from our ongoing research involving older adults with MCI and their interactions with the Google Home Hub, we highlight breakdowns in conversational flow when older adults seek explanations. Based on our experience, we conclude with recommendations for HCI researchers to adopt a more human-centered approach as we move towards developing the next generation of AI systems.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
Retrieved September 24, 2023, from https://home.google.com/welcome/.
References
Clark, L., et al.: What makes a good conversation? Challenges in designing truly conversational agents. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, pp. 1–12 (2019)
Ehsan, U., Liao, Q.V., Muller, M., Riedl, M.O., Weisz, J.D.: Expanding explainability: towards social transparency in AI systems. In: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, pp. 1–19 (2021)
Liao, Q.V., Gruen, D., Miller, S.: Questioning the AI: informing design practices for explainable AI user experiences. In: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, pp. 1–15 (2020)
Mathur, N., Dhodapkar, K., Zubatiy, T., Li, J., Jones, B., Mynatt, E.: A collaborative approach to support medication management in older adults with mild cognitive impairment using conversational assistants (CAs). In: Proceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility, pp. 1–14 (2022)
Rogers, W.A., Mitzner, T.L.: Envisioning the future for older adults: autonomy, health, well-being, and social connectedness with technology support. Futures 87, 133–139 (2017)
Sengupta, K., et al.: Challenges and opportunities of leveraging intelligent conversational assistant to improve the well-being of older adults. In: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems, pp. 1–4 (2020)
Shin, D.: The effects of explainability and causability on perception, trust, and acceptance: implications for explainable AI. Int. J. Hum Comput Stud. 146, 102551 (2021)
Zubatiy, T., Vickers, K.L., Mathur, N., Mynatt, E.D.: Empowering dyads of older adults with mild cognitive impairment and their care partners using conversational agents. In: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, pp. 1–15 (2021)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Mathur, N., Zubatiy, T., Rozga, A., Mynatt, E. (2023). “Why Did You Say That?”: Understanding Explainability in Conversational AI Systems for Older Adults with Mild Cognitive Impairment (MCI). In: Bravo, J., Urzáiz, G. (eds) Proceedings of the 15th International Conference on Ubiquitous Computing & Ambient Intelligence (UCAmI 2023). UCAmI 2023. Lecture Notes in Networks and Systems, vol 835. Springer, Cham. https://doi.org/10.1007/978-3-031-48306-6_21
Download citation
DOI: https://doi.org/10.1007/978-3-031-48306-6_21
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-48305-9
Online ISBN: 978-3-031-48306-6
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)