research-article

Open access

Designing Interactive Explainable AI Tools for Algorithmic Literacy and Transparency

Authors:

Duri LongAuthors Info & Claims

DIS '24: Proceedings of the 2024 ACM Designing Interactive Systems Conference

Pages 939 - 957

https://doi.org/10.1145/3643834.3660722

Published: 01 July 2024 Publication History

All formats PDF

Abstract

As artificial intelligence (AI) increasingly permeates everyday life, there is a growing need for public understanding of AI’s underlying principles. Existing educational interventions and explainable AI (XAI) tools cater mainly to children or adult experts. In this paper, we present three interactive web-based tools to foster AI learning among adults without technical backgrounds. Designed according to learning sciences and user-centered design principles, these tools simplify complex AI concepts like edge detection, confidence thresholds, and sensitivity, making AI more understandable for beginners and facilitating reflection on ethical issues. We present results from a mixed-methods evaluation of the tools with 42 participants. Results show heightened familiarity and confidence in AI concepts. Our qualitative analysis additionally reveals common interaction patterns amongst participants. This paper offers both a design contribution to the AI education and XAI communities and emergent interaction patterns to support the design of transparent and learner-centered AI for adult novices.

References

[1]

Ashraf Abdul, Jo Vermeulen, Danding Wang, Brian Y Lim, and Mohan Kankanhalli. 2018. Trends and Trajectories for Explainable, Accountable and Intelligible Systems: An HCI Research Agenda. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–18.

Digital Library

[2]

Safinah Ali, Blakeley H Payne, Randi Williams, Hae Won Park, and Cynthia Breazeal. 2019. Constructionism, ethics, and creativity: Developing primary and middle school artificial intelligence education. In International workshop on education in artificial intelligence k-12 (eduai’19), Vol. 2. 1–4.

[3]

Farshid Anvari, H. Tran, Deborah Richards, and M. Hitchens. 2019. Towards a Method for Creating Personas with Knowledge and Cognitive Process for User Centered Design of a Learning Application. In 2019 IEEE/ACM 12th International Workshop on Cooperative and Human Aspects of Software Engineering (CHASE). IEEE. https://doi.org/10.1109/CHASE.2019.00037

Digital Library

[4]

Alejandro Barredo Arrieta, Natalia Díaz-Rodríguez, Javier Del Ser, Adrien Bennetot, Siham Tabik, Alberto Barbado, Salvador García, Sergio Gil-López, Daniel Molina, Richard Benjamins, 2020. Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI. Information Fusion 58 (2020), 82–115.

Digital Library

[5]

Azlan Abdul Aziz, Intan Nur Hafawati Adam, Jamaluddin Jasmis, S. J. Elias, and S. Mansor. 2021. N-Gain and System Usability Scale Analysis on Game Based Learning for Adult Learners. IEEE (2021). https://doi.org/10.1109/ICRAIE52900.2021.9704013

[6]

A. Bandura. 2006. Guide for constructing self-efficacy scales. Vol. 5. 307–337.

[7]

Karl-Emil Kjær Bilstrup, Magnus H. Kaspersen, and Marianne Graves Petersen. 2020. Staging Reflections on Ethical Dilemmas in Machine Learning: A Card-Based Design Workshop for High School Students. In Proceedings of the 2020 ACM Designing Interactive Systems Conference (, Eindhoven, Netherlands, ) (DIS ’20). Association for Computing Machinery, New York, NY, USA, 1211–1222. https://doi.org/10.1145/3357236.3395558

Digital Library

[8]

Dawn Branley-Bell, Rebecca Whitworth, and L. Coventry. 2020. User Trust and Understanding of Explainable AI: Exploring Algorithm Visualisations and User Biases. In International Conference on Human-Computer Interaction. Springer, –. https://doi.org/10.1007/978-3-030-49065-2_27

Digital Library

[9]

Virginia Braun and Victoria Clarke. 2023. Toward good practice in thematic analysis: Avoiding common problems and be(com)ing a knowing researcher. International Journal of Transgender Health 24, 1 (2023), 1–6. https://doi.org/10.1080/26895269.2022.2129597

[10]

J. Brummelen. [n. d.]. Conversational Artificial Intelligence Development Tools for K-12 Education. ([n. d.]).

[11]

S. Buijsman. 2023. Navigating fairness measures and trade-offs. AI Ethics (2023). https://doi.org/10.1007/s43681-023-00318-0

[12]

J. Canny. 1986. A Computational Approach to Edge Detection. IEEE Transactions on Pattern Analysis and Machine Intelligence PAMI-8, 6 (1986), 679–698.

Digital Library

[13]

Michelle Carney, Barron Webster, Irene Alvarado, Kyle Phillips, Noura Howell, Jordan Griffith, Jonas Jongejan, Amit Pitaru, and Alexander Chen. 2020. Teachable machine: Approachable Web-based tool for exploring machine learning classification. In Extended abstracts of the 2020 CHI conference on human factors in computing systems. 1–8.

[14]

Laura Casal-Otero, Alejandro Catala, Carlos Fernández-Morante, and et al.2023. AI literacy in K-12: a systematic literature review. International Journal of STEM Education 10, 1 (19 April 2023), 29. https://doi.org/10.1186/s40594-023-00418-7

[15]

Francisco Enrique Vicente Castro, Kayla DesPortes, William Payne, Yoav Bergner, and Kathleen McDermott. 2022. Ai+ dance: Co-designing culturally sustaining curricular resources for ai and ethics education through artistic computing. In Proceedings of the 2022 ACM Conference on International Computing Education Research-Volume 2. 26–27.

Digital Library

[16]

M. T. Chi, M. Bassok, M. W. Lewis, P. Reimann, and R. Glaser. 1989. Self-explanations: How students study and use examples in learning to solve problems. Cognitive Science 13, 2 (1989), 145–182.

[17]

S. Cornelius, Carole Gordon, and Aileen Ackland. 2011. Towards flexible learning for adult learners in professional contexts: an activity-focused course design. Interactive Learning Environments 19, 5 (2011), 467–484. https://doi.org/10.1080/10494820903298258

[18]

K. Crawford and R. Calo. 2016. There is a blind spot in AI research. Nature 538 (2016), 311–313. https://doi.org/10.1038/538311a

[19]

J. W. Creswell and J. D. Creswell. 2017. Research design: Qualitative, quantitative, and mixed methods approaches. Sage publications.

[20]

Aba-Sah Dadzie, Laura Benton, Asimina Vasalou, and Russell Beale. 2014. Situated design for creative, reflective, collaborative, technology-mediated learning. In Proceedings of the 2014 Conference on Designing Interactive Systems (Vancouver, BC, Canada) (DIS ’14). Association for Computing Machinery, New York, NY, USA, 83–92. https://doi.org/10.1145/2598510.2598527

Digital Library

[21]

D. A. de Vaus. 2013. Surveys in social research. Routledge.

[22]

T. Decker, R. Gross, A. Koebler, M. Lebacher, R. Schnitzer, and S. H. Weber. 2023. The Thousand Faces of Explainable AI Along the Machine Learning Life Cycle: Industrial Reality and Current State of Research. White Paper. Siemens AG, Munich, Germany.

[23]

Guang Deng and L.W. Cahill. 1993. An adaptive Gaussian filter for noise reduction and edge detection. Proc. of Nuclear Science Symposium and Medical Imaging Conference 3, 1615 – 1619 vol.3. https://doi.org/10.1109/NSSMIC.1993.373563

[24]

Deepak Varuvel Dennison, Raycelle CC Garcia, Parth Sarin, Jacob Wolf, Christine Bywater, Benjamin Xie, and Victor R Lee. 2024. From Consumers to Critical Users: Prompty, an AI Literacy Tool For High School Students. (2024).

[25]

N. K. Denzin. 1978. The research act: A theoretical introduction to sociological methods. Aldine.

[26]

Shipi Dhanorkar, Christine T. Wolf, Kun Qian, Anbang Xu, Lucian Popa, and Yunyao Li. 2021. Who needs to know what, when?: Broadening the Explainable AI (XAI) Design Space by Looking at Explanations Across the AI Lifecycle. In Proceedings of the 2021 ACM Designing Interactive Systems Conference (Virtual Event, USA) (DIS ’21). Association for Computing Machinery, New York, NY, USA, 1591–1602. https://doi.org/10.1145/3461778.3462131

Digital Library

[27]

Nicholas Diakopoulos. 2016. Accountability in Algorithmic Decision Making. Commun. ACM 59, 2 (jan 2016), 56–62. https://doi.org/10.1145/2844110

Digital Library

[28]

DA Dillman, JD Smyth, and LM Christian. 2014. Internet, Phone, Mail, and Mixed-Mode Surveys: The Tailored Design Method.

[29]

Stefania Druga. 2018. Growing up with AI: Cognimates: from coding to teaching machines. Ph. D. Dissertation. Massachusetts Institute of Technology.

[30]

Stefania Druga, Fee Lia Christoph, and Amy J Ko. 2022. Family as a Third Space for AI Literacies: How do children and parents learn about AI together?. In Proceedings of the 2022 CHI conference on human factors in computing systems. 1–17.

Digital Library

[31]

Stefania Druga, Nancy Otero, and Amy J. Ko. 2022. The Landscape of Teaching Resources for AI Education. Proceedings of the 2022 ACM Conference on International Computing Education Research (2022). https://doi.org/10.1145/3502718.3524782

Digital Library

[32]

David W. Eccles and Güler Arsal. 2017. The think aloud method: What is it and how do I use it?Qualitative Research in Sport, Exercise and Health 9, 4 (2017), 514–531. https://doi.org/10.1080/2159676X.2017.1331501

[33]

Upol Ehsan and Mark O Riedl. 2019. Human-centered Explainable AI (HCXAI): Beyond opening up the black-box of AI. In Proceedings of the 24th International Conference on Intelligent User Interfaces. Association for Computing Machinery, New York, NY, USA, 1–2.

[34]

Andrew J Elliot. 2014. Color and psychological functioning: a review of theoretical and empirical work. Frontiers in Psychology 5 (2014).

[35]

John H Falk, Scott Randol, and Lynn D Dierking. 2012. Mapping the informal science education landscape: An exploratory study. Public Understanding of Science 21, 7 (2012), 865–874.

[36]

F. Faruqe, R. Watkins, and L. Medsker. 2021. Competency Model Approach to AI Literacy: Research-based Path from Initial Framework to Model. Advances in Artificial Intelligence, Machine Learning, and Computational Intelligence (2021). https://doi.org/10.54364/aaiml.2022.1140

[37]

A. Field. 2013. Discovering Statistics Using IBM SPSS Statistics (4th ed.). SAGE Publications.

Digital Library

[38]

A. Fink. 2017. How to conduct surveys: A step-by-step guide. Sage Publications.

[39]

C. T. Fosnot. 2005. Constructivism: Theory, Perspectives, and Practice, Second Edition. Teachers College Press.

[40]

A. Fu, A. Kannan, R. Shavelson, Lisa S. Peterson, and Amy Kurpius. 2016. Room for Rigor: Designs and Methods in Informal Science Education Evaluation. Visitor Studies 19, 1 (2016), 8–27. https://doi.org/10.1080/10645578.2016.1144025

[41]

F. O. Giuste 2021. Explainable Artificial Intelligence Methods in Combating Pandemics: A Systematic Review. IEEE Reviews in Biomedical Engineering 16 (2021), 5–21.

[42]

Rafael C. Gonzalez and Richard E. Woods. 2018. Digital Image Processing (4 ed.). Pearson, New York, NY, USA.

[43]

S. Grigorescu 2020. A survey of deep learning techniques for autonomous driving. Journal of Field Robotics 37, 3 (2020), 362–386.

[44]

John P Gutwill and Scott Allen. 2010. Facilitating family group inquiry at science museum exhibits. Science Education 94, 4 (2010), 710–742.

[45]

Thilo Hagendorff and D. Danks. 2022. Ethical and methodological challenges in building morally informed AI systems. AI and Ethics (June 2022). https://doi.org/10.1007/s43681-022-00188-y

[46]

Alexa Hagerty and Igor Rubinov. 2019. Global AI Ethics: A Review of the Social Impacts and Ethical Implications of Artificial Intelligence. CoRR abs/1907.07892 (2019). arXiv:1907.07892http://arxiv.org/abs/1907.07892

[47]

Julie Henry, Alyson Hernalesteen, and Anne-Sophie Collard. 2021. Teaching Artificial Intelligence to K-12 Through a Role-Playing Game Questioning the Intelligence Concept. KI - Künstliche Intelligenz (2021). https://doi.org/10.1007/s13218-021-00733-7

[48]

Yan Yin Ho, Eun-Young Yeo, and Dhaniah Suhana Binte Mohammad Wijaya. 2023. Turning Coffee Time into Teaching Moments Through Bite-Sized Learning for Adult Learners. Journal of Continuing Higher Education 71, 2 (2023), 123–134. https://doi.org/10.1080/07377363.2021.2024000

[49]

Michael S. Horn, E. Solovey, R. J. Crouser, and R. Jacob. 2009. Comparing the use of tangible and graphical programming languages for informal science education. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (2009). https://doi.org/10.1145/1518701.1518851

Digital Library

[50]

K. Hyttinen. 2019. Human-centered Design Model in the Development of Online Learning Tools for International Security Training - CASE IECEU New Media based Learning Application (NMLA). Proceedings of the 11th International Conference on Computer Supported Education (2019). https://doi.org/10.5220/0006559902750282

[51]

Henry Jenkins 2006. Confronting the Challenges of Participatory Culture: Media Education for the 21st Century. An Occasional Paper on Digital Media and Learning (2006). http://tinyurl.com/2uztw4

[52]

Ken Kahn, Rani Megasari, Erna Piantari, and Enjun Junaeti. 2018. AI programming by children using snap! Block programming in a developing country. In Thirteenth European Conference on Technology Enhanced Learning, Vol. 11082. Springer.

[53]

Minsuk Kahng, Nikhil Thorat, Duen Horng Chau, Fernanda B Viégas, and Martin Wattenberg. 2018. Gan lab: Understanding complex deep generative models using interactive visual experimentation. IEEE transactions on visualization and computer graphics 25, 1 (2018), 310–320.

[54]

Maria Kasinidou. 2022. Promoting AI Literacy for the Public. Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (2022). https://doi.org/10.1145/3545947.3573292

Digital Library

[55]

Maria Kasinidou. 2023. AI Literacy for All: A Participatory Approach. Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (2023). https://doi.org/10.1145/3587103.3594135

Digital Library

[56]

Anna Kawakami, Luke Guerdan, Yang Cheng, Anita Sun, Alison Hu, Kate Glazko, Nikos Arechiga, Matthew Lee, Scott Carter, Haiyi Zhu, and Kenneth Holstein. 2022. Towards a Learner-Centered Explainable AI: Lessons from the learning sciences. arxiv:2212.05588 [cs.HC]

[57]

Malcolm S. Knowles. 1984. Andragogy in Action: Applying Modern Principles of Adult Education. Jossey-Bass, San Francisco, CA.

[58]

T. Köhler. 2021. Didactic modeling of a digital instrument for the perception, construction and evaluation of ethical perspectives in AI systems. 2021 IEEE 10th International Congress on Information Science and Technology (CiSt) (July 2021). https://doi.org/10.1109/IIAI-AAI53430.2021.00030

[59]

D. R. Krathwohl. 2002. A revision of Bloom’s taxonomy: An overview. Theory into Practice 41, 4 (2002), 212–218.

[60]

Valentin Kuleto, Milena P. Ilić, Mihail-Alexandru Dumangiu, M. Ranković, Oliva M. D. Martins, D. Păun, and Larisa Mihoreanu. 2021. Exploring Opportunities and Challenges of Artificial Intelligence and Machine Learning in Higher Education Institutions. Sustainability 13, 18 (2021), 10424. https://doi.org/10.3390/su131810424

[61]

Vishesh Kumar and Marcelo Worsley. 2023. Scratch for sports: athletic drills as a platform for experiencing, understanding, and developing AI-driven apps. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 37. 16011–16016.

Digital Library

[62]

Matthias Laupichler, Alexandra Aster, Jana Schirch, and Tobias Raupach. 2022. Artificial intelligence literacy in higher and adult education: A scoping literature review. Computers and Education: Artificial Intelligence 3 (09 2022), 100101. https://doi.org/10.1016/j.caeai.2022.100101

[63]

Qianyang V Liao, Daniel Gruen, and Sarah Miller. 2020. Questioning the AI: Informing Design Practices for Explainable AI User Experiences. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–15.

Digital Library

[64]

Daria Loi, Christine T. Wolf, Jeanette L. Blomberg, Raphael Arar, and Margot Brereton. 2019. Co-designing AI Futures: Integrating AI Ethics, Social Computing, and Design. In Companion Publication of the 2019 on Designing Interactive Systems Conference 2019 Companion (, San Diego, CA, USA, ) (DIS ’19 Companion). Association for Computing Machinery, New York, NY, USA, 381–384. https://doi.org/10.1145/3301019.3320000

Digital Library

[65]

D. Long and B. Magerko. 2020. What is AI literacy? Competencies and design considerations. In CHI Conference on Human Factors in Computing Systems.

[66]

Duri Long, Jessica Roberts, Brian Magerko, Kenneth Holstein, Daniella DiPaola, and Fred Martin. 2023. AI Literacy: Finding Common Threads between Education, Design, Policy, and Explainability. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems (, Hamburg, Germany, ) (CHI EA ’23). Association for Computing Machinery, New York, NY, USA, Article 329, 6 pages. https://doi.org/10.1145/3544549.3573808

Digital Library

[67]

D. Long, Anthony Teachey, and Brian Magerko. 2022. Family Learning Talk in AI Literacy Learning Activities. In CHI Conference on Human Factors in Computing Systems Extended Abstracts. https://doi.org/10.1145/3491102.3502091

Digital Library

[68]

Celestin Mayombe. 2020. Adult learners’ perception on the use of constructivist principles in teaching and learning in non-formal education centres in South Africa. International Journal of Lifelong Education (2020). https://doi.org/10.1080/02601370.2020.1796834

[69]

L. McCarthy, C. Reas, and B. Fry. 2015. Getting started with p5.js: Making interactive graphics in JavaScript and Processing. Maker Media, Inc.

[70]

Ravi Mehta and Rui (Juliet) Zhu. 2009. Blue or Red? Exploring the Effect of Color on Cognitive Task Performances. Science 323, 5918 (2009), 1226–1229.

[71]

C. Meske and E. Bunde. 2020. Transparency and Trust in Human-AI-Interaction: The Role of Model-Agnostic Explanations in Computer Vision-Based Decision Support. Interacción (2020).

[72]

T. Miletić. 2020. Military Medical Enhancement and Autonomous AI Systems: Requirements, Implications, Concerns. Springer. https://doi.org/10.1007/978-3-030-36319-2_11

[73]

Tim Miller. 2023. Explainable AI is Dead, Long Live Explainable AI! Hypothesis-driven Decision Support using Evaluative AI. In Proceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency (, Chicago, IL, USA,) (FAccT ’23). Association for Computing Machinery, New York, NY, USA, 333–342. https://doi.org/10.1145/3593013.3594001

Digital Library

[74]

Anoop Mishra and Harvey Siy. 2020. An Interdisciplinary Approach for Teaching Artificial Intelligence to Computer Science Students. In Proceedings of the 21st Annual Conference on Information Technology Education (Virtual Event, USA) (SIGITE ’20). Association for Computing Machinery, New York, NY, USA, 344. https://doi.org/10.1145/3368308.3415440

Digital Library

[75]

Allan Paivio. 1986. Mental Representations: A Dual Coding Approach. Oxford University Press, New York, NY.

[76]

Seymour Papert and Idit Harel. 1991. Situating Constructionism. Ablex Publishing, Norwood, NJ, USA.

[77]

A. Parasuraman. 2000. Technology Readiness Index (TRI): A multiple-item scale to measure readiness to embrace new technologies. Journal of Service Research 2, 4 (2000), 307–320. https://doi.org/10.1177/109467050024001 This paper introduces the Technology Readiness Index, a scale developed to measure the propensity to embrace and use new technologies among consumers.

[78]

S. S. Rautaray and A. Agrawal. 2015. Vision based hand gesture recognition for human computer interaction: a survey. Artificial Intelligence Review 43, 1 (2015), 1–54.

Digital Library

[79]

J. Redmon 2016. You only look once: Unified, real-time object detection. IEEE CVPR (2016).

[80]

Mitchel Resnick, Amy Bruckman, and Fred Martin. 1996. Pianos not stereos: Creating computational construction kits. interactions 3, 5 (1996), 40–50.

Digital Library

[81]

Mitchel Resnick, John Maloney, Andrés Monroy-Hernández, Natalie Rusk, Evelyn Eastmond, Karen Brennan, Amon Millner, Eric Rosenbaum, Jay Silver, Brian Silverman, and Yasmin Kafai. 2009. Scratch: Programming for All. Commun. ACM 52, 11 (2009), 60–67.

Digital Library

[82]

Marco Túlio Ribeiro, Sameer Singh, and Carlos Guestrin. 2016. "Why Should I Trust You?": Explaining the Predictions of Any Classifier. CoRR abs/1602.04938 (2016). arXiv:1602.04938http://arxiv.org/abs/1602.04938

[83]

J. Roberts and L. Lyons. 2017. The value of learning talk: applying a novel dialogue scoring method to inform interaction design in an open-ended, embodied museum exhibit. International Journal of Computer-Supported Collaborative Learning (2017).

[84]

Farhan Fuad Rupom, Shafaitul Jannat, F. Tamanna, Gazi Musa Al Johan, and Md. Motaharul Islam. 2020. EMG Controlled Bionic Robotic Arm using Artificial Intelligence and Machine Learning. In IEEE TENSYMP 2020. https://doi.org/10.1109/TENSYMP50017.2020.9230885

[85]

Janet Ruppert, Diego Velazquez-Ramos, Ricarose Roque, and R Benjamin Shapiro. 2023. Taking play and tinkering seriously in AI education: cases from Drag vs AI teen workshops. Learning, Media and Technology (2023), 1–15.

[86]

D. R. Sadler. 1989. Formative assessment and the design of instructional systems. Instructional Science 18, 2 (1989), 119–144.

[87]

Lorena Sánchez Chamorro, Kerstin Bongard-Blanchy, and Vincent Koenig. 2023. Ethical Tensions in UX Design Practice: Exploring the Fine Line Between Persuasion and Manipulation in Online Interfaces. In Proceedings of the 2023 ACM Designing Interactive Systems Conference (, Pittsburgh, PA, USA, ) (DIS ’23). Association for Computing Machinery, New York, NY, USA, 2408–2422. https://doi.org/10.1145/3563657.3596013

Digital Library

[88]

Benjamin Sanchez-Lengeling, Emily Reif, Adam Pearce, and Alexander B Wiltschko. 2021. A gentle introduction to graph neural networks. Distill 6, 9 (2021), e33.

[89]

David W. Shaffer and Mitchel Resnick. 1999. "Thick" Authenticity: New Media and Authentic Learning. Journal of Interactive Learning Research 10, 2 (1999), 195–216.

Digital Library

[90]

Donghee Shin and Yong Jin Park. 2019. Role of fairness, accountability, and transparency in algorithmic affordance. Computers in Human Behavior (2019). https://doi.org/10.1016/j.chb.2019.04.019

Digital Library

[91]

Daniel Smilkov, Shan Carter, D Sculley, Fernanda B Viégas, and Martin Wattenberg. 2017. Direct-manipulation visualization of deep networks. arXiv preprint arXiv:1708.03788 (2017).

[92]

Elliot Soloway, Mark Guzdial, and Kenneth E Hay. 1994. Learner-centered design: The challenge for HCI in the 21st century. interactions 1, 2 (1994), 36–48.

Digital Library

[93]

Milan Sonka, Vaclav Hlavac, and Roger Boyle. 2014. Image Processing, Analysis, and Machine Vision. Cengage Learning, Stamford, CT, USA.

[94]

K. Sorbán. 2021. Ethical and legal implications of using AI-powered recommendation systems in streaming services. Információs Társadalom (June 2021). https://doi.org/10.22503/inftars.xxi.2021.2.5

[95]

A. Tlili, J. Zhang, Z. Papamitsiou, S. Manske, R. Huang, Kinshuk, and H. Hoppe. 2021. Towards utilising emerging technologies to address the challenges of using Open Educational Resources: a vision of the future. Educational Technology Research and Development (2021). https://doi.org/10.1007/s11423-021-09993-4

[96]

Curtis L. Todd, K. Ravi, H. Akoh, and Vance Gray. 2021. Engaging Adult Learners Online Through Technology, Andragogy, and Flexible Course Design. https://doi.org/10.4018/978-1-7998-8598-6.ch055

[97]

David Touretzky, Christina Gardner-McCune, Fred Martin, and Deborah Seehorn. 2019. Envisioning AI for K-12: What should every child know about AI?. In Proceedings of the AAAI conference on artificial intelligence, Vol. 33. 9795–9799.

Digital Library

[98]

Tiffany Tseng, Matt J Davidson, Luis Morales-Navarro, Jennifer King Chen, Victoria Delaney, Mark Leibowitz, Jazbo Beason, and R Benjamin Shapiro. 2024. Co-ML: Collaborative Machine Learning Model Building for Developing Dataset Design Practices. ACM Transactions on Computing Education (2024).

[99]

T. Turki, Zhi Wei, and J. Wang. 2017. Transfer Learning Approaches to Improve Drug Sensitivity Prediction in Multiple Myeloma Patients. IEEE Access (2017). https://doi.org/10.1109/ACCESS.2017.2696523

[100]

Jessica Van Brummelen, Viktoriya Tabunshchyk, and Tommy Heng. 2021. “Alexa, Can I Program You?”: Student Perceptions of Conversational Artificial Intelligence Before and After Programming Alexa. In Interaction Design and Children. 305–313.

[101]

M. V. J. Veenman, P. Wilhelm, and J. J. Beishuizen. 2004. The relation between intellectual and metacognitive skills from a developmental perspective. Learning and Instruction 14, 1 (2004), 89–109. https://doi.org/10.1016/j.learninstruc.2003.10.004

[102]

V. Venkatesh, M. G. Morris, G. B. Davis, and F. D. Davis. 2003. User Acceptance of Information Technology: Toward a Unified View. MIS Quarterly 27, 3 (2003), 425–478. https://doi.org/10.2307/30036540

[103]

Benjamin Walsh, Bridget Dalton, Stacey Forsyth, and Tom Yeh. 2023. Literacy and STEM teachers adapt AI ethics curriculum. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 37. 16048–16055.

Digital Library

[104]

Zijie J Wang, Robert Turko, Omar Shaikh, Haekyu Park, Nilaksh Das, Fred Hohman, Minsuk Kahng, and Duen Horng Polo Chau. 2020. CNN explainer: learning convolutional neural networks with interactive visualization. IEEE Transactions on Visualization and Computer Graphics 27, 2 (2020), 1396–1406.

[105]

K. Weitz 2019. "Do you trust me?": Increasing User-Trust by Integrating Virtual Agents in Explainable AI Interaction Design. In ACM IVA.

[106]

L. Wells and T. Bednarz. 2021. Explainable AI and Reinforcement Learning: A Systematic Review of Current Approaches. Frontiers in Robotics and AI 8 (2021), 550030. https://doi.org/10.3389/frai.2021.550030

[107]

Mette Wichmand and Ditte Kolbaek. 2021. Collective Memory Work: A Method for Turning Adult Learners’ Work-Life Experiences Into a Rich Collective Knowledge Resource in Higher Education. Adult Learning 32, 3 (2021), 117–127. https://doi.org/10.1177/10451595211004767

[108]

M. Wilson and K. Scalise. 2006. Assessment for learning in the classroom. In Assessment of student achievement. Allyn & Bacon, 289–319.

[109]

Weipeng Yang. 2022. Artificial Intelligence education for young children: Why, what, and how in curriculum design and implementation. Computers and Education: Artificial Intelligence 3 (2022), 100061. https://doi.org/10.1016/j.caeai.2022.100061

[110]

Y. Zhang, Q. V. Liao, and R. K. E. Bellamy. 2020. Effect of confidence and explanation on accuracy and trust calibration in ai-assisted decision making. Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency (2020). https://doi.org/10.1145/3351095.3372852

Digital Library

[111]

Ziyi Zhang, Samuel Micah Akai-Nettey, Adonai Addo, C. Rogers, and J. Sinapov. 2021. An Augmented Reality Platform for Introducing Reinforcement Learning to K-12 Students with Robots. (2021). https://arxiv.org/abs/2110.04697

[112]

Xiaofei Zhou, Jessica Van Brummelen, and Phoebe Lin. 2020. Designing AI learning experiences for K-12: Emerging works, future opportunities and a design framework. arXiv preprint arXiv:2009.10228 (2020).

[113]

Barry J. Zimmerman. 2000. Self-efficacy: An essential motive to learn. Contemporary Educational Psychology 25, 1 (2000), 82–91. https://doi.org/10.1006/ceps.1999.1016

Cited By

Varghese NJose BBindhumol TCleetus ANair S(2025)The power duo: unleashing cognitive potential through human-AI synergy in STEM and non-STEM educationFrontiers in Education10.3389/feduc.2025.153458210Online publication date: 5-Mar-2025
https://doi.org/10.3389/feduc.2025.1534582

Index Terms

Recommendations

Creative Explainable AI Tools to Understand Algorithmic Decision-Making
C&C '24: Proceedings of the 16th Conference on Creativity & Cognition

This doctoral research aims to to design interactive Explainable AI (XAI) tools in response to the challenge of fostering AI literacy among adults without technical expertise. The tools developed thus far focus on edge detection, confidence thresholds, ...
AI Literacy: Finding Common Threads between Education, Design, Policy, and Explainability
CHI EA '23: Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems

Fostering public AI literacy has been a growing area of interest at CHI for several years, and a substantial community is forming around issues such as teaching children how to build and program AI systems, designing learning experiences to broaden ...
Methods and standards for research on explainable artificial intelligence: Lessons from intelligent tutoring systems
Abstract
The DARPA Explainable Artificial Intelligence (AI) (XAI) Program focused on generating explanations for AI programs that use machine learning techniques. This article highlights progress during the DARPA Program (2017‐2021) relative to research ...

Lessons learned in the work on intelligent tutoring systems that apply to system design in Explainable AI. image image

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

DIS '24: Proceedings of the 2024 ACM Designing Interactive Systems Conference

July 2024

3616 pages

ISBN:9798400705830

DOI:10.1145/3643834

Editors:
Anna Vallgårda
IT University of Copenhagen
,
Li Jönsson
Malmö University
,
Jonas Fritsch
IT University of Copenhagen
,
Sarah Fdili Alaoui
LISN-Université Paris Saclay
,
Christopher A. Le Dantec
Northeastern University

Copyright © 2024 Owner/Author.

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives International 4.0 License.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 July 2024

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

DIS '24

Sponsor:

SIGCHI

DIS '24: Designing Interactive Systems Conference

July 1 - 5, 2024

Copenhagen, Denmark

Acceptance Rates

Overall Acceptance Rate 1,158 of 4,684 submissions, 25%

Upcoming Conference

DIS '25

Sponsor:
sigchi

Designing Interactive Systems Conference

July 5 - 9, 2025

Funchal , Portugal

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
1,142
Total Downloads

Downloads (Last 12 months)1,142
Downloads (Last 6 weeks)182

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Varghese NJose BBindhumol TCleetus ANair S(2025)The power duo: unleashing cognitive potential through human-AI synergy in STEM and non-STEM educationFrontiers in Education10.3389/feduc.2025.153458210Online publication date: 5-Mar-2025
https://doi.org/10.3389/feduc.2025.1534582

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Figures

Tables

Media

View Table of Conten