research-article

Open access

Understanding Students’ Perspectives, Practices, and Challenges of Designing with AI in Special Schools

Authors:

Wun Kam Reginia Leung,

Ada How Sim Ho,

Cheuk Lam KwokAuthors Info & Claims

CHCHI '23: Proceedings of the Eleventh International Symposium of Chinese CHI

Pages 197 - 209

https://doi.org/10.1145/3629606.3629625

Published: 27 February 2024 Publication History

All formats PDF

CHCHI '23: Proceedings of the Eleventh International Symposium of Chinese CHI

Understanding Students’ Perspectives, Practices, and Challenges of Designing with AI in Special Schools

Pages 197 - 209

Abstract
References

Abstract

As generative artificial intelligence (GenAI) develops rapidly, equipping students with basic knowledge of GenAI at the secondary school level is beneficial. However, few subjects in special schools cover AI-related topics, and it remains unclear how students with special educational needs (SEN) perceive, learn, and use AI. In this study, we documented the Artificial Intelligence Generated Content (AIGC) learning experience of seven students from two special schools who participated in a series of game design workshops. We analysed their learning process, usage, and perspectives of text-to-image GenAI through video analysis, questionnaire, and evaluation of design outputs. Our findings reveal the students' willingness to learn and utilise AI technology. This AI experience allows students, especially those who struggle with fine motor skills, to translate their ideas into digital images. Moreover, the text-to-image interaction enhances students' ability to convey their ideas in writing and develop their skills in conceptualisation. We also summarised significant human-AI interaction challenges, including difficulties with typing, Chinese and English spelling, and prompt writing. We conclude with recommendations for designing future inclusive human-AI interaction experiences for students with SEN in China.

References

[1]

Prabal Datta Barua, Jahmunah Vicnesh, Raj Gururajan, Shu Lih Oh, Elizabeth Palmer, Muhammad Mokhzaini Azizan, Nahrizul Adib Kadri, and U. Rajendra Acharya. 2022. Artificial Intelligence Enabled Personalised Assistive Tools to Enhance Education of Children with Neurodevelopmental Disorders-A Review. Int. J. Environ. Res. Public. Health 19, 3 (January 2022), 1192. https://doi.org/10.3390/ijerph19031192

[2]

Tilde Bekker, Saskia Bakker, Iris Douma, Janneke van der Poel, and Koen Scheltenaar. 2015. Teaching children digital literacy through design-based learning with digital toolkits in schools. Int. J. Child-Comput. Interact. 5, (September 2015), 29–38. https://doi.org/10.1016/j.ijcci.2015.12.001

Digital Library

[3]

Laura Benton, George Varotsis, and Asimina Vasalou. 2019. Leading by example: Exploring the influence of design examples on children's creative ideation. Int. J. Hum.-Comput. Stud. 122, (February 2019), 174–183. https://doi.org/10.1016/j.ijhcs.2018.09.007

[4]

Cecilia Ka Yuk Chan and Wenjie Hu. 2023. Students’ Voices on Generative AI: Perceptions, Benefits, and Challenges in Higher Education. arXiv:2305.00290. Retrieved from https://arxiv.org/abs/2305.00290

[5]

Lijia Chen, Pingping Chen, and Zhijian Lin. 2020. Artificial Intelligence in Education: A Review. IEEE Access 8, (2020), 75264–75278. https://doi.org/10.1109/ACCESS.2020.2988510

[6]

Li-Yuan Chiou, Peng-Kai Hung, Rung-Huei Liang, and Chun-Teng Wang. 2023. Designing with AI: An Exploration of Co-Ideation with Image Generators. In Proceedings of the 2023 ACM Designing Interactive Systems Conference (DIS ’23), Association for Computing Machinery, New York, NY, USA, 1941–1954. https://doi.org/10.1145/3563657.3596001

Digital Library

[7]

Victoria Clarke and Virginia Braun. 2017. Thematic analysis. J. Posit. Psychol. 12, 3 (May 2017), 297–298. https://doi.org/10.1080/17439760.2016.1262613

[8]

P. John Clarkson, Roger Coleman, Simeon Keates, and Cherie Lebbon. 2013. Inclusive Design: Design for the Whole Population. Springer Science & Business Media.

[9]

Tracie Costantino. 2018. STEAM by another name: Transdisciplinary Practice in Art and Design Education. Arts Educ. Policy Rev. 119, 2 (April 2018), 100–106. https://doi.org/10.1080/10632913.2017.1292973

[10]

Wendy Dow. 2004. The Role of Implicit Theories in the Development of Creative Classrooms. Retrieved from https://hdl.handle.net/2134/2870

[11]

Athanasios S. Drigas and Rodi-Eleni Ioannidou. 2013. A Review on Artificial Intelligence in Special Education. In Information Systems, E-learning, and Knowledge Management Research (Communications in Computer and Information Science), Springer, Berlin, Heidelberg, 385–391. https://doi.org/10.1007/978-3-642-35879-1_46

[12]

Mehrnaz Fahimirad and Sedigheh Shakib Kotamjani. 2018. A Review on Application of Artificial Intelligence in Teaching and Learning in Educational Contexts. Int. J. Learn. Dev. 8, 4 (December 2018), 106–118. https://doi.org/10.5296/ijld.v8i4.14057

[13]

Maurício Pasetto de Freitas, Vinícius Aquino Piai, Ricardo Heffel Farias, Anita M. R. Fernandes, Anubis Graciela de Moraes Rossetto, and Valderi Reis Quietinho Leithardt. 2022. Artificial Intelligence of Things Applied to Assistive Technology: A Systematic Literature Review. Sensors 22, 21 (January 2022), 8531. https://doi.org/10.3390/s22218531

[14]

Ariel Han and Zhenyao Cai. 2023. Design implications of generative AI systems for visual storytelling for young learners. In Proceedings of the 22nd Annual ACM Interaction Design and Children Conference (IDC ’23), Association for Computing Machinery, New York, NY, USA, 470–474. https://doi.org/10.1145/3585088.3593867

Digital Library

[15]

Francisco-Javier Hinojo-Lucena, Inmaculada Aznar-Díaz, María-Pilar Cáceres-Reche, and José-María Romero-Rodríguez. 2019. Artificial Intelligence in Higher Education: A Bibliometric Study on its Impact in the Scientific Literature. Educ. Sci. 9, 1 (March 2019), 51. https://doi.org/10.3390/educsci9010051

[16]

Sinan Hopcan, Elif Polat, Mehmet Emin Ozturk, and Lutfi Ozturk. 2022. Artificial intelligence in special education: a systematic review. Interact. Learn. Environ. (May 2022), 1–19. https://doi.org/10.1080/10494820.2022.2067186

[17]

Yu-Chang Hsu and Yu-Hui Ching. 2023. Generative Artificial Intelligence in Education, Part One: the Dynamic Frontier. TechTrends. 67, (June 2023), 603–607. https://doi.org/10.1007/s11528-023-00863-9

[18]

Angel Hsing-Chi Hwang. 2022. Too Late to be Creative? AI-Empowered Tools in Creative Processes. In Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems (CHI EA ’22), Association for Computing Machinery, New York, NY, USA, 1–9. https://doi.org/10.1145/3491101.3503549

Digital Library

[19]

Kutubuddin Kazi, Sirisha Devi, Burada Sreedhar, and P Arulprakash. 2022. A Path Towards Child-Centric Artificial Intelligence based Education. Int. J. Early Child. Spec. Educ. 14, 3 (January 2022), 9915–9922. https://doi.org/10.9756/INT-JECSE/V14I3.1145

[20]

Linda Keane and Mark Keane. 2016. STEAM by Design. Des. Technol. Educ. 21, 1 (2016), 61–82.

[21]

Tianyi Li, Mihaela Vorvoreanu, Derek DeBellis, and Saleema Amershi. 2022. Assessing Human-AI Interaction Early through Factorial Surveys: A Study on the Guidelines for Human-AI Interaction. ACM Trans. Comput.-Hum. Interact. 30, 5, Article 69 (October 2023), 45 pages. https://doi.org/10.1145/3511605

Digital Library

[22]

Matthew T. Marino, Eleazar Vasquez, Lisa Dieker, James Basham, and Jose Blackorby. 2023. The Future of Artificial Intelligence in Special Education Technology. J. Spec. Educ. Technol. 38, 3 (May 2023), 404–416. https://doi.org/10.1177/01626434231165977

[23]

Bella Martin and Bruce M. Hanington. 2012. Universal methods of design: 100 ways to research complex problems, develop innovative ideas, and design effective solutions (Digital ed ed.). Rockport Publishers, Beverly, MA.

[24]

Aohua Ni and Alan Cheung. 2023. Understanding secondary students’ continuance intention to adopt AI-powered intelligent tutoring system for English learning. Educ. Inf. Technol. 28, 3 (March 2023), 3191–3216. https://doi.org/10.1007/s10639-022-11305-z

Digital Library

[25]

Anna Rusmann and Stine Ejsing-Duun. 2022. When design thinking goes to school: A literature review of design competences for the K-12 level. Int. J. Technol. Des. Educ. 32, 4 (September 2022), 2063–2091. https://doi.org/10.1007/s10798-021-09692-4

[26]

Esha Shandilya and Mingming Fan. 2022. Understanding Older Adults’ Perceptions and Challenges in Using AI-enabled Everyday Technologies. arXiv:2210.01369. Retrieved from https://arxiv.org/abs/2210.01369

[27]

Dian Toar Y. G. Sumakul, Fuad Abdul Hamied, and Didi Sukyadi. 2022. Students’ Perceptions of the Use of AI in a Writing Class. In Proceedings of the 67th TEFLIN International Virtual Conference & the 9th ICOELT 2021 (TEFLIN ICOELT 2021), Atlantis Press, Padang, Indonesia, 52–57. https://doi.org/10.2991/assehr.k.220201.009

[28]

Willem Van Der Maden, Evert Van Beek, Iohanna Nicenboim, Vera Van Der Burg, Peter Kun, James Derek Lomas, and Eunsu Kang. 2023. Towards a Design (Research) Framework with Generative AI. In Companion Publication of the 2023 ACM Designing Interactive Systems Conference (DIS ’23 Companion), Association for Computing Machinery, New York, NY, USA, 107–109. https://doi.org/10.1145/3563703.3591453

Digital Library

[29]

Henriikka Vartiainen and Matti Tedre. 2023. Using artificial intelligence in craft education: crafting with text-to-image generative models. Digital Creativity. 34, 1 (January 2023), 1–21. https://doi.org/10.1080/14626268.2023.2174557

[30]

Henriikka Vartiainen, Tapani Toivonen, Ilkka Jormanainen, Juho Kahila, Matti Tedre, and Teemu Valtonen. 2021. Machine learning for middle schoolers: Learning through data-driven design. Int. J. Child-Comput. Interact. 29, (September 2021), 100281. https://doi.org/10.1016/j.ijcci.2021.100281

Digital Library

[31]

Bin Wan, Zengjian Wang, Minyoung Jung, Yanchun Lu, Haoqiang He, Qi Chen, and Yu Jin. 2019. Effects of the Co-occurrence of Anxiety and Attention-Deficit/Hyperactivity Disorder on Intrinsic Functional Network Centrality among Children with Autism Spectrum Disorder. Autism Res. Off. J. Int. Soc. Autism Res. 12, 7 (July 2019), 1057–1068. https://doi.org/10.1002/aur.2120

[32]

Justin D. Weisz, Michael Muller, Jessica He, and Stephanie Houde. 2023. Toward General Design Principles for Generative AI Applications. arXiv:2301.05578. Retrieved from https://arxiv.org/abs/2301.05578

[33]

Yi Lin Wong and Kin Wai Michael Siu. 2012. Is there creativity in design? From a perspective of school design and technology in Hong Kong. Asia Pac. Educ. Rev. 13, 3 (September 2012), 465–474. https://doi.org/10.1007/s12564-012-9208-y

[34]

Design and Technology Association. 2023. Special Educational Needs - D&T Association. Retrieved from https://www.designtechnology.org.uk/for-education/special-educational-needs/.

[35]

Education Bureau. 2022. SENSE - Categories and Numbers of Special Schools. Retrieved from https://sense.edb.gov.hk/en/special-education/categories-and-numbers-of-special-schools.html

[36]

Education Bureau. 2022. SENSE - Underlying Principles. Retrieved from https://sense.edb.gov.hk/en/special-education/principles.html

[37]

Digital Literacy & Design. 2023. Digital Literacy & Design | Convent & Stuart Hall. Retrieved from https://www.sacredsf.org/the-education/curriculum/digital-literacy-design/.

[38]

Office for Standards in Education Children's Services and Skills (Ofsted). 2011. Meeting Technological Challenges: Design and Technology in Schools 2007–10. Ofsted Survey Report Reference No. 100121. Office for Standards in Education Children's Services and Skills, UK.

[39]

Stable Diffusion Online. 2023. Stable Diffusion Online. Retrieved from https://stablediffusionweb.com/.

[40]

Canva. 2023. Canva: Visual Suite for Everyone. Retrieved from https://www.canva.com/en/.

[41]

Xi Liu, Newman Lau, Alex Chuin, Wun Kam Reginia Leung, Ada How Sim Ho, Mohana Das, Mengru Liu, and Cheuk Lam Kwok. 2023. Enhancing design competencies for students with special educational needs for future career development. In IASDR 2023: Life-Changing Design, October 9-13, 2023, Milan, Italy. https://doi.org/10.21606/iasdr.2023.370

[42]

MinisterAI. 2023. MinisterAI - Free online AI Art Generator | Stable Diffusion. Retrieved from https://mst.ai/home/.

Cited By

Song YHuang LZheng LFan MLiu Z(2025)Interactions with generative AI chatbots: unveiling dialogic dynamics, students’ perceptions, and practical competencies in creative problem-solvingInternational Journal of Educational Technology in Higher Education10.1186/s41239-025-00508-222:1Online publication date: 5-Mar-2025
https://doi.org/10.1186/s41239-025-00508-2
Daher WHussein A(2024)Higher Education Students’ Perceptions of GenAI Tools for LearningInformation10.3390/info1507041615:7(416)Online publication date: 18-Jul-2024
https://doi.org/10.3390/info15070416
Shrivastava VSharma SChakraborty DKinnula M(2024)Is a Sunny Day Bright and Cheerful or Hot and Uncomfortable? Young Children's Exploration of ChatGPTProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685397(1-15)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3679318.3685397

Index Terms

Understanding Students’ Perspectives, Practices, and Challenges of Designing with AI in Special Schools
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Empirical studies in HCI

Recommendations

Questioning the AI: Informing Design Practices for Explainable AI User Experiences
CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

A surge of interest in explainable AI (XAI) has led to a vast collection of algorithmic work on the topic. While many recognize the necessity to incorporate explainability features in AI systems, how to address real-world user needs for understanding AI ...
Comparing Mathematics and Science Achievement of Students from Schools with PLTW versus Schools without PLTW
2018 IEEE Frontiers in Education Conference (FIE)
Project Lead the Way (PLTW) has been developed to provide a rigorous engineering curriculum that allows high school students to learn about advanced engineering concepts and their application in various STEM-related subjects. The present study was ...
Player-AI Interaction: What Neural Network Games Reveal About AI as Play
CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems

The advent of artificial intelligence (AI) and machine learning (ML) bring human-AI interaction to the forefront of HCI research. This paper argues that games are an ideal domain for studying and experimenting with how humans interact with AI. Through a ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

CHCHI '23: Proceedings of the Eleventh International Symposium of Chinese CHI

November 2023

634 pages

ISBN:9798400716454

DOI:10.1145/3629606

Copyright © 2023 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 February 2024

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

CHCHI 2023

CHCHI 2023: Chinese CHI 2023

November 13 - 16, 2023

Denpasar, Bali, Indonesia

Acceptance Rates

Overall Acceptance Rate 17 of 40 submissions, 43%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
1,114
Total Downloads

Downloads (Last 12 months)1,110
Downloads (Last 6 weeks)101

Reflects downloads up to 07 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Song YHuang LZheng LFan MLiu Z(2025)Interactions with generative AI chatbots: unveiling dialogic dynamics, students’ perceptions, and practical competencies in creative problem-solvingInternational Journal of Educational Technology in Higher Education10.1186/s41239-025-00508-222:1Online publication date: 5-Mar-2025
https://doi.org/10.1186/s41239-025-00508-2
Daher WHussein A(2024)Higher Education Students’ Perceptions of GenAI Tools for LearningInformation10.3390/info1507041615:7(416)Online publication date: 18-Jul-2024
https://doi.org/10.3390/info15070416
Shrivastava VSharma SChakraborty DKinnula M(2024)Is a Sunny Day Bright and Cheerful or Hot and Uncomfortable? Young Children's Exploration of ChatGPTProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685397(1-15)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3679318.3685397

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Figures

Tables

Media

View Table of Conten