Zhiyi Rong
ABSTRACT
Tangible programming toolkits are widely used to nurture computational literacy in the young generation. However, novice learners with visual impairment have been neglected as these toolkits are primarily designed for sighted students, and mostly rely on visual cues in the whole manipulation process. To fill this gap, we present CodeRhythm, a tangible programming toolkit for engaging blind and visually impaired (BVI) students to learn basic programming concepts by creating simple melodies (Figure 1). In the rest of the paper, we will first discuss the background of tangible educational toolkits and accessible programming tools, describe the design features of CodeRhythm, and discuss the feedback and future improvement by the preliminary user study.
- Jeffrey P. Bigham, Maxwell B. Aller, Jeremy T. Brudvik, Jessica O. Leung, Lindsay A. Yazzolino, and Richard E. Ladner. 2008. Inspiring Blind High School Students to Pursue Computer Science with Instant Messaging Chatbots. In Proceedings of the 39th SIGCSE Technical Symposium on Computer Science Education (SIGCSE '08), 449--453. DOI: https://doi.org/10.1145/1352135.1352287Google Scholar
Digital Library
- Leah Buechley, Mike Eisenberg, Jaime Catchen, and Ali Crockett. The LilyPad Arduino: using computational textiles to investigate engagement, aesthetics, and diversity in computer science education. 2008. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09). ACM, New York, NY, USA, 423--432 DOI: https://doi.org/10.1145/1357054.1357123Google Scholar
- Alexandru Dancu, Catherine Hedler, Stig Anton Nielsen, Hanna Frank, Zhu Kening, Axel Pelling, Adviye Ayça Ünlüer, Christian Carlsson, Max Witt, and Morten Fjeld. 2015. Emergent Interfaces: Constructive Assembly of Identical Units. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '15). Association for Computing Machinery, New York, NY, USA, 451--460. DOI: https://doi.org/10.1145/2702613.2732509Google ScholarDigital Library
- Michael S. Horn and Robert J. K. Jacob. 2007. Tangible programming in the classroom with Tern. In CHI '07 Extended Abstracts on Human Factors in Computing Systems (CHI EA '07). ACM, New York, NY, USA, 1965--1970. DOI: https://doi.org/10.1145/1240866.1240933Google Scholar
- Michael S. Horn, Erin T. Solovey, R. Jordan Crouser, Robert J.K. Jacob. 2009. Comparing the use of tangible and graphical programming languages for informal science education. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09). ACM, New York, NY, USA, 975--984. DOI: https://doi.org/10.1145/1518701.1518851Google ScholarDigital Library
- Felix Hu, Ariel Zekelman, Michael Horn, and Frances Judd. 2015. Strawbies: explorations in tangible programming. In Proceedings of the 14th International Conference on Interaction Design and Children(IDC '15). ACM, New York, NY, USA, 410--413. DOI: http://dx.doi.org/10.1145/2771839.2771866Google ScholarDigital Library
- Hiroshi Ishii. 2008. The tangible user interface and its evolution. Commun. ACM 51, 6 (June 2008), 32--36. DOI:https://doi.org/10.1145/1349026.1349034Google ScholarDigital Library
- Filiz Kaleliolu. 2015. A new way of teaching programming skills to K-12 students: Code. org. Computers in Human Behavior, 52, 200--210.Google ScholarDigital Library
- Shaun K. Kane and Jeffrey P. Bigham. 2014. Tracking @Stemxcomet: Teaching Programming to Blind Students via 3D Printing, Crisis Management, and All Twitter. In Proceedings of the 45th ACM Technical Symposium on Computer Science Education (SIGCSE '14), 247--252.DOI: https://doi.org/10.1145/2538862.2538975Google Scholar
- Shaun K. Kane, Varsha Koushik, and Annika Muehlbradt. 2018. Bonk: accessible programming for accessible audio games. In Proceedings of the 17th ACM Conference on Interaction Design and Children (IDC '18). ACM, New York, NY, USA, 132142. DOI: https://doi.org/10.1145/3202185.3202754Google ScholarDigital Library
- Varsha Koushik, Darren Guinness, and Shaun K. Kane. 2019. StoryBlocks: A Tangible Programming Game To Create Accessible Audio Stories. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). Association for Computing Machinery, New York, NY, USA, Paper 492, 1--12.Google Scholar
- Caitlin Kelleher, Randy Pausch, and Sara Kiesler. 2007. Storytelling alice motivates middle school girls to learn computer programming. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '07). ACM, New York, NY, USA, 1455--1464. DOI: https://doi.org/10.1145/1240624.1240844Google ScholarDigital Library
- Morrison, Cecily; Villar, Nicolas; Hadwen-Bennett, Alex; Regan, Tim; Cletheroe, Daniel; Thieme, Anja; Sentance, Sue. Physical Programming for Blind and Low Vision Children at Scale. In: HUMAN COMPUTER INTERACTION. 2019; pp. 1--35.Google Scholar
- Ana Cristina Pires, Sebastian Marichal, Fernando Gonzalez-Perilli, Ewelina Bakala, Bruno Fleischer, Gustavo Sansone, and Tiago Guerreiro. 2019. A Tangible Math Game for Visually Impaired Children. In The 21st International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '19). Association for Computing Machinery, New York, NY, USA, 670--672.Google ScholarDigital Library
- Mitchel Resnick, John Maloney, Andrés MonroyHernández, Natalie Rusk, Evelyn Eastmond, Karen Brennan, Amon Millner,Eric Rosenbaum, Jay Silver, Brian Silverman, and Yasmin Kafai. 2009. Scratch: programming for all. Communications of the ACM 52,11: 60--67. DOI: https://doi.org/10.1145/1592761.1592779Google ScholarDigital Library
- Alpay Sabuncuoglu. 2020. Tangible Music Programming Blocks for Visually Impaired Children. In Proceedings of the Fourteenth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '20). Association for Computing Machinery, New York, NY, USA, 423--429.Google ScholarDigital Library
- Kening Zhu, Alexandru Dancu, and Shengdong (Shen) Zhao. 2016. FusePrint: A DIY 2.5D Printing Technique Embracing Everyday Artifacts. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems (DIS '16). Association for Computing Machinery, New York, NY, USA, 146--157. DOI:https://doi.org/10.1145/2901790.2901792Google ScholarDigital Library
- Kening Zhu, Taizhou Chen, Feng Han, and YiShiun Wu. 2019. HapTwist: Creating Interactive Haptic Proxies in Virtual Reality Using Low-cost Twistable Artefacts. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). Association for Computing Machinery, New York, NY, USA, Paper 693, 1--13. DOI:https://doi.org/10.1145/3290605.3300923Google ScholarDigital Library
- Kening Zhu, Hideaki Nii, Owen Noel Newton Fernando, and Adrian David Cheok. 2011. Selective inductive powering system for paper computing. In Proceedings of the 8th International Conference on Advances in Computer Entertainment Technology (ACE '11). Association for Computing Machinery, New York, NY, USA, Article 59, 1--7. DOI:https://doi.org/10.1145/2071423.2071497Google ScholarDigital Library
- Kening Zhu, Xiaojuan Ma, Gary Ka Wai Wong, and John Man Ho Huen. 2016. How Different Input and Output Modalities Support Coding as a ProblemSolving Process for Children. In Proceedings of the The 15th International Conference on Interaction Design and Children (IDC '16). Association for Computing Machinery, New York, NY, USA, 238--245. DOI:https://doi.org/10.1145/2930674.2930697Google ScholarDigital Library
- Kening Zhu. 2012. A framework for interactive paper-craft system. In CHI '12 Extended Abstracts on Human Factors in Computing Systems (CHI EA '12). Association for Computing Machinery, New York, NY, USA, 1411--1416. DOI:https://doi.org/10.1145/2212776.2212464Google ScholarDigital Library
Index Terms
- CodeRhythm: Designing Inclusive Tangible Programming Blocks
Recommendations
CodeRhythm: A Tangible Programming Toolkit for Visually Impaired Students
AsianCHI '20: Proceedings of the 2020 Symposium on Emerging Research from Asia and on Asian Contexts and CulturesBlock-based programming toolkits are widely used to nurture computational literacy in the young generation. However, they may not be suitable for young blind and visually impaired (BVI) students as these toolkits mostly rely on visual cues in the whole ...
Toward Inclusive Learning: Designing and Evaluating Tangible Programming Blocks for Visually Impaired Students
Human-Computer Interaction. Human Values and Quality of LifeTangible programming and informal science learning: making TUIs work for museums
IDC '08: Proceedings of the 7th international conference on Interaction design and childrenIn this paper we describe the design and initial evaluation of a tangible computer programming exhibit for children on display at the Boston Museum of Science. We also discuss five design considerations for tangible interfaces in science museums that ...
Comments