skip to main content
10.1145/3341215.3356264acmconferencesArticle/Chapter ViewAbstractPublication Pageschi-playConference Proceedingsconference-collections
Work in Progress

HyperCubes: A Playful Introduction to Computational Thinking in Augmented Reality

Published: 17 October 2019 Publication History

Abstract

We present HyperCubes, an Augmented Reality (AR) platform to foster computational literacy. Using paper cubes as AR markers and spatial tracking, the user becomes familiar with sequences of instructions as coding blocks. We leverage spatial cognition as a means to improve understanding of procedural and sequential models. We have performed two pilot studies for an iterative and user centered design of the platform. With a final qualitative user study we address engagement levels and the educational potential of the platform. We argue that by using spatial cognition and the flexibility of the AR medium, a playful introduction to basic computational thinking concepts can be presented in late elementary school and middle school children.

Supplemental Material

ZIP File
3 minute video (mp4) of the HyperCubes application with different examples of usage and children playing with the platform.

References

[1]
Judith Amores, Xavier Benavides, Michel Comin, Anna Fusté, Pol Pla, and David Miralles. 2012. Smart Avatars: using avatars to interact with objects. (2012).
[2]
Alissa N Antle. 2009. LIFELONG INTERACTIONS: Embodied child computer interaction: why embodiment matters. interactions 16, 2 (2009), 27--30.
[3]
Mikkel M Beck, Rune R Lind, Svend S Geertsen, Christian Ritz, Jesper Lundbye-Jensen, and Jacob Wienecke. 2016. Motor-enriched learning activities can improve mathematical performance in preadolescent children. Frontiers in human neuroscience 10 (2016), 645.
[4]
Tim Bell, Jason Alexander, Isaac Freeman, and Mick Grimley. 2009. Computer science unplugged: School students doing real computing without computers. The New Zealand Journal of Applied Computing and Information Technology 13, 1 (2009), 20--29.
[5]
Barbara Cleto, Joao Moura, Cristina Sylla, and Luis Ferreira. 2018. CodeCubes - Playing with Cubes and Learning to Code.
[6]
Stephen Cooper, Wanda Dann, and Randy Pausch. 2000. Alice: a 3-D tool for introductory programming concepts. In Journal of Computing Sciences in Colleges, Vol. 15. Consortium for Computing Sciences in Colleges, 107--116.
[7]
Ángela Di Serio, María Blanca Ibáñez, and Carlos Delgado Kloos. 2013. Impact of an augmented reality system on students' motivation for a visual art course. Computers & Education 68 (2013), 586--596.
[8]
Adso Fernández-Baena, La Salle-URL, and David Miralles. 2014. Avatar: Tangible interaction and augmented reality in character animation. on Interacting with Smart Objects (2014), 28.
[9]
Morten Fjeld and Benedikt M Voegtli. 2002. Augmented chemistry: An interactive educational workbench. In Mixed and Augmented Reality, 2002. ISMAR 2002. Proceedings. International Symposium on. IEEE, 259--321.
[10]
Anna Fusté, Judith Amores, David Ha, Jonas Jongejan, and Amit Pitaru. 2017. Paper Cubes: Evolving 3D characters in Augmented Reality using Recurrent Neural Networks. NIPS.
[11]
Sidhant Goyal, Rohan S Vijay, Charu Monga, and Pratul Kalita. 2016. Code Bits: An Inexpensive Tangible Computational Thinking Toolkit For K-12 Curriculum. In Proceedings of the TEI'16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction. ACM, 441--447.
[12]
Michael S Horn and Robert JK Jacob. 2007. Designing tangible programming languages for classroom use. In Proceedings of the 1st international conference on Tangible and embedded interaction. ACM, 159--162.
[13]
Michael S. Horn, Erin Treacy Solovey, R. Jordan Crouser, and Robert J.K. Jacob. 2009. Comparing the Use of Tangible and Graphical Programming Languages for Informal Science Education. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09). ACM, New York, NY, USA, 975--984.
[14]
Qiao Jin, Danli Wang, Xiaozhou Deng, Nan Zheng, and Steve Chiu. 2018. AR-Maze: a tangible programming tool for children based on AR technology. In Proceedings of the 17th ACM Conference on Interaction Design and Children. ACM, 611--616.
[15]
Hannes Kaufmann and Dieter Schmalstieg. 2002. Mathematics and geometry education with collaborative augmented reality. In ACM SIGGRAPH 2002 conference abstracts and applications. ACM, 37--41.
[16]
Alan Kay, Kim Rose, Dan Ingalls, Ted Kaehler, John Maloney, Scott Wallace, and others. 1997. Etoys & SimStories. ImagiLearning Internal Document (1997).
[17]
Mehmet Kesim and Yasin Ozarslan. 2012. Augmented reality in education: current technologies and the potential for education. Procedia-Social and Behavioral Sciences 47 (2012), 297--302.
[18]
Kangdon Lee. 2012. Augmented reality in education and training. TechTrends 56, 2 (2012), 13--21.
[19]
James Lockwood and Aidan Mooney. 2017. Computational Thinking in Education: Where does it fit? A systematic literary review. arXiv preprint arXiv:1703.07659 (2017).
[20]
Timothy S McNerney. 2004. From turtles to Tangible Programming Bricks: explorations in physical language design. Personal and Ubiquitous Computing 8, 5 (2004), 326--337.
[21]
Nora Newcombe. 2017. The connection between spatial intelligence and STEM. (2017).
[22]
Nora S Newcombe. 2010. Picture this: Increasing math and science learning by improving spatial thinking. American Educator 34, 2 (2010), 29.
[23]
Seymour Papert. 1980. Mindstorms: Children, computers, and powerful ideas. Basic Books, Inc, New York, NY.
[24]
Shaileen Crawford Pokress and José Juan Dominguez Veiga. 2013. MIT App Inventor: Enabling personal mobile computing. arXiv preprint arXiv:1310.2830 (2013).
[25]
Iulian Radu and Blair MacIntyre. 2009. Augmented-reality scratch: a tangible programming environment for children. In Proceedings of conference on interaction design for children, Como, Italy.
[26]
A Rees, Francisco J García-Peñalvo, I Jormanainen, M Tuul, and D Reimann. 2016. An overview of the most relevant literature on coding and computational thinking with emphasis on the relevant issues for teachers. (2016).
[27]
Alex Repenning. 1993. Agentsheets: a tool for building domain-oriented visual programming environments. In Proceedings of the INTERACT'93 and CHI'93 conference on Human factors in computing systems. ACM, 142--143.
[28]
Mitchel Resnick, John Maloney, Andrés Monroy-Hernández, Natalie Rusk, Evelyn Eastmond, Karen Brennan, Amon Millner, Eric Rosenbaum, Jay Silver, Brian Silverman, and others. 2009. Scratch: programming for all. Commun. ACM 52, 11 (2009), 60--67.
[29]
Eric Rosenbaum. 2010. Color Code. (2010). https://www.ericrosenbaum.com/color-code/
[30]
Shourya Pratap Singh, Ankit Kumar Panda, Susobhit Panigrahi, and Ajaya Kumar Dash. 2018. PlutoAR: An Inexpensive, Interactive And Portable Augmented Reality Based Interpreter For K-10 Curriculum. arXiv preprint arXiv:1809.00375 (2018).
[31]
Arash Soleimani. 2014. CyberPLAYce: a play space of creative, intelligent tools promoting personal and computational expression for early learners. In Proceedings of the 2014 companion publication on Designing interactive systems. ACM, 191--194.
[32]
Hideyuki Suzuki and Hiroshi Kato. 1993. AlgoBlock: a tangible programming language, a tool for collaborative learning. In Proceedings of 4th European Logo Conference. 297--303.
[33]
Cristina Sylla, Pedro Branco, Clara Coutinho, and Eduarda Coquet. 2012. TUIs vs. GUIs: comparing the learning potential with preschoolers. Personal and Ubiquitous Computing 16, 4 (2012), 421--432.
[34]
Jonathan Wai, David Lubinski, and Camilla P Benbow. 2009. Spatial ability for STEM domains: Aligning over 50 years of cumulative psychological knowledge solidifies its importance. Journal of Educational Psychology 101, 4 (2009), 817.
[35]
Jeannette M Wing. 2006. Computational thinking. Commun. ACM 49, 3 (2006), 33--35.
[36]
Chip Wood. 1997. Yardsticks: Children in the Classroom Ages 4--14. A Resource for Parents and Teachers. ERIC.
[37]
Fabio Zünd, Mattia Ryffel, Stéphane Magnenat, Alessia Marra, Maurizio Nitti, Mubbasir Kapadia, Gioacchino Noris, Kenny Mitchell, Markus Gross, and Robert W Sumner. 2015. Augmented creativity: bridging the real and virtual worlds to enhance creative play. In SIGGRAPH Asia 2015 Mobile Graphics and Interactive Applications. ACM, 21.

Cited By

View all
  • (2024)Leveraging IEC and Others’ Viewpoints Presentation to Support Creative ThinkingInternational Journal of Affective Engineering10.5057/ijae.IJAE-D-24-0000123:2(157-168)Online publication date: 2024
  • (2024)Algo-AR: Development of an Augmented Reality-Supported Tangible Programming Tool to Improve Algorithmic Thinking SkillsBilişim Teknolojileri Dergisi10.17671/gazibtd.139878117:2(59-69)Online publication date: 30-Apr-2024
  • (2024)An Overview of Enhancing Distance Learning Through Emerging Augmented and Virtual Reality TechnologiesIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.326457730:8(4480-4496)Online publication date: 1-Aug-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
CHI PLAY '19 Extended Abstracts: Extended Abstracts of the Annual Symposium on Computer-Human Interaction in Play Companion Extended Abstracts
October 2019
859 pages
ISBN:9781450368711
DOI:10.1145/3341215
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 October 2019

Check for updates

Author Tags

  1. augmented reality
  2. computational thinking
  3. diy
  4. k-12 education
  5. paper crafts
  6. programming
  7. spatial cognition

Qualifiers

  • Work in progress

Data Availability

3 minute video (mp4) of the HyperCubes application with different examples of usage and children playing with the platform. https://dl.acm.org/doi/10.1145/3341215.3356264#CPEAwp041aux.zip

Conference

CHI PLAY '19
Sponsor:

Acceptance Rates

CHI PLAY '19 Extended Abstracts Paper Acceptance Rate 51 of 181 submissions, 28%;
Overall Acceptance Rate 421 of 1,386 submissions, 30%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)38
  • Downloads (Last 6 weeks)10
Reflects downloads up to 14 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Leveraging IEC and Others’ Viewpoints Presentation to Support Creative ThinkingInternational Journal of Affective Engineering10.5057/ijae.IJAE-D-24-0000123:2(157-168)Online publication date: 2024
  • (2024)Algo-AR: Development of an Augmented Reality-Supported Tangible Programming Tool to Improve Algorithmic Thinking SkillsBilişim Teknolojileri Dergisi10.17671/gazibtd.139878117:2(59-69)Online publication date: 30-Apr-2024
  • (2024)An Overview of Enhancing Distance Learning Through Emerging Augmented and Virtual Reality TechnologiesIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.326457730:8(4480-4496)Online publication date: 1-Aug-2024
  • (2024)Gamification Applied to Programming Learning with Virtual Reality and Augmented Reality: Comparative AnalysisProceedings of the International Conference on Computer Science, Electronics and Industrial Engineering (CSEI 2023)10.1007/978-3-031-70981-4_11(146-161)Online publication date: 23-Dec-2024
  • (2023)Reality and Beyond: Proxemics as a Lens for Designing Handheld Collaborative Augmented RealityProceedings of the ACM on Human-Computer Interaction10.1145/36264637:ISS(21-40)Online publication date: 1-Nov-2023
  • (2023)MagiBricks: Fostering Intergenerational Connectedness in Distributed Play with Smart Toy BricksProceedings of the 22nd Annual ACM Interaction Design and Children Conference10.1145/3585088.3589390(239-252)Online publication date: 19-Jun-2023
  • (2023)Stackable Music: A Marker-Based Augmented Reality Music Synthesis GameCompanion Proceedings of the Annual Symposium on Computer-Human Interaction in Play10.1145/3573382.3616071(22-28)Online publication date: 6-Oct-2023
  • (2023)Emerging Technologies in K–12 Education: A Future HCI Research AgendaACM Transactions on Computer-Human Interaction10.1145/356989730:3(1-40)Online publication date: 10-Jun-2023
  • (2023)Potentiating Learning Through Augmented Reality and Serious GamesSpringer Handbook of Augmented Reality10.1007/978-3-030-67822-7_15(369-390)Online publication date: 1-Jan-2023
  • (2022)Using Augmented Reality in K-12 Education: An Indicative Platform for Teaching PhysicsInformation10.3390/info1307033613:7(336)Online publication date: 12-Jul-2022
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media