Adam Agassi
Iddo Yehoshua Wald
Oren Zuckerman
ABSTRACT
Children are growing up in a Machine Learning infused world and it's imperative to provide them with opportunities to develop an accurate understanding of basic Machine Learning concepts. Physical gesture recognition is a typical application of Machine Learning, and physical gestures are also an integral part of children's lives, including sports and play. We present Scratch Nodes ML, a system enabling children to create personalized gesture recognizers by: (1) Creating their own gesture classes; (2) Collecting gesture data for each class; (3) Evaluating the classifier they created with new gesture data; (4) Integrating their classifiers into the Scratch environment as new Scratch blocks, empowering other children to use these new blocks as gesture classifiers in their own Scratch creations.
- AIY 2019. Do-it-yourself artificial intelligence. Retrieved January 7, 2019 from https://aiyprojects.withgoogle.com/Google Scholar
- Lisa Anthony, Quincy Brown, Jaye Nias, Berthel Tate, and Shreya Mohan. 2012. Interaction and Recognition Challenges in Interpreting Children's Touch and Gesture Input on Mobile Devices. In Proceedings of the 2012 ACM International Conference on Interactive Tabletops and Surfaces (ITS '12). ACM, New York, NY, USA, 225--234. Google ScholarDigital Library
- Brad Astbury and Frans L Leeuw. 2010. Unpacking black boxes: mechanisms and theory building in evaluation. American journal of evaluation 31, 3 (2010), 363--381.Google Scholar
- Karen Brennan and Mitchel Resnick. 2013. Imagining, Creating, Playing, Sharing, Reflecting: How Online Community Supports Young People as Designers of Interactive Media. In Emerging Technologies for the Classroom: A Learning Sciences Perspective, Chrystalla Mouza and Nancy Lavigne (Eds.). Springer New York, New York, NY, 253--268.Google Scholar
- Stefania Druga, Randi Williams, Hae Won Park, and Cynthia Breazeal. 2018. How Smart Are the Smart Toys?: Children and Parents' Agent Interaction and Intelligence Attribution. In Proceedings of the 17th ACM Conference on Interaction Design and Children (IDC '18). ACM, New York, NY, USA, 231--240. Google ScholarDigital Library
- Tom Hitron, Idan David, Netta Ofer, Andrey Grishko, Iddo Yehoshua Wald, Hadas Erel, and Oren Zuckerman. 2018. Digital Outdoor Play: Benefits and Risks from an Interaction Design Perspective. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 284, 13 pages. Google ScholarDigital Library
- Tom Hitron, Iddo Wald, Hadas Erel, and Oren Zuckerman. 2018. Introducing Children to Machine Learning Concepts Through Hands-on Experience. In Proceedings of the 17th ACM Conference on Interaction Design and Children (IDC '18). ACM, New York, NY, USA, 563--568. Google ScholarDigital Library
- Cindy E. Hmelo and Mark Guzdial. 1996. Of Black and Glass Boxes: Scaffolding for Doing and Learning. In Proceedings of the 1996 International Conference on Learning Sciences (ICLS '96). International Society of the Learning Sciences, 128--134. http://dl.acm.org.ezprimo1.idc.ac.il/citation.cfm?id=1161135.1161153 Google ScholarDigital Library
- Mitchel Resnick and Brian Silverman. 2005. Some reflections on designing construction kits for kids. In Proceedings of the 2005 conference on Interaction design and children. ACM, 117--122. Google ScholarDigital Library
- Ricarose Roque, Natalie Rusk, and Amos Blanton. 2013. Youth roles and leadership in an online creative community. International Society of the Learning Sciences.Google Scholar
- Teachable 2019. Teachable Machine. Retrieved January 7, 2019 from https://teachablemachine.withgoogle.com/Google Scholar
- Jiahui Wu, Gang Pan, Daqing Zhang, Guande Qi, and Shijian Li. 2009. Gesture Recognition with a 3-D Accelerometer. In Proceedings of the 6th International Conference on Ubiquitous Intelligence and Computing (UIC '09). Springer-Verlag, Berlin, Heidelberg, 25--38. Google ScholarDigital Library
- Oren Zuckerman. 2009. Designing digital objects for learning: lessons from Froebel and Montessori. International Journal of Arts and Technology 3, 1 (2009), 124--135.Google ScholarCross Ref
Index Terms
- Scratch Nodes ML: A Playful System for Children to Create Gesture Recognition Classifiers
Recommendations
A gesture-based virtual art program for children with severe motor impairments: development and pilot study
i-CREATe '13: Proceedings of the 7th International Convention on Rehabilitation Engineering and Assistive TechnologyArt plays a vital role in child development. The Kinect Virtual Art Program (KVAP) was designed using Microsoft Kinect gesture recognition technology to allow the creation of art through non-contact 'virtual' button activation. This modality engages ...
BackHand: Sensing Hand Gestures via Back of the Hand
UIST '15: Proceedings of the 28th Annual ACM Symposium on User Interface Software & TechnologyIn this paper, we explore using the back of hands for sensing hand gestures, which interferes less than glove-based approaches and provides better recognition than sensing at wrists and forearms. Our prototype, BackHand, uses an array of strain gauge ...
PlushPal: Storytelling with Interactive Plush Toys and Machine Learning
IDC '21: Proceedings of the 20th Annual ACM Interaction Design and Children ConferenceThis paper presents PlushPal, a web-based design tool for children to make plush toys interactive with machine learning (ML). With PlushPal, children attach micro:bit hardware to stuffed animals, design custom gestures for their toy, and build gesture-...
Comments