skip to main content
10.1145/3594781.3594797acmotherconferencesArticle/Chapter ViewAbstractPublication PagesldtConference Proceedingsconference-collections
research-article

Tingets 2.0: Computer Vision-Powered Interactive Social and Emotional Learning Tool

Published:23 June 2023Publication History

ABSTRACT

Young children between the ages of 3 and 6 often struggle with identifying, expressing, and managing their emotions, especially when it comes to negative emotions. Research indicates that children with higher emotional skills tend to experience greater long-term mental health and well-being benefits. Building on our previous work, we introduce Tingets 2.0, an interactive storytelling app powered by computer vision to facilitate social and emotional learning (SEL) through tangible and digital play. We propose the TinkeRERR framework: Reflect, Express, Regulate, and Repeat, and utilize computer vision technology to combine tangible and digital play seamlessly. Tingets 2.0 aims to help children understand their own and others’ emotions, express emotions constructively, manage negative emotions and cultivate positive emotions. Early results indicate that our novel approach has effectively increased the depth and length of conversations around emotions among children and their parents.

References

  1. CSEFEL: Center on the social and emotional foundations for early learning: http://csefel.vanderbilt.edu/familytools/teaching_emotions.pdf. Accessed: 2023-03-15. Google ScholarGoogle Scholar
  2. What is the Casel Framework?: 2023. https://casel.org/fundamentals-of-sel/what-is-the-casel-framework/. Accessed: 2023-03-14. Google ScholarGoogle Scholar
  3. Marc A Brackett and Susan E Rivers. 2014. Transforming students’ lives with social and emotional learning. International handbook of emotions in education 368, (2014).Google ScholarGoogle Scholar
  4. Lawrence J Schweinhart. 2003. Benefits, Costs, and Explanation of the High/Scope Perry Preschool Program. (2003).Google ScholarGoogle Scholar
  5. Merita Shala and others. 2013. The impact of preschool social-emotional development on academic success of elementary school students. Psychology 4, 11 (2013), 787.Google ScholarGoogle ScholarCross RefCross Ref
  6. Industry Agenda. 2016. New vision for education: Fostering social and emotional learning through technology. In World Economic Forum, March.Google ScholarGoogle Scholar
  7. Shauna L Tominey, Elisabeth C O'Bryon, Susan E Rivers, and Sharon Shapses. 2017. Teaching emotional intelligence in early childhood. YC Young Children 72, 1 (2017), 6–14.Google ScholarGoogle Scholar
  8. Parent survey shows concern about impact of covid-19: https://youngminds.org.uk/about-us/media-centre/press-releases/parent-survey-reveals-widespread-concerns-about-mental-health-impact-of-covid-19-on-young-people-s-mental-health/. Accessed: 2023-03-14. Google ScholarGoogle Scholar
  9. Meirav Hen, Vered Shenaar-Golan, and Uri Yatzker. 2022. Children and adolescents’ mental health following Covid-19: the possible role of difficulty in emotional regulation. Frontiers in Psychiatry 13, (2022).Google ScholarGoogle Scholar
  10. Children's mental health is in crisis: https://www.apa.org/monitor/2022/01/special-childrens-mental-health. Accessed: 2023-03-14. Google ScholarGoogle Scholar
  11. D Sluyter and Peter Salovey. 1997. Emotional development and emotional intelligence: Implications for educators. New York: Basic Books.Google ScholarGoogle Scholar
  12. Martin EP Seligman, Randal M Ernst, Jane Gillham, Karen Reivich, and Mark Linkins. 2009. Positive education: Positive psychology and classroom interventions. Oxford review of education 35, 3 (2009), 293–311.Google ScholarGoogle Scholar
  13. Khan Academy Kids: Learning! - apps on Google Play: https://play.google.com/store/apps/details?id=org.khankids.android. Accessed: 2023-03-14. Google ScholarGoogle Scholar
  14. Breathe, think, do with Sesame Street: 2013. https://apps.apple.com/us/app/breathe-think-do-with-sesame/id721853597. Accessed: 2023-03-14. Google ScholarGoogle Scholar
  15. Maria Montessori. 2013. The montessori method. Transaction publishers.Google ScholarGoogle Scholar
  16. Free Resources for Early Learning: Second Step: https://www.secondstep.org/free-sel-resources/early-learning. Accessed: 2023-03-14. Google ScholarGoogle Scholar
  17. Heidy Maldonado and Ariel Zekelman. 2019. Designing Tangible ABCs: Fröbel's Sticks and Rings for the 21st Century. In Proceedings of the 18th ACM International Conference on Interaction Design and Children, 326–333.Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Matthew Farber and William Merchant. 2022. Insights from investigating early childhood ebooks on literacy, cognitive development, and social and emotional learning outcomes. E-Learning and Digital Media 20, 300-313. DOI:https://doi.org/10.1177/20427530221108538Google ScholarGoogle ScholarCross RefCross Ref
  19. Daniela Vainer and Andrew Utter. 2018. Tingets: a system for young students to communicate and reflect. In Proceedings of the 17th ACM Conference on Interaction Design and Children, 480–483.Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Martin Kaltenbrunner and Ross Bencina. 2007. reacTIVision: a computer-vision framework for table-based tangible interaction. In Proceedings of the 1st international conference on Tangible and embedded interaction, 69–74.Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Bertrand Schneider, Patrick Jermann, Guillaume Zufferey, and Pierre Dillenbourg. 2010. Benefits of a tangible interface for collaborative learning and interaction. IEEE Transactions on Learning Technologies 4, 3 (2010), 222–232. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Alissa N Antle, Milena Droumeva, and Greg Corness. 2008. Playing with the sound maker: do embodied metaphors help children learn? In Proceedings of the 7th international conference on Interaction design and children, 178–185.Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Leila Wehbe, Brian Murphy, Partha Talukdar, Alona Fyshe, Aaditya Ramdas, and Tom Mitchell. 2014. Simultaneously uncovering the patterns of brain regions involved in different story reading subprocesses. PloS one 9, 11 (2014), e112575.Google ScholarGoogle ScholarCross RefCross Ref
  24. Irina R Kumschick, Luna Beck, Michael Eid, Georg Witte, Gisela Klann-Delius, Isabella Heuser, Rüdiger Steinlein, and Winfried Menninghaus. 2014. Reading and feeling: The effects of a literature-based intervention designed to increase emotional competence in second and third graders. Frontiers in Psychology 5, (2014), 1448. Google ScholarGoogle Scholar
  25. Caitlin Gallingane and Heejeong Sophia Han. 2015. Words can help manage emotions: Using research-based strategies for vocabulary instruction to teach emotion words to young children. Childhood Education 91, 5 (2015), 351–362. Google ScholarGoogle ScholarCross RefCross Ref
  26. John Dewey. 1986. Experience and education. In The educational forum, Taylor & Francis, 241–252.Google ScholarGoogle Scholar
  27. Carol Rodgers. 2002. Defining reflection: Another look at John Dewey and reflective thinking. Teachers college record 104, 4 (2002), 842–866.Google ScholarGoogle Scholar
  28. Alice Y Kolb and David A Kolb. 2005. Learning styles and learning spaces: Enhancing experiential learning in higher education. Academy of management learning & education 4, 2 (2005), 193–212. Google ScholarGoogle Scholar
  29. Plousia Misailidi and Fotini Bonoti. 2008. Emotion in children's art: do young children understand the emotions expressed in other children's drawings? Journal of Early Childhood Research 6, 2 (2008), 189–200.Google ScholarGoogle ScholarCross RefCross Ref
  30. Heather M Kelley, Teddi Cunningham, and Jennifer Branscome. 2015. Reflective journaling with at-risk students. Vistas Online 9, (2015).Google ScholarGoogle Scholar
  31. Diana A Coholic and Mark Eys. 2016. Benefits of an arts-based mindfulness group intervention for vulnerable children. Child and adolescent social work journal 33, (2016), 1–13.Google ScholarGoogle Scholar
  32. Jon Kabat Zinn. 1994. Wherever you go, there you are: Mindfulness meditation in everyday life. Hyperion (1994), 78–80.Google ScholarGoogle Scholar
  33. Philippe Goldin. 2008. Mindfulness-based stress reduction for school-age children. New Harbinger Publications Oakland, CA, USA.Google ScholarGoogle Scholar
  34. Amy Saltzman. 2014. A still quiet place: A mindfulness program for teaching children and adolescents to ease stress and difficult emotions. New Harbinger Publications.Google ScholarGoogle Scholar
  35. Gail E Joseph and Phillip S Strain. 2003. Enhancing emotional vocabulary in young children. Young Exceptional Children 6, 4 (2003), 18–26.Google ScholarGoogle ScholarCross RefCross Ref
  36. Grazyna Kochanska. 2001. Emotional development in children with different attachment histories: The first three years. Child development 72, 2 (2001), 474–490.Google ScholarGoogle Scholar
  37. Brian J Fogg. 2009. A behavior model for persuasive design. In Proceedings of the 4th international Conference on Persuasive Technology, 1–7.Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. David Rose. 2000. Universal design for learning. Journal of Special Education Technology 15, 4 (2000), 47–51.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Tingets 2.0: Computer Vision-Powered Interactive Social and Emotional Learning Tool
      Index terms have been assigned to the content through auto-classification.

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Other conferences
        LDT '23: Proceedings of the 2023 Symposium on Learning, Design and Technology
        June 2023
        128 pages
        ISBN:9798400707360
        DOI:10.1145/3594781

        Copyright © 2023 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 23 June 2023

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article
        • Research
        • Refereed limited
      • Article Metrics

        • Downloads (Last 12 months)97
        • Downloads (Last 6 weeks)11

        Other Metrics

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      HTML Format

      View this article in HTML Format .

      View HTML Format