skip to main content
10.1145/2838739.2838751acmotherconferencesArticle/Chapter ViewAbstractPublication PagesozchiConference Proceedingsconference-collections
research-article

VibRein: An Engaging and Assistive Mobile Learning Companion for Students with Intellectual Disabilities

Published:07 December 2015Publication History

ABSTRACT

Massive Open Online Courses (MOOCs) have paved a new wave in the education world. Rich multimedia content coupled with mobile delivery mechanisms makes the content always available and engaging. This paper proposes VibRein to enrich the student interaction with multimedia learning content by making use of different sensors that are available on a mobile device to create an intelligent video consumption experience. VibRein as a companion is even more effective for students with intellectual disabilities who require some form of continuous supervision. It provides an assistive mechanism that keeps track of the user attention using the device camera (this can be particularly useful for students with attention disorder), and uses haptic feedback to recapture attention. In course of the video consumption, VibRein evaluates the learning by asking questions about the content in the video, and automatically force-rewinds to the location where the concept was explained if the user answers incorrectly. It uses tilt in four directions for response to questions, since touch, as a modality on mobile devices requires fine motor skills. An evaluation with 18 users with intellectual disabilities of various kind (autism, intellectual disability and attention deficit hyperactive disorder) suggests that VibRein can provide better learning with less intervention.

References

  1. David Attis, Colin Koproske, Chris Miller, Understanding the MOOC Trend 2012, Advisory Board Company Report, http://blogs.oregonstate.edu/engage/files/2012/12/Understanding-the-MOOC-Trend.pdf. Last accessed October 2013.Google ScholarGoogle Scholar
  2. Razzaq, L., Heffernan, N. T., et. al The Assistment project: Blending assessment and assisting. In Proc. of the 12th Artificial Intelligence in Education, Amsterdam: ISO Press. pp. 555--562. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Department for Education and Skills (2006) Learning Outside the Classroom Manifesto, Learning Outside the Classroom.Google ScholarGoogle Scholar
  4. UNESCO Working Paper Series. The Future of Mobile Learning: Implications for Policy Makers and Planners. UNESCO Publications. 2013.Google ScholarGoogle Scholar
  5. Suporn Pongnumkul, Mira Dontcheva, Wilmot Li, Jue Wang, Lubomir Bourdev, Shai Avidan, and Michael F. Cohen. 2011. Pause-and-play: automatically linking screencast video tutorials with applications. In Proc. UIST 2011, ACM Press (2011), 135--144. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Laurent Denoue, Scott Carter, Matthew Cooper, and John Adcock. 2013. Real-time direct manipulation of screen-based videos. In Proc. IUI 2013 Companion. ACM Press (2013), 43--44. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Wolfgang Hürst and Konrad Meier. 2008. Interfaces for timeline-based mobile video browsing. In Proc. MM 2008, ACM Press (2008), 469--478. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Thorsten Karrer, Moritz Wittenhagen, and Jan Borchers. 2009. PocketDRAGON: a direct manipulation video navigation interface for mobile devices. In Proc. MobileHCI 2009, ACM Press (2009), Article 47, 1--3. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Hao Jiang, Songhua Xu, and Francis Chi-Moon Lau. 2011. Capturing user reading behaviors for personalized document summarization. In Proc. IUI 2011, ACM Press (2011), 355--358. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Robert Bixler and Sidney D'Mello. 2013. Detecting boredom and engagement during writing with keystroke analysis, task appraisals, and stable traits. In Proc. IUI 2013, ACM Press (2013), 225--234. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Roberto Valenti, Alejandro Jaimes, and Nicu Sebe. 2008. Facial expression recognition as a creative interface. In Proc. IUI 2008, ACM Press (2008), 433--434. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Hana Vrzakova. Computational approaches to visual attention for interaction inference. In Proc. IUI 2013 Companion. ACM Press (2013), 37--40. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Scott S. Snibbe, Karon E. MacLean, Rob Shaw, Jayne Roderick, William L. Verplank, and Mark Scheeff. 2001. Haptic techniques for media control. In Proc. UIST 2001, ACM Press (2001), 199--208. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Burkay Sucu and Eelke Folmer. Haptic interface for non-visual steering. In Proc. IUI 2013. ACM Press (2013), 427--434. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Haska Steltenpohl and Anders Bouwer. 2013. Vibrobelt: tactile navigation support for cyclists. In Proc. IUI 2001, pp.417--426. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Raimund Dachselt and Robert Buchholz. 2009. Natural throw and tilt interaction between mobile phones and distant displays. In Ex. Abstracts CHI 2009, ACM Press (2009), pp. 3253--3258. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Yuan Du, Haoyi Ren, Gang Pan, and Shjian Li. 2011. Tilt & touch: mobile phone for 3D interaction. In proc. UbiComp 2011. ACM Press (2011), pp. 485--486. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Lovaas, O. Ivar, Behavioral treatment and normal educational and intellectual functioning in young autistic children. In Journal of Consulting and Clinical Psychology, Vol 55(1), Feb 1987, 3--9.Google ScholarGoogle ScholarCross RefCross Ref
  19. Lorna Wing. Judith Gould, Sybil R. Yeates, Lorna M. Brierly. Symbolic play in severely mentally retarded and in autistic children. In Journal of Child Psychology and Psychiatry. Volume 18, Issue 2, pages 167--178, April 1977.Google ScholarGoogle ScholarCross RefCross Ref
  20. Werry, I & Dautenhahn, K 1999. Applying Mobile Robot Technology to the Rehabilitation of Autistic Children. In Proc. SIRS 1999, pp. 265--272.Google ScholarGoogle Scholar

Index Terms

  1. VibRein: An Engaging and Assistive Mobile Learning Companion for Students with Intellectual Disabilities

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in
        • Published in

          cover image ACM Other conferences
          OzCHI '15: Proceedings of the Annual Meeting of the Australian Special Interest Group for Computer Human Interaction
          December 2015
          691 pages
          ISBN:9781450336734
          DOI:10.1145/2838739

          Copyright © 2015 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 7 December 2015

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article
          • Research
          • Refereed limited

          Acceptance Rates

          OzCHI '15 Paper Acceptance Rate47of97submissions,48%Overall Acceptance Rate362of729submissions,50%

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader