skip to main content
10.1145/3130859.3131336acmconferencesArticle/Chapter ViewAbstractPublication Pageschi-playConference Proceedingsconference-collections
Work in Progress

KeynVision: Exploring Piano Pedagogy in Mixed Reality

Published:15 October 2017Publication History

ABSTRACT

Integrating new technology such as Augmented Reality into an established learning context is not a simple process. We explore the use of mixed reality for piano pedagogy, focusing on notation literacy, and playtest a series of prototypes with a panel of practitioners in piano teaching. Our piano training game prototypes called KeynVision (keen-vision) use the Microsoft Hololens to playfully introduce octave scales, chords, and arpeggios to beginners. Based on the results, the augmented contextualization of mixed reality can be an effective tool for aiding students in the process of learning to play piano.

References

  1. R. T. Azuma. 1997. A survey of augmented reality. Presence: Teleoperators and Virtual Environments (1997).Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Alexandru Balog and Costin Pribeanu. 2010. The Role of Perceived Enjoyment in the Students' Acceptance of an Augmented Reality Teaching Platform: A Structural Equation Modelling Approach. Studies in Informatics and Control (2010).Google ScholarGoogle Scholar
  3. Chuan C. Chang. 2016. Fundamentals of Piano Practice. http://pianofundamentals.com/. (2016).Google ScholarGoogle Scholar
  4. Jonathan Chow, Haoyang Feng, Robert Amor, and Burkhahrd C. Wunsche. 2013. Music education using augmented reality with a head mounted display. AUIC (2013).Google ScholarGoogle Scholar
  5. Matt Dunleavy, Chris Dede, and Rebecca Mitchell. 2008. Affordances and Limitations of Immersive Participatory Augmented Reality Simulations for Teaching and Learning. Journal of Science Education and Technology (2008).Google ScholarGoogle Scholar
  6. Steven J Henderson. 2011. Augmented Reality Interfaces for Procedural Tasks. Columbia University (2011).Google ScholarGoogle Scholar
  7. Kangdon Lee. 2012. Augmented Reality in Education and Training. TechTrends 56 (2012), 13--21. Issue 2.Google ScholarGoogle ScholarCross RefCross Ref
  8. Yanjin Long and Vincent Aleven. 2014. Gamification of Joint Student/System Control over Problem Selection in a Linear Equation Tutor. SpringerLink (2014).Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. R. E. Mayer. 2009. Multimedia learning (2nd ed). Cambridge University Press. (2009). Google ScholarGoogle ScholarCross RefCross Ref
  10. Siew Nyet Moi. 2016. Students' Algebraic Thinking and Attitudes towards Algebra: The Effects of Game-Based Learning using Dragonbox 12 App. Academia.edu (2016).Google ScholarGoogle Scholar
  11. Yoichi Motokawa and Hideo Saito. 2006. Support system for guitar playing using augmented reality display. IEEE/ACM International Symposium on Mixed and Augmented Reality (2006).Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Francois Berard Ozan Cakmakci and Joelle Coutaz. 2006. An Augmented Reality Based Learning Assistant for Electric Bass Guitar. CLIPS-IMAG BP 53 (2006).Google ScholarGoogle Scholar
  13. Iuli Radu. 2014. Augmented reality in education: a meta-review and cross-media analysis. Springer-Verlag London (2014).Google ScholarGoogle Scholar
  14. K. E. Shacklock. 2011. Personal Communication. N.p. (2011).Google ScholarGoogle Scholar
  15. Stephen D. Sorden. 2012. The Cognitive Theory of Multimedia Learning. 2012 IEEE 12th International Conference on Advanced Learning Technologies (2012).Google ScholarGoogle Scholar
  16. Clay Spinuzzi. 2005. The Methodology of Participatory Design. Technical Communication (2005).Google ScholarGoogle Scholar
  17. Lisa Torrey and Jude Shavlik. 2009. Transfer Learning. In Handbook of Research on Machine Learning Applications, E. Soria, J. Martin, R. Magdalena, M. Martinez, and A. Serrano (Eds.). IGI Global.Google ScholarGoogle Scholar
  18. M Uszler. 2000. The Well-Tempered Keyboard Teacher, Second Edition. Schirmer Books (2000).Google ScholarGoogle Scholar
  19. Chris W Wasko. 2013. Instructional Design Guidelines for Procedural Instruction Delivered via Augmented Reality. Virginia Polytechnic Institute and State University (2013).Google ScholarGoogle Scholar

Index Terms

  1. KeynVision: Exploring Piano Pedagogy in Mixed Reality

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      CHI PLAY '17 Extended Abstracts: Extended Abstracts Publication of the Annual Symposium on Computer-Human Interaction in Play
      October 2017
      700 pages
      ISBN:9781450351119
      DOI:10.1145/3130859

      Copyright © 2017 Owner/Author

      Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 15 October 2017

      Check for updates

      Qualifiers

      • Work in Progress

      Acceptance Rates

      CHI PLAY '17 Extended Abstracts Paper Acceptance Rate46of178submissions,26%Overall Acceptance Rate421of1,386submissions,30%

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader