Abstract
ARPiano uses a MIDI keyboard and a multifunction knob to create a novel mixed reality experience that supports visual music learning, music visualizations and music understanding. At its core, ARPiano provides a framework for extending a physical piano using augmented reality. ARPiano is able to precisely locate a physical keyboard in order to overlay various objects around the keyboard and on individual keys. These augmented objects are then used for music learning, visualization and understanding. Furthermore, ARPiano demonstrates a novel way to utilize the keys in a piano as an interface to interact with various augmented objects.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Campbell, P.S., Scott-Kassner, C., Kassner, K.: Music in childhood: from preschool through the elementary grades. Schirmer Cengage Learning, Boston (2014)
Gault, B.: Music learning through all the channels: combining aural, visual, and kinesthetic strategies to develop musical understanding. Gen. Music Today 19(1), 7–9 (2005). https://doi.org/10.1177/10483713050190010103
Morris, C.: Making sense of education: sensory ethnography and visual impairment. Ethnography Educ. 12(1), 1–16 (2016). https://doi.org/10.1080/17457823.2015.1130639
Harmonic Coloring: A method for indicating pitch class (n.d.). http://www.musanim.com/mam/circle.html. Accessed 11 Dec 2017
Music Learning Software for Educators & Students (n.d.). https://www.smartmusic.com/. Accessed 11 Dec 2017
Synthesia, Piano for Everyone (n.d.). https://www.synthesiagame.com/. Accessed 11 Dec 2017
Xiao, X.: Andante: a walking tempo (n.d.). http://portfolio.xiaosquared.com/Andante. Accessed 11 Dec 2017
Xiao, X.: Perpetual Canon (n.d.). http://portfolio.xiaosquared.com/Perpetual-Canon. Accessed 11 Dec 2017
Takahashi, K.: MidiJack, 5 November 2016. https://github.com/keijiro/MidiJack. Accessed 11 Dec 2017
Tone.js (n.d.). https://tonejs.github.io/. Accessed 11 Dec 2017
Color Music Theory (n.d.). https://www.facebook.com/Virtuosoism/. Accessed 11 Dec 2017
How does Muse work? (n.d.). http://www.choosemuse.com/how-does-muse-work/. Accessed 11 Dec 2017
Smith, T.F., Waterman, M.S.: Identification of common molecular subsequences. J. Mol. Biol. 147, 195–197 (1981)
May, P., Ehrlich, H.C., Steinke, T.: ZIB structure prediction pipeline: composing a complex biological workflow through web services. In: Nagel, W.E., Walter, W.V., Lehner, W. (eds.) Euro-Par 2006. LNCS, vol. 4128, pp. 1148–1158. Springer, Heidelberg (2006)
Foster, I., Kesselman, C.: The Grid: Blueprint for a New Computing Infrastructure. Morgan Kaufmann, San Francisco (1999)
Czajkowski, K., Fitzgerald, S., Foster, I., Kesselman, C.: Grid information services for distributed resource sharing. In: 10th IEEE International Symposium on High Performance Distributed Computing, pp. 181–184. IEEE Press, New York (2001)
Foster, I., Kesselman, C., Nick, J., Tuecke, S.: The physiology of the grid: an open grid services architecture for distributed systems integration. Technical report, Global Grid Forum (2002)
National Center for Biotechnology Information. http://www.ncbi.nlm.nih.gov
Acknowledgments
Redacted to maintain submission anonimity.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Switzerland AG
About this paper
Cite this paper
Trujano, F., Khan, M., Maes, P. (2018). ARPiano Efficient Music Learning Using Augmented Reality. In: Wu, TT., Huang, YM., Shadiev, R., Lin, L., Starčič, A. (eds) Innovative Technologies and Learning. ICITL 2018. Lecture Notes in Computer Science(), vol 11003. Springer, Cham. https://doi.org/10.1007/978-3-319-99737-7_1
Download citation
DOI: https://doi.org/10.1007/978-3-319-99737-7_1
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-99736-0
Online ISBN: 978-3-319-99737-7
eBook Packages: Computer ScienceComputer Science (R0)