Abstract
In this paper, we propose a learning support system considering gamification and reconsolidation for piano beginners. The proposed system is a game-based that supports the improvement of motor skills such as piano keying. Practice of motor skills using reconsolidation is more efficient than practice that focuses on specific parts or repetition. On the other hand, what is important in reconsolidation is that the subjects themselves are unaware that they are performing reconsolidation. In this research, gamification is incorporated into a piano learning support system that enables users to practice while using reconsolidation unconsciously. In this way, learners can practice piano motor skills like a game without recognizing the reconsolidation, and can acquire motor skills more efficiently than in previous practice methods that focus on specific parts or repetition. As a result of the comparative experiment, the learning support system in the proposed method was significantly useful for acquiring the set piece of music through the improvement of motor skills.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
CASIO, Glowing navigation keyboard. https://casio.jp/emi/products/lk511/
Takegawa, Y., Terada, T., Tsukamoto, M.: A piano learning support system considering rhythm. In: Proceedings of International Computer Music Conference, pp. 326–332 (2012)
Takegawa, Y., Tsukamoto, M., Terada, T.: Design and implementation of a piano practice support system using a real-time fingering recognition technique. In: Proceedings of International Computer Music Conference, pp. 1–8 (2011)
Takegawa, Y., Fukuya, Y., Yanagi, H.: Design and implementation of a piano learning support system considering maintenance of motivation. In: Proceedings of EdMedia 2016 World Conference on Educational Media and Technology, pp. 449–463 (2016)
Takegawa, Y., Terada, T., Tsukamoto, M.: Design and implementation of piano performance learning system considering withdrawal from system support. Comput. Softw. (J. Jpn. Soc. Softw. Sci. Technol.) 30(4), 51–60 (2013). (in Japanese)
Weing, M., Rhlig, A., Rogers, K., Weber, M.: PIANO: enhancing instrument learning via interactive projected augmentation. In: Proceedings of ACM Conference on Pervasive and Ubiquitous Computing Adjunct Publication, UbiComp 2013, pp. 75–78 (2013)
Raymaekers, L., Vermeulen, J., Luyten, K., Coninx, K.: Game of tones: learning to play songs on a piano using projected instructions and games. In: Proceedings of Special Interest Group on Computer-Human Interaction 2014, pp. 411–414 (2014)
Karola, M., Andreas, W., Thomas, K.: Supporting musical practice sessions through HMD-based augmented reality. In: Proceedings of the Mensch and Computer 2019 - Workshopband (2019)
Klepsch, M., Könings, B., Weber, M., Seufert, T.: Fostering piano learning by dynamic mapping of notes. In: Proceedings of EARLI SIG Text and Comprehension (2013)
Molero, D., Schez-Sobrino, S., Vallejo, D., Glez-Morcillo, C., Albusac, J.: A novel approach to learning music and piano based on mixed reality and gamification. J. Multimedia Tools Appl. 80, 165–186 (2020)
Gerry, L., Dahl, S., Serafin, S.: ADEPT: exploring the design, pedagogy, and analysis of a mixed reality application for piano training. In: Proceedings of the 16th Sound and Music Computing Conference SMC 2019, pp. 241–239 (2019)
Nonami, J., Takegawa, Y.: Construction of a support system for learning character balance in transcription for beginners. In: Proceedings of IEEE Global Conference on Consumer Electronics, pp. 26–30 (2014)
Yokoyama, Y., Nishimoto, K.: A piano practice support system for preventing performance cessation caused by performance errors. J. Inf. Process. Soc. Jpn. 2010(4), 205–208 (2010). (in Japanese)
Kumaki, M., Takegawa, Y., Hirata, K.: Design and implementation of a positioning learning support system for violin beginners, using true, vague and false information. J. Inf. Process. Soc. Jpn. 2018(26), 285–293 (2018)
Nader, K., Schafe, G.E., Le Doux, J.E.: Fear memories require protein synthesis in the amygdala for reconsolidation after retrieval. Nature 406, 722–726 (2000)
Nader, K., Hardt, O.: A single standard for memory: the case for reconsolidation. J. Nat. Rev. Neurosci. 10, 224–234 (2009)
Tronson, N.C., Taylor, J.R.: Molecular mechanisms of memory reconsolidation. J. Nat. Rev. Neurosci. 8, 262–275 (2007)
Wymbs, N.F., Bastian, A.J., Celnik, P.A.: Motor skills are strengthened through reconsolidation. J. Curr. Biol. 26, 338–343 (2009)
Walker, M.P., Brakefield, T., Hobson, J.A., Stickgold, R.: Dissociable stages of human memory consolidation and reconsolidation. Nature 425, 616–620 (2003)
Censor, N., Dimyan, M.A., Cohen, L.G.: Modification of existing human motor memories is enabled by primary cortical processing during memory reactivation. J. Curr. Biol. 20, 1545–1549 (2010)
Oshima, C., Miyagawa, Y., Nishimoto, K.: Coloring in piano: a piano that allows a performer to concentrate on musical expression. In: Proceedings of the 7th International Conference on Music Perception and Cognition, pp. 707–710 (2002)
Takeuchi, Y., Katayose, H.: Representation of music expression with two finger piano. J. Inf. Process. Soc. Jpn. 1995, 37–44 (1995)
Acknowledgments
This work was supported by JST CREST Grant Number JPMJCR18A3, Japan.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Matsui, R., Kumaki, M., Takegawa, Y., Hirata, K., Yanagisawa, Y. (2022). Proposal of a Piano Learning Support System Considering Gamification Based on Reconsolidation. In: Zaphiris, P., Ioannou, A. (eds) Learning and Collaboration Technologies. Designing the Learner and Teacher Experience. HCII 2022. Lecture Notes in Computer Science, vol 13328. Springer, Cham. https://doi.org/10.1007/978-3-031-05657-4_9
Download citation
DOI: https://doi.org/10.1007/978-3-031-05657-4_9
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-05656-7
Online ISBN: 978-3-031-05657-4
eBook Packages: Computer ScienceComputer Science (R0)