Arinobu Niijima
ABSTRACT
Electrical muscle stimulation (EMS)-based systems have been proposed to assist in the learning of motor skills for piano playing. However, learning effects and retention have not been thoroughly evaluated. To address this, we conducted two user studies to investigate the learning effects and retention of EMS for piano playing. Twenty-four novice participants practiced the technique of tremolo, a rapid change between two notes, with both hands under three conditions: without EMS, with EMS on one hand, and with EMS on both hands. The results showed that practicing with EMS on both hands significantly improved tempo accuracy compared to practicing without EMS. A follow-up study of 15 participants confirmed that the improved performance achieved with EMS on both hands was maintained after one week and was not significantly different from practicing without EMS.
- Rumen Donchev, Erik Pescara, and Michael Beigl. 2021. Investigating Retention in Passive Haptic Learning of Piano Songs. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 5, 2 (2021), 1–14. https://doi.org/10.1145/3463513Google Scholar
Digital Library
- Felipe Augusto dos Santos Mendes, José Eduardo Pompeu, Alexandra Modenesi Lobo, Keyte Guedes da Silva, Tatiana de Paula Oliveira, Andrea Peterson Zomignani, and Maria Elisa Pimentel Piemonte. 2012. Motor learning, retention and transfer after virtual-reality-based training in Parkinson’s disease–effect of motor and cognitive demands of games: a longitudinal, controlled clinical study. Physiotherapy 98, 3 (2012), 217–223. https://doi.org/10.1016/j.physio.2012.06.001Google ScholarCross Ref
- Ayaka Ebisu, Satoshi Hashizume, and Yoichi Ochiai. 2018. Building a feedback loop between electrical stimulation and percussion learning. In ACM SIGGRAPH 2018 Studio. 1–2. https://doi.org/10.1145/3214822.3214824Google ScholarDigital Library
- Ayaka Ebisu, Satoshi Hashizume, Kenta Suzuki, Akira Ishii, Mose Sakashita, and Yoichi Ochiai. 2017. Stimulated percussions: method to control human for learning music by using electrical muscle stimulation. In Proceedings of the 8th Augmented Human International Conference. 1–5. https://doi.org/10.1145/3041164.3041202Google ScholarDigital Library
- Shinichi Furuya, Tatsushi Goda, Haruhiro Katayose, Hiroyoshi Miwa, and Noriko Nagata. 2011. Distinct inter-joint coordination during fast alternate keystrokes in pianists with superior skill. Frontiers in human neuroscience 5 (2011), 50. https://doi.org/10.3389/fnhum.2011.00050Google Scholar
- Mahmoud Hassan, Florian Daiber, Frederik Wiehr, Felix Kosmalla, and Antonio Krüger. 2017. Footstriker: an EMS-based foot strike assistant for running. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 1 (2017), 1–18. https://doi.org/10.1145/3053332Google ScholarDigital Library
- Kevin Huang, Ellen Yi-Luen Do, and Thad Starner. 2008. PianoTouch: a wearable haptic piano instruction system for passive learning of piano skills. In 2008 12th IEEE international symposium on wearable computers. IEEE, 41–44. https://doi.org/10.1109/ISWC.2008.4911582Google ScholarDigital Library
- Gillian Murphy, John A Groeger, and Ciara M Greene. 2016. Twenty years of load theory—Where are we now, and where should we go next?Psychonomic bulletin & review 23, 5 (2016), 1316–1340. https://doi.org/10.3758/s13423-015-0982-5Google Scholar
- Alice Nieuwboer, Lynn Rochester, Liesbeth Müncks, and Stephan P Swinnen. 2009. Motor learning in Parkinson’s disease: limitations and potential for rehabilitation. Parkinsonism & related disorders 15 (2009), S53–S58. https://doi.org/10.1016/S1353-8020(09)70781-3Google Scholar
- Arinobu Niijima, Toki Takeda, Ryosuke Aoki, and Shinji Miyahara. 2022. Muscle Synergies Learning with Electrical Muscle Stimulation for Playing the Piano. In Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology. 1–10. https://doi.org/10.1145/3526113.3545666Google ScholarDigital Library
- Arinobu Niijima, Toki Takeda, Kentaro Tanaka, Ryosuke Aoki, and Yukio Koike. 2021. Reducing Muscle Activity when Playing Tremolo by Using Electrical Muscle Stimulation to Learn Efficient Motor Skills. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 5, 3 (2021), 1–17. https://doi.org/10.1145/3478110Google ScholarDigital Library
- Jun Nishida, Yudai Tanaka, Romain Nith, and Pedro Lopes. 2022. DigituSync: A Dual-User Passive Exoskeleton Glove That Adaptively Shares Hand Gestures. In Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology. 1–12. https://doi.org/10.1145/3526113.3545630Google ScholarDigital Library
- Romain Nith, Shan-Yuan Teng, Pengyu Li, Yujie Tao, and Pedro Lopes. 2021. DextrEMS: Increasing Dexterity in Electrical Muscle Stimulation by Combining it with Brakes. In The 34th Annual ACM Symposium on User Interface Software and Technology. 414–430. https://doi.org/10.1145/3472749.3474759Google ScholarDigital Library
- Richard A Schmidt, Timothy D Lee, Carolee Winstein, Gabriele Wulf, and Howard N Zelaznik. 2018. Motor control and learning: A behavioral emphasis. Human kinetics.Google Scholar
- Caitlyn Seim, Nick Doering, Yang Zhang, Wolfgang Stuerzlinger, and Thad Starner. 2017. Passive haptic training to improve speed and performance on a keypad. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 3 (2017), 1–13. https://doi.org/10.1145/3132026Google ScholarDigital Library
- Caitlyn Seim, Tanya Estes, and Thad Starner. 2015. Towards passive haptic learning of piano songs. In 2015 IEEE World Haptics Conference (WHC). IEEE, 445–450. https://doi.org/10.1109/WHC.2015.7177752Google ScholarCross Ref
- Akifumi Takahashi, Jas Brooks, Hiroyuki Kajimoto, and Pedro Lopes. 2021. Increasing electrical muscle stimulation’s dexterity by means of back of the hand actuation. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–12. https://doi.org/10.1145/3411764.3445761Google ScholarDigital Library
- Nobuhiro Takahashi, Shinichi Furuya, and Hideki Koike. 2020. Soft exoskeleton glove with human anatomical architecture: production of dexterous finger movements and skillful piano performance. IEEE Transactions on Haptics (2020). https://doi.org/10.1109/TOH.2020.2993445Google ScholarDigital Library
- Emi Tamaki, Takashi Miyaki, and Jun Rekimoto. 2011. PossessedHand: techniques for controlling human hands using electrical muscles stimuli. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 543–552. https://doi.org/10.1145/1978942.1979018Google ScholarDigital Library
- Sho Tatsuno, Tomohiko Hayakawa, and Masatoshi Ishikawa. 2017. Supportive training system for sports skill acquisition based on electrical stimulation. In 2017 IEEE World Haptics Conference (WHC). IEEE, 466–471. https://doi.org/10.1109/WHC.2017.7989946Google ScholarCross Ref
- Gabriele Wulf, Suzete Chiviacowsky, and Priscila Lopes Cardozo. 2014. Additive benefits of autonomy support and enhanced expectancies for motor learning. Human movement science 37 (2014), 12–20. https://doi.org/10.1016/j.humov.2014.06.004Google Scholar
Index Terms
- Learning Effects and Retention of Electrical Muscle Stimulation in Piano Playing
Recommendations
Muscle Synergies Learning with Electrical Muscle Stimulation for Playing the Piano
UIST '22: Proceedings of the 35th Annual ACM Symposium on User Interface Software and TechnologyWhen playing scales on the piano, playing all notes evenly is a basic technique to improve the quality of music. However, it is difficult for beginners to do this because they need to achieve appropriate muscle synergies of the forearm and shoulder ...
Reducing Muscle Activity when Playing Tremolo by Using Electrical Muscle Stimulation to Learn Efficient Motor Skills
When beginners play the piano, the activity of the forearm muscles tends to be greater than that of experts because beginners move their fingers with more force than necessary. Reducing forearm muscle activity is important for pianists to prevent fatigue ...
Motor-Skill-Transfer Technology for Piano Playing with Electrical Muscle Stimulation
SA '23: SIGGRAPH Asia 2023 Emerging TechnologiesWe introduce a motor-skill-transfer technology using electrical muscle stimulation (EMS) for acquiring piano playing skills. While expert pianists use the coordination of multiple muscles, such as fingers and arms, novices are less aware of muscle ...
Comments