A Piano Performance Training System Based on Visual and Tactile Guidance

Abstract

Learning and improving piano play performance supported by an ICT-based training system is a difficult and time consuming task. It is especially difficult for beginners because existing technologies force users the continuation of excessive burdens on their vision and concentration. We propose a piano performance training system where the users can easily focus on the acquisition of piano performance skills with lighter cognitive loads. The proposed system provides a training environment based on visual and tactile guidance. It enables the users to keep their eyes on a screen for checking the performance instructions presented on it and concentrate on typing keys with correct fingers according to the instructions. It also uses the tactile stimuli for intuitively prompting the users to hit the keys with correct fingers on a real keyboard. The system recognizes the users’ fingering, judging whether they hit the right keys with correct fingers, and feedback the results via tactile sensation. It enables even beginners to easily practice piano performance with correct fingering by self-study.