A Guitar Training System for Beginners Using a Mixed Reality Device and a MIDI Guitar

Abstract

To represent how to play a guitar chord for beginners, our system displays the following two 3D objects in virtual space using a mixed reality device and a 3D game engine (Unity): (1) 3D guitar object displays a sphere at the position of the string to be pressed where each color of the spheres represents the finger to be used. (2) 3D hand object expresses an ideal finger shape when playing the chord. Moreover, to visualize the goodness of pressing the strings, we used a MIDI guitar controller which can acquire information on which string was pressed during performance. After a performance, using the acquired information, the system displays figures showing the correct way to press the strings and the state of the strings pressed during the performance. Moreover, our system can show how to correct mistakes using animation. A comparative experiment was performed between our system and a general system by 14 test users. As a result, it was shown that our system is superior in terms of clarity and users can learn guitar chords by themselves.