Abstract
An augmented reality (AR) system is developed that helps beginners practice the electronic drums. The player sitting on the drums is captured by a USB camera mounted on top of a large display device placed in front of the drums and the player. Their mirror image is shown on the display device in real time with superimposed graphical instructions that indicate when and which drum to bang along a musical note. Each bang on the drum set is sent from the drum controller as a MIDI signal to the PC where it is compared with the musical note. Throughout the practice, the player only has to look straight at the display screen because everything including the drum sticks, arms, legs of his/her own, and the instructions is integrated on the screen.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
DrumMania. https://en.wikipedia.org/wiki/GuitarFreaks_and_DrumMania Cited 21 Jun 2021
Motokawa, Y., Saito, H.: Support system for guitar playing using augmented reality display. In: Fifth IEEE/ACM International Symposium on Mixed and Augmented Reality, ISMAR 2006, 22–25 October 2006, Santa Barbara (2006). https://doi.org/10.1109/ISMAR.2006.297825
Paradiddle. https://paradiddleapp.com/ Cited 21 Jun 2021
MIDI Association. https://www.midi.org/ Cited 21 Jun 2021
Unity. https://unity.com/ Cited 21 Jun 2021
Vuforia engine developer portal. https://developer.vuforia.com/ Accessed 29 May 2021
Qiita Zine: How to display the camera image vertically and horizontally flipped. https://qiita.com/ELIXIR/items/d6cd335a697148f61c38 Cited 21 Jun 2021
Takahashi, K.: Unity-midi-receiver-test. https://github.com/keijiro/unity-midi-receiver-test Cited 21 Jun 2021
Acknowledgement
The authors thank Daisuke Tanaka for his valuable and helpful discussions in the early stage of this study.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Kikuchi, K., Niibori, M., Kamada, M. (2022). An AR System to Practice Drums. In: Barolli, L., Chen, HC., Enokido, T. (eds) Advances in Networked-Based Information Systems. NBiS 2021. Lecture Notes in Networks and Systems, vol 313. Springer, Cham. https://doi.org/10.1007/978-3-030-84913-9_37
Download citation
DOI: https://doi.org/10.1007/978-3-030-84913-9_37
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-84912-2
Online ISBN: 978-3-030-84913-9
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)