Abstract
When playing the marimba, percussionists must always be aware of mallet placement. Striking on top of the rope produces a very dead sound with little resonance, so it should always be avoided. Beginner players often make this mistake, but can learn to avoid it if it is pointed out to them. In this paper we present a system that uses a video recording of a percussionist playing the marimba, and highlights the frames in which they struck above the rope. Since the visual information alone is not enough to accomplish this, the system uses a combination of audio and video processing to detect which of the possible four mallets struck the marimba, and then estimate its position, classifying it as correct or incorrect.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Vogl, R., Dorfer, M., Knees, P.: Drum transcription from polyphonic music with recurrent neural networks. In: 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), New Orleans, LA, pp. 201–205 (2017)
Tian, M., Srinivasamurthy A., Sandler, M., Serra, X.: A study of instrument-wise onset detection in Beijing Opera percussion ensembles. In: 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Florence, pp. 2159–2163 (2014)
Manoj Kumar, P.A., Sebastian, J., Murthy, H.A.: Musical onset detection on carnatic percussion instruments. In: 2015 Twenty First National Conference on Communications (NCC), Mumbai, pp. 1–6 (2015)
Kastner, K.: The emergence and evolution of a generalized marimba technique. DMA thesis, University of Illinois at Urbana-Champaign (1989)
Johnston, I.: Measured Tones: The Interplay of Physics and Music, 3rd edn. CRC Press, Boca Raton (2009)
Physics of Music Notes. Frequencies of Musical Notes, A4 = 440 Hz. pages.mtu.edu/ suits/notefreqs.html. Accessed 14 June 2023
Oberton. The Harmonic Series. https://www.oberton.org/en/overtone-singing/harmonic-series/. Accessed 14 June 2023
User Guide - MoviePy 1.0.2 Documentation. zulko.github.io/moviepy/. Accessed 14 June 2023
librosa - librosa 0.10.0 documentation. https://librosa.org/doc/latest/index.html. Accessed 14 June 2023
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Beer, D., Salgian, A. (2023). Marimba Mallet Placement Tracker. In: Bebis, G., et al. Advances in Visual Computing. ISVC 2023. Lecture Notes in Computer Science, vol 14362. Springer, Cham. https://doi.org/10.1007/978-3-031-47966-3_24
Download citation
DOI: https://doi.org/10.1007/978-3-031-47966-3_24
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-47965-6
Online ISBN: 978-3-031-47966-3
eBook Packages: Computer ScienceComputer Science (R0)