Abstract
The article presents an algorithm for classifying the style of expression of violin playing based on IMU sensor, located on the violinists forearm. In the initial phase of research, the original set of measured signals was extended by transferring them to new coordinate systems. Additional motion dynamics signals, including estimated linear velocity, have been obtained using transformations typical for inertial navigation systems (INS). In the next part of the work, universal features as well as indicators typical for IMU signals were extracted. The final experiment concerned the comparative effectiveness of data classification, using features selected by mutual information and random forest algorithms. The evaluation of the performance of the proposed algorithm has been carried out using a publicly available database. The obtained level of classification accuracy exceeded 90%.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Pelachaud, C.: Studies on gesture expressivity for a virtual agent. Speech Commun. 51 (7), 630–639 (2009). 107
Palmer, C.: Music performance. Ann. Rev. Psychol. 48(1), 115–138 (1997)
Sarasúa, Á., Caramiaux, B., Tanaka, A., Ortiz, M.: Datasets for the analysis of expressive musical gestures. In: Proceeding MOCO 2017 Proceedings of the 4th International Conference on Movement Computing, Article No. 131 (2017)
Datasets for the Analysis of Expressive Musical Gestures repositorum. https://gitlab.doc.gold.ac.uk. Accessed 21 Jan 2019
Rabin, M., Smith, P.:Guide to orchestral bowings through musical styles. Univeristy of Wisconsin-Madisnon, Really Good Music, LLC
Peters, D., Eckel, G., Dorschel, A.: Bodily Expression in Electronic Music: Perspectives on Reclaiming Performativity. Routledge, New York (2012)
Williams, D., et al.: Affective calibration of musical feature sets in an emotionally intelligent music composition system. ACM Trans. Appl. Percept. (TAP) 14(3), 17 (2017)
Zappi, V., Pistillo, A., Calinon, S., Brogni, A., Caldwell, D.: Music expression with a robot manipulator used as a bidirectional tangible interface. EURASIP J. Audio, Speech Music Process. 1, 2 (2012)
Li, H., et al.: Multisensor data fusion for human activities classification and fall detection. In: 2017 IEEE SENSORS (2017)
Zhang, M., Sawchuk, A.A.: Motion primitive-based human activity recognition using a bag-of-features approach. In: Proceedings of IHI 2012 of the 2nd ACM SIGHIT International Health Informatics Symposium, pp. 631–640 (2012)
Georgi, M., Amma, C., Schultz, T.: Recognizing hand and finger gestures with IMU based motion and EMG based muscle activity sensing. In: Proceedings of BIOSTEC 2015 Proceedings of the International Joint Conference on Biomedical Engineering Systems and Technologies, vol. 4, pp. 99–108 (2015)
Comotti, D., Caldara, M., Galizzi, M., Locatelli, P., Re, V.: Inertial based hand position tracking for future applications in rehabilitation environments. In: Proceedings of 6th IEEE International Workshop Advances in Sensors and Interfaces (IWASI), pp. 222–227 (2015)
Dunn, F., Parberry, I.: 3D Math Primer for Graphics and Game Development. Wordware Publishing (2002)
Kang, W., Han, Y.: SmartPDR: smartphone-based pedestrian deadreckoning for indoor localization. IEEE Sens. J. 15(5), 557 (2015)
Zhang, R., Höflinger, F., Reindl, L.: Inertial sensor based indoor localization and monitoring system for emergency responders. IEEE Sens. J. 13(2), 838–848 (2013)
Sawicki, A., Walendziuk, W., Idźkowski, A.: The gravitational acceleration components elimination from the accelerometer measurement data. In: Photonics Applications in Astronomy, Communications, Industry, and High-Energy Physics Experiments 2016, Proceedings of SPIE, vol. 10031 (2016)
Acknowledgment
This work was supported by S/WI/3/2018 and WI/WI/11/2019 grants from Białystok University of Technology and funded with resources for research by the Ministry of Science and Higher Education in Poland.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Sawicki, A., Zieliński, S.K. (2019). An Algorithm for Detecting the Expressive Musical Gestures of Violinists Based on IMU Signals. In: Saeed, K., Chaki, R., Janev, V. (eds) Computer Information Systems and Industrial Management. CISIM 2019. Lecture Notes in Computer Science(), vol 11703. Springer, Cham. https://doi.org/10.1007/978-3-030-28957-7_6
Download citation
DOI: https://doi.org/10.1007/978-3-030-28957-7_6
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-28956-0
Online ISBN: 978-3-030-28957-7
eBook Packages: Computer ScienceComputer Science (R0)