skip to main content
10.1145/2390848.2390855acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
research-article

Learning and extraction of violin instrumental controls from audio signal

Published: 02 November 2012 Publication History

Abstract

Acquisition of instrumental gestures in musical performances is an important task used in different fields ranging from acoustics and sound synthesis to motor learning or electroacoustic performances. The most common approach for acquiring gestures is by means of a sensing system. The direct measurement involves the use of usually expensive sensors with some degree of intrusivity and generally entails complex setups. Indirect acquisition is based on the processing of the audio signal and it is usually informed on acoustical or physical properties of the sound or sound production mechanism. In this paper we present an indirect acquisition method of violin controls from an audio signal based on learning of empirical data that is previously collected with a highly accurate sensing system. The learning consists of training of statistical models with a database of multimodal data from violin performances. The database includes audio spectral features and instrumental controls (bow tilt, bow force, bow velocity, bowing distance to the bridge and played string) and is designed to sample most part of the violin performance control space. We expect that once the indirect acquisition system is trained, no sensors should be required, so the indirect acquisition becomes a low-cost and non-intrusive acquisition method.

References

[1]
J. Abeßer. Automatic string detection for bass guitar and electric guitar. In Proc. 9th International Symposium on Computer Music Modelling and Retrieval, London, June 2012.
[2]
J. Abeßer, H. Lukashevich, and G. Schuller. Feature-based extraction of plucking and expression styles of the electric bass guitar. In Proc. ICASSP, 2010.
[3]
I. Barbancho, C. de la Bandera, A. Barbancho, and L. Tardon. Transcription and expressiveness detection system for violin music. In IEEE International Conference on Acoustics, Speech and Signal Processing, pages 189--192, april 2009.
[4]
L. Cremer. Physics of the Violin. The MIT Press, November 1984.
[5]
E. Guaus, J. Bonada, E. Maestre, A. Perez, and M. Blaauw. Calibration method to measure accurate bow force for real violin performances. In Int. Computer Music Conf., pages 251--254, Montreal, Canada, 16/08/2009 2009.
[6]
E. Guaus, J. Bonada, A. Perez, E. Maestre, and M. Blaauw. Measuring the bow pressing force in a real violin performance. In Int. Symposium on Musical Acoust., Barcelona, Spain, 2007.
[7]
M. Hall, E. Frank, G. Holmes, B. Pfahringer, P. Reutemann, and I. H. Witten. The weka data mining software: an update. SIGKDD Explor. Newsl., 11(1):10--18, Nov. 2009.
[8]
C. Kereliuk, B. Scherrer, V. Verfaille, P. Depalle, and M. M. Wanderley. Indirect acquisition of fingerings of harmonics notes on the flute. In 33rd Int. Computer Music Conf., volume 1, pages 263--6, Copenhagen, Denmark, August 2007.
[9]
A. Krishnaswamy and J. O. Smith. Inferring control inputs to an acoustic violin from audio spectra. In Proceedings of the 2003 International Conference on Multimedia and Expo - Volume 2, ICME '03, pages 733--736, Washington, DC, USA, 2003. IEEE Computer Society.
[10]
A. Loscos. Low level descriptors for automatic violin transcription. In In ISMIR, pages 164--167, 2006.
[11]
E. Maestre, M. Blaauw, J. Bonada, E. Guaus, and A. Pérez. Statistical modeling of bowing control applied to sound synthesis. IEEE Transactions on Audio, Speech and Language Processing. Special Issue on Virtual Analog Audio Effects and Musical Instruments, 2010.
[12]
E. Maestre, J. Bonada, M. Blaauw, A. Pérez, and E. Guaus. Acquisition of violin instrumental gestures using a commercial EMF device. In Proc. Int. Computer Music Conf., Copenhagen, Denmark, 2007.
[13]
G. Peeters. A large set of audio features for sound description (similarity and classification) in the cuidado project. Technical report, IRCAM, Paris, France, 2004.
[14]
A. Perez Carrillo, J. Bonada, E. Maestre, E. Guaus, and M. Blaauw. Performance control driven violin timbre model based on neural networks. Audio, Speech, and Language Processing, IEEE Transactions on, 20(3):1007--1021, march 2012.
[15]
J. Schelleng. The bowed string and the player. The Journal of the Acoustical Society of America, 53(1):26--41, 1973.
[16]
B. Scherrer and P. Depalle. Extracting the angle of release from guitar tones: preliminary results. In 2012, Nantes, France, 2012.
[17]
T. Smyth and J. S. Abel. Toward an estimation of the clarinet reed pulse from instrument performance. The Journal of the Acoustical Society of America, 131(6):4799--4810, 2012.
[18]
C. Traube, P. Depalle, and M. Wanderley. Indirect acquisition of instrumental gesture based on signal, physical and perceptual information. In Proceedings of the 2003 conference on New interfaces for musical expression, NIME '03, pages 42--47, Singapore, Singapore, 2003. National University of Singapore.
[19]
G. Tzanetakis, A. Kapur, and A. Tindale. Learning indirect acquisition of instrumental gestures using direct sensors. In 8th IEEE Workshop on Multimedia Signal Processing, pages 37--40, oct. 2006.
[20]
V. Verfaille, P. Depalle, and M. M. Wanderley. Detecting overblown flute fingerings from the residual noise spectrum. The Journal of the Acoustical Society of America, 127(1):534--541, 2010.
[21]
L. Vinceslas, F. García, A. Pérez, and E. Maestre. Mapping blowing pressure and sound features in recorder playing. In Proceedings of the International Conference on Digital Audio Effects, 2011.
[22]
M. M. Wanderley and P. Depalle. Gestural control of sound synthesis. In Proceedings IEEE, pages 632--644, 2004.
[23]
B. Zhang and Y. Wang. Automatic music transcription using audio-visual fusion for violin practice in home environment. Technical Report TRA7/09, Shool of Computing, National University of Singapore, 2009.

Cited By

View all
  • (2022)Toward a meaningful technology for instrumental music education: Teachers’ voiceFrontiers in Education10.3389/feduc.2022.10270427Online publication date: 28-Oct-2022
  • (2021)Real-Time Sound and Motion Feedback for Violin Bow Technique Learning: A Controlled, Randomized TrialFrontiers in Psychology10.3389/fpsyg.2021.64847912Online publication date: 26-Apr-2021
  • (2018)Violin Timbre Navigator: Real-Time Visual Feedback of Violin Bowing Based on Audio Analysis and Machine LearningMultiMedia Modeling10.1007/978-3-030-05716-9_15(182-193)Online publication date: 11-Dec-2018
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
MIRUM '12: Proceedings of the second international ACM workshop on Music information retrieval with user-centered and multimodal strategies
November 2012
82 pages
ISBN:9781450315913
DOI:10.1145/2390848
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 November 2012

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. indirect acquisition
  2. information retrieval
  3. musical gesture
  4. violin instrumental controls

Qualifiers

  • Research-article

Conference

MM '12
Sponsor:
MM '12: ACM Multimedia Conference
November 2, 2012
Nara, Japan

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)3
  • Downloads (Last 6 weeks)0
Reflects downloads up to 16 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2022)Toward a meaningful technology for instrumental music education: Teachers’ voiceFrontiers in Education10.3389/feduc.2022.10270427Online publication date: 28-Oct-2022
  • (2021)Real-Time Sound and Motion Feedback for Violin Bow Technique Learning: A Controlled, Randomized TrialFrontiers in Psychology10.3389/fpsyg.2021.64847912Online publication date: 26-Apr-2021
  • (2018)Violin Timbre Navigator: Real-Time Visual Feedback of Violin Bowing Based on Audio Analysis and Machine LearningMultiMedia Modeling10.1007/978-3-030-05716-9_15(182-193)Online publication date: 11-Dec-2018
  • (2017)A Survey of Research into Mixed Criticality SystemsACM Computing Surveys10.1145/313134750:6(1-37)Online publication date: 22-Nov-2017
  • (2015)ml.lib: Robust, Cross-platform, Open-source Machine Learning for Max and Pure DataProceedings of the international conference on New Interfaces for Musical Expression10.5555/2993778.2993845(265-270)Online publication date: 30-May-2015
  • (2013)Physical modelling and supervised training of a virtual string quartetProceedings of the 21st ACM international conference on Multimedia10.1145/2502081.2502101(103-112)Online publication date: 21-Oct-2013
  • (2012)2nd international ACM workshop on music information retrieval with user-centered and multimodal strategies (MIRUM)Proceedings of the 20th ACM international conference on Multimedia10.1145/2393347.2396541(1509-1510)Online publication date: 29-Oct-2012

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media