skip to main content
10.1145/3206025.3206090acmconferencesArticle/Chapter ViewAbstractPublication PagesicmrConference Proceedingsconference-collections
research-article

A Simple Score Following System for Music Ensembles Using Chroma and Dynamic Time Warping

Published: 05 June 2018 Publication History

Abstract

It is disruptive for instrumentalists to turn the page of music sheet when they are playing instruments. The purpose of this study is to investigate how real-time music score alignment can serve as a tool for a computer-assisted page turner. We proposed a simple system which can be set up easily and quickly for use to solve the problem. The framework of the system has two parts: off-line preprocessing stage and online alignment stage. In the first stage, the system extracts chroma feature vectors from the reference recording. In the second stage, the system receives audio signals of live performance and extracts chroma feature vectors from them. Finally, the system uses Dynamic Time Warping (DTW) to find an alignment between those two sets of chroma feature vectors to mark the current measure of the score. The prototype system was evaluated by musicians in different music ensembles like string quartet and orchestra. Most musicians agreed that the system is helpful and can indicate the current measure of a live performance correctly. Some musicians, however, disagreed that the system turned the page at right time. The user survey showed that the best timing for page turning is user-dependent because it is highly to do with musicians' sight reading skills and speed.

References

[1]
Dannenberg, R. B. (1984, October). An on-line algorithm for real-time accompaniment. In ICMC (Vol. 84, pp. 193--198).
[2]
Raphael, C. (2002). A Bayesian network for real-time musical accompaniment. In Advances in Neural Information Processing Systems (pp. 1433--1439).
[3]
Prockup, M., Grunberg, D., Hrybyk, A., & Kim, Y. E. (2013). Orchestral performance companion: Using real-time audio to score alignment. IEEE MultiMedia, 20(2), 52--60.
[4]
Zhiyao, D., & Pardo, B(2011). A state space model for online polyphonic audio-score alignment. In International Conference on Acoustics, Speech and Signal Processing (ICASSP) (pp. 22--27).
[5]
Fujishima, T. (1999, October). Realtime Chord Recognition of Musical Sound: a System Using Common Lisp Music. In ICMC (pp. 464--467).
[6]
Dannenberg, R. B., & Raphael, C. (2006). Music score alignment and computer accompaniment. Communications of the ACM, 49(8), 38--43.
[7]
Carabias-Orti, J. J., Rodríguez-Serrano, F. J., Vera-Candeas, P., Ruiz-Reyes, N., & Cañadas-Quesada, F. J. (2015). An Audio to Score Alignment Framework Using Spectral Factorization and Dynamic Time Warping. In ISMIR (pp. 742--748).
[8]
Bellman, R., & Kalaba, R. (1959). On adaptive control processes. IRE Transactions on Automatic Control, 4(2), 1--9.
[9]
Myers, C., Rabiner, L., & Rosenberg, A. (1980). Performance tradeoffs in dynamic time warping algorithms for isolated word recognition. IEEE Transactions on Acoustics, Speech, and Signal Processing, 28(6), 623--635.

Cited By

View all
  • (2022)Hybrid Context-Content Based Music Recommendation SystemProceedings of the Future Technologies Conference (FTC) 2022, Volume 110.1007/978-3-031-18461-1_8(121-132)Online publication date: 13-Oct-2022
  • (2019)Deep Learning in Music Recommendation SystemsFrontiers in Applied Mathematics and Statistics10.3389/fams.2019.000445Online publication date: 29-Aug-2019

Index Terms

  1. A Simple Score Following System for Music Ensembles Using Chroma and Dynamic Time Warping

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    ICMR '18: Proceedings of the 2018 ACM on International Conference on Multimedia Retrieval
    June 2018
    550 pages
    ISBN:9781450350464
    DOI:10.1145/3206025
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 05 June 2018

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. chroma
    2. dynamic time warping
    3. score following

    Qualifiers

    • Research-article

    Conference

    ICMR '18
    Sponsor:

    Acceptance Rates

    ICMR '18 Paper Acceptance Rate 44 of 136 submissions, 32%;
    Overall Acceptance Rate 254 of 830 submissions, 31%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)6
    • Downloads (Last 6 weeks)2
    Reflects downloads up to 30 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2022)Hybrid Context-Content Based Music Recommendation SystemProceedings of the Future Technologies Conference (FTC) 2022, Volume 110.1007/978-3-031-18461-1_8(121-132)Online publication date: 13-Oct-2022
    • (2019)Deep Learning in Music Recommendation SystemsFrontiers in Applied Mathematics and Statistics10.3389/fams.2019.000445Online publication date: 29-Aug-2019

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media