skip to main content
10.1145/1452392.1452436acmconferencesArticle/Chapter ViewAbstractPublication Pagesicmi-mlmiConference Proceedingsconference-collections
research-article

Multimodal presentation and browsing of music

Published: 20 October 2008 Publication History

Abstract

Recent digitization efforts have led to large music collections, which contain music documents of various modes comprising textual, visual and acoustic data. In this paper, we present a multimodal music player for presenting and browsing digitized music collections consisting of heterogeneous document types. In particular, we concentrate on music documents of two widely used types for representing a musical work, namely visual music representation (scanned images of sheet music) and associated interpretations (audio recordings). We introduce novel user interfaces for multimodal (audio-visual) music presentation as well as intuitive navigation and browsing. Our system offers high quality audio playback with time-synchronous display of the digitized sheet music associated to a musical work. Furthermore, our system enables a user to seamlessly crossfade between various interpretations belonging to the currently selected musical work.

References

[1]
V. Arifi, M. Clausen, F. Kurth, and M. Müller. Synchronization of music data in score-, MIDI- and PCM-format. Computing in Musicology, 13, 2004.
[2]
M. A. Bartsch and G. H. Wakefield. Audio thumbnailing of popular music using chroma-based representations. IEEE Trans. on Multimedia, 7(1):96--104, 2005.
[3]
D. Byrd and M. Schindele. Prospects for improving OMR with multiple recognizers. In Proc. ISMIR, pages 41--46, 2006.
[4]
G. Choudhury, T. DiLauro, M. Droettboom, I. Fujinaga, B. Harrington, and K. MacMillan. Optical music recognition system within a large-scale digitization project.
[5]
R. Dannenberg and C. Raphael. Music score alignment and computer accompaniment. Special Issue, Commun. ACM, 49(8):39--43, 2006.
[6]
N. Hu, R. Dannenberg, and G. Tzanetakis. Polyphonic audio matching and alignment for music retrieval. In Proc. IEEE WASPAA, 2003.
[7]
M. Müller. Information Retrieval for Music and Motion. Springer, 2007.
[8]
M. Müller, H. Mattes, and F. Kurth. An efficient multiscale approach to audio synchronization. In Proc. ISMIR, pages 192--197, 2006.

Cited By

View all
  • (2024)Digital Competences in Classical Music Teaching: From a Critical View to the Systematization of Digital ResourceINSAM Journal of Contemporary Music, Art and Technology10.51191/issn.2637-1898.2024.7.13.40(40-68)Online publication date: Dec-2024
  • (2023)Application of Computational Methods for Comparative Music Analysis2023 4th International Symposium on the Internet of Sounds10.1109/IEEECONF59510.2023.10335098(1-6)Online publication date: 26-Oct-2023
  • (2020)Using Cell Phone Pictures of Sheet Music To Retrieve MIDI PassagesIEEE Transactions on Multimedia10.1109/TMM.2020.297383122:12(3115-3127)Online publication date: Dec-2020
  • Show More Cited By

Index Terms

  1. Multimodal presentation and browsing of music

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    ICMI '08: Proceedings of the 10th international conference on Multimodal interfaces
    October 2008
    322 pages
    ISBN:9781605581989
    DOI:10.1145/1452392
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 20 October 2008

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. music alignment
    2. music browsing
    3. music information retrieval
    4. music navigation
    5. music synchronization

    Qualifiers

    • Research-article

    Conference

    ICMI '08
    Sponsor:
    ICMI '08: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERFACES
    October 20 - 22, 2008
    Crete, Chania, Greece

    Acceptance Rates

    Overall Acceptance Rate 453 of 1,080 submissions, 42%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)14
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 15 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Digital Competences in Classical Music Teaching: From a Critical View to the Systematization of Digital ResourceINSAM Journal of Contemporary Music, Art and Technology10.51191/issn.2637-1898.2024.7.13.40(40-68)Online publication date: Dec-2024
    • (2023)Application of Computational Methods for Comparative Music Analysis2023 4th International Symposium on the Internet of Sounds10.1109/IEEECONF59510.2023.10335098(1-6)Online publication date: 26-Oct-2023
    • (2020)Using Cell Phone Pictures of Sheet Music To Retrieve MIDI PassagesIEEE Transactions on Multimedia10.1109/TMM.2020.297383122:12(3115-3127)Online publication date: Dec-2020
    • (2020)Towards Linking the Lakh and IMSLP DatasetsICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)10.1109/ICASSP40776.2020.9053815(546-550)Online publication date: May-2020
    • (2018)Content-Based Methods for Knowledge Discovery in MusicSpringer Handbook of Systematic Musicology10.1007/978-3-662-55004-5_39(823-840)Online publication date: 2018
    • (2015)Curating Ethnomusicology in Cyberworlds for Ethnomusicological ResearchEthnologies10.7202/1039658ar37:1(119)Online publication date: 2015
    • (2014)Estimating Onset and Offset Asynchronies in Polyphonic Score-Audio AlignmentJournal of New Music Research10.1080/09298215.2014.89063043:3(266-275)Online publication date: 10-Sep-2014
    • (2013)Learning Optimal Features for Polyphonic Audio-to-Score AlignmentIEEE Transactions on Audio, Speech, and Language Processing10.1109/TASL.2013.226679421:10(2118-2128)Online publication date: 1-Oct-2013
    • (2012)Optical music recognition: state-of-the-art and open issuesInternational Journal of Multimedia Information Retrieval10.1007/s13735-012-0004-61:3(173-190)Online publication date: 2-Mar-2012
    • (2011)A Conditional Random Field Framework for Robust and Scalable Audio-to-Score MatchingIEEE Transactions on Audio, Speech, and Language Processing10.1109/TASL.2011.213409219:8(2385-2397)Online publication date: 1-Nov-2011
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media