Abstract
Modern digital music libraries contain textual, visual, and audio data describing music on various semantic levels. Exploiting the availability of different semantically interrelated representations for a piece of music, this paper presents a query-by-lyrics retrieval system that facilitates multimodal navigation in CD audio collections. In particular, we introduce an automated method to time align given lyrics to an audio recording of the underlying song using a combination of synchronization algorithms. Furthermore, we describe a lyrics search engine and show how the lyrics-audio alignments can be used to directly navigate from the list of query results to the corresponding matching positions within the audio recordings. Finally, we present a user interface for lyrics-based queries and playback of the query results that extends the functionality of our SyncPlayer framework for content-based music and audio navigation.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Kurth, F., Müller, M., Damm, D., Fremerey, C., Ribbrock, A., Clausen, M.: SyncPlayer — An Advanced System for Multimodal Music Access. In: ISMIR, London, GB (2005)
Arifi, V., Clausen, M., Kurth, F., Müller, M.: Automatic Synchronization of Musical Data: A Mathematical Approach. Computing in Musicology 13 (2004)
Dannenberg, R., Raphael, C.: Music score alignment and computer accompaniment. Special Issue, Commun. ACM 49(8), 39–43 (2006)
Hu, N., Dannenberg, R., Tzanetakis, G.: Polyphonic audio matching and alignment for music retrieval. In: Proc. IEEE WASPAA, New Paltz, NY (October 2003)
Müller, M., Kurth, F., Röder, T.: Towards an efficient algorithm for automatic score-to-audio synchronization. In: Proc. ISMIR, Barcelona, Spain (2004)
Müller, M., Mattes, H., Kurth, F.: An efficient multiscale approach to audio synchronization. In: Proc. ISMIR, Victoria, Canada, pp. 192–197 (2006)
Soulez, F., Rodet, X., Schwarz, D.: Improving polyphonic and poly-instrumental music to score alignment. In: Proc. ISMIR, Baltimore, USA (2003)
Turetsky, R.J., Ellis, D.P.: Force-Aligning MIDI Syntheses for Polyphonic Music Transcription Generation. In: Proc. ISMIR, Baltimore, USA (2003)
Wang, Y., Kan, M.Y., Nwe, T.L., Shenoy, A., Yin, J.: Lyrically: automatic synchronization of acoustic musical signals and textual lyrics. In: MULTIMEDIA 2004. Proceedings of the 12th annual ACM international conference on Multimedia, pp. 212–219. ACM Press, New York (2004)
Bartsch, M.A., Wakefield, G.H.: Audio thumbnailing of popular music using chroma-based representations. IEEE Trans. on Multimedia 7(1), 96–104 (2005)
Müller, M., Kurth, F.: Towards structural analysis of audio recordings in the presence of musical variations. EURASIP Journal on Advances in Signal Processing, Article ID 89686 2007, 18 (2007), doi: 10.1155/2007/89686
Witten, I.H., Moffat, A., Bell, T.C.: Managing Gigabytes, 2nd edn. Van Nostrand Reinhold (1999)
Clausen, M., Kurth, F.: A Unified Approach to Content-Based and Fault Tolerant Music Recognition. IEEE Transactions on Multimedia 6(5) (2004)
Fremerey, C.: SyncPlayer – a Framework for Content-Based Music Navigation. Diploma Thesis, Dept. of Computer Science, University of Bonn (2006)
Multimedia Signal Processing Group Prof. Dr. Michael Clausen: SyncPlayer Homepage. Website (January 2007), http://www-mmdb.iai.uni-bonn.de/projects/syncplayer/index.php
Müller, M., Kurth, F., Clausen, M.: Audio matching via chroma-based statistical features. In: Proc. ISMIR, London, GB (2005)
Steenweg, T., Steffens, U.: Probado – non-textual digital libraries put into practice. In: ERCIM News Special Theme: European Digital Library, pp. 47–48 (July 2006)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Müller, M., Kurth, F., Damm, D., Fremerey, C., Clausen, M. (2007). Lyrics-Based Audio Retrieval and Multimodal Navigation in Music Collections. In: Kovács, L., Fuhr, N., Meghini, C. (eds) Research and Advanced Technology for Digital Libraries. ECDL 2007. Lecture Notes in Computer Science, vol 4675. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-74851-9_10
Download citation
DOI: https://doi.org/10.1007/978-3-540-74851-9_10
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-74850-2
Online ISBN: 978-3-540-74851-9
eBook Packages: Computer ScienceComputer Science (R0)