skip to main content
article

Visualization of tonal content with self-organizing maps and self-similarity matrices

Published: 01 October 2005 Publication History

Abstract

This article presents a dynamic model of tonality perception based on a short-term memory model and a self-organizing map (SOM). The model can be used for dynamic visualization of perceived tonal content, making it possible to examine the clarity and locus of tonality at any given point of time. This article also presents a method for the visualization of tonal structure using self-similarity matrices. The methods are applied to compositions of J. S. Bach, S. Barber, and J. Pachelbel. Finally, a real-time application embracing the tonality perception model is presented.

Supplementary Material

JPG File (bach.jpg)
JPG File (barber.jpg)
JPG File (pachelbel.jpg)
MP4 File (bach.mp4)
Toiviainen music file #1
MP4 File (barber.mp4)
Toiviainen music file #2
MP4 File (pachelbel.mp4)
Toiviainen music file #3

References

[1]
Eerola, T. and Toiviainen, P. 2004. MIDI Toolbox: MATLAB tools for music research. University of Jyväskylä: Kopijyvä, Jyväskylä, Finland. http://www.jyu.fi/musica/miditoolbox/.
[2]
Foote, J., Cooper, M., and Nam, U. 2002. Audio retrieval by rhythmic similarity. In Proceedings of the International Conference on Music Information Retrieval, 3. M. Fingerhut, ed., IRCAM - Centre Pompidou, Paris, 265-266.
[3]
Klapuri, A. 2003. Multiple fundamental frequency estimation by harmonicity and spectral smoothness. IEEE Trans. Speech and Audio Processing 11, 6 (2003), 804-816.
[4]
Kohonen, T. 1997. Self-Organizing Maps. Springer-Verlag, Berlin.
[5]
Krumhansl, C. L. 1990. Cognitive Foundations of Musical Pitch. Oxford University Press, New York.
[6]
Krumhansl, C. L. and Shepard, R. N. 1979. Quantification of the hierarchy of tonal functions within a Diatonic context. J. Experimental Psychology: Human Perception and Performance 5 (1979), 579-594.
[7]
Toiviainen, P. and Krumhansl, C. L. 2003. Measuring and modeling real-time responses to music: the dynamics of tonality induction. Perception 32, 6 (2003), 741-766.

Cited By

View all
  • (2024)Cocreative Interaction: Somax2 and the REACH ProjectComputer Music Journal10.1162/comj_a_00662(1-19)Online publication date: 6-Feb-2024
  • (2024)Inhaltsbasiertes System zur Suche und Visualisierung von Musik in ethnomusikologischen MusikarchivenComputergestützte Archivierung von Tonträgern10.1007/978-3-031-49640-0_7(157-187)Online publication date: 30-Oct-2024
  • (2022)Topological reduction algorithm for relation systemsSoft Computing - A Fusion of Foundations, Methodologies and Applications10.1007/s00500-022-07431-y26:22(11961-11971)Online publication date: 1-Nov-2022
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Computers in Entertainment
Computers in Entertainment   Volume 3, Issue 4
Theoretical and Practical Computer Applications in Entertainment
October 2005
116 pages
EISSN:1544-3574
DOI:10.1145/1095534
Issue’s Table of Contents

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 October 2005
Published in CIE Volume 3, Issue 4

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. computational music cognition
  2. harmonic analysis
  3. music visualization
  4. tonal analysis
  5. tonality models

Qualifiers

  • Article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)8
  • Downloads (Last 6 weeks)2
Reflects downloads up to 13 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Cocreative Interaction: Somax2 and the REACH ProjectComputer Music Journal10.1162/comj_a_00662(1-19)Online publication date: 6-Feb-2024
  • (2024)Inhaltsbasiertes System zur Suche und Visualisierung von Musik in ethnomusikologischen MusikarchivenComputergestützte Archivierung von Tonträgern10.1007/978-3-031-49640-0_7(157-187)Online publication date: 30-Oct-2024
  • (2022)Topological reduction algorithm for relation systemsSoft Computing - A Fusion of Foundations, Methodologies and Applications10.1007/s00500-022-07431-y26:22(11961-11971)Online publication date: 1-Nov-2022
  • (2021)A Survey of Music Visualization TechniquesACM Computing Surveys10.1145/346183554:7(1-29)Online publication date: 18-Jul-2021
  • (2019)Content-Based Music Retrieval and Visualization System for Ethnomusicological Music ArchivesComputational Phonogram Archiving10.1007/978-3-030-02695-0_7(145-173)Online publication date: 26-Jan-2019
  • (2018)Applying Acoustical and Musicological Analysis to Detect Brain Responses to Realistic Music: A Case StudyApplied Sciences10.3390/app80507168:5(716)Online publication date: 4-May-2018
  • (2018)Content-Based Methods for Knowledge Discovery in MusicSpringer Handbook of Systematic Musicology10.1007/978-3-662-55004-5_39(823-840)Online publication date: 2018
  • (2011)Music and Operations ResearchWiley Encyclopedia of Operations Research and Management Science10.1002/9780470400531.eorms0557Online publication date: 14-Jan-2011
  • (2009)Modelling Perceptual Elements of Music in a Vibrotactile Display for Deaf UsersProceedings of the 2009 Second International Conferences on Advances in Computer-Human Interactions10.1109/ACHI.2009.64(249-254)Online publication date: 1-Feb-2009
  • (2006)Music retrievalFoundations and Trends in Information Retrieval10.1561/15000000021:1(1-96)Online publication date: 1-Jan-2006

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media