research-article

Large-scale music exploration in hierarchically organized landscapes using prototypicality information

Authors:

Christian Höglinger,

Peter KneesAuthors Info & Claims

ICMR '11: Proceedings of the 1st ACM International Conference on Multimedia Retrieval

Article No.: 8, Pages 1 - 7

https://doi.org/10.1145/1991996.1992004

Published: 18 April 2011 Publication History

Abstract

We present a novel user interface that offers a fun way to explore music collections in virtual landscapes in a game-like manner. Extending previous work, special attention is paid to scalability and user interaction. In this vein, the ever growing size of today's music collections is addressed in two ways that allow for visualizing and browsing nearly arbitrarily sized music repositories. First, the proposed user interface deepTune employs a hierarchical version of the Self-Organizing Map (SOM) to cluster similar pieces of music using multiple, hierarchically aligned layers. Second, to facilitate orientation in the landscape by presenting well-known anchor points to the user, a combination of Web-based and audio signal-based information extraction techniques to determine cluster prototypes (songs) is proposed. Selecting representative and well-known prototypes -- the former is ensured by using signal-based features, the latter by using Web-based data -- is crucial for browsing large music collections. We further report on results of an evaluation carried out to assess the quality of the proposed cluster prototype ranking.

References

[1]

N. Ahmed, T. Natarajan, and K. R. Rao. Discrete Cosine Transfom. IEEE Transactions on Computers, 23:90--93, January 1974.

Digital Library

[2]

S. Baumann and O. Hummel. Using Cultural Metadata for Artist Recommendation. In Proc. of WEDELMUSIC, Leeds, UK, 2003.

[3]

J. S. Breese, D. Heckerman, and C. Kadie. Empirical Analysis of Predictive Algorithms for Collaborative Filtering. In Proc. of UAI, San Francisco, USA, 1998. Morgan Kaufmann.

Digital Library

[4]

O. Celma. Music Recommendation and Discovery in the Long Tail. PhD thesis, Universitat Pompeu Fabra, Barcelona, Spain, 2008.

Digital Library

[5]

O. Celma, M. Ramírez, and P. Herrera. Foafing the Music: A Music Recommendation System Based on RSS Feeds and User Preferences. In Proc. of ISMIR, London, UK, 2005.

[6]

J. W. Cooley and J. W. Tukey. An algorithm for themachine calculation of complex Fourier series. Mathematics of Computation, 19(90):297--301, 1965.

[7]

M. Dittenbach, D. Merkl, and A. Rauber. The Growing Hierarchical Self-Organizing Map. In Proc. of IJCNN, Como, Italy, 2000.

Digital Library

[8]

M. Dopler, M. Schedl, T. Pohle, and P. Knees. Accessing Music Collections via Representative Cluster Prototypes in a Hierarchical Organization Scheme. In Proc. of ISMIR, Philadelphia, USA, 2008.

[9]

D. Eck, P. Lamere, T. Bertin-Mahieux, and S. Green. Automatic Generation of Social Tags for Music Recommendation. In Proc. of NIPS, 2008.

[10]

M. Goto and T. Goto. Musicream: New Music Playback Interface for Streaming, Sticking, Sorting, and Recalling Musical Pieces. In Proc. of ISMIR, London, UK, 2005.

[11]

I. T. Jolliffe. Principal Component Analysis. Springer, New York, USA, 1986.

[12]

P. Knees, E. Pampalk, and G. Widmer. Artist Classification with Web-based Data. In Proc. of ISMIR, Barcelona, Spain, 2004.

[13]

P. Knees, M. Schedl, T. Pohle, and G. Widmer. An Innovative Three-Dimensional User Interface for Exploring Music Collections Enriched with Meta-Information from the Web. In Proc. of ACM Multimedia, Santa Barbara, USA, 2006.

Digital Library

[14]

T. Kohonen. Self-Organizing Maps, volume 30 of Springer Series in Information Sciences. Springer, Berlin, Germany, 3rd edition, 2001.

Digital Library

[15]

http://last.fm (access: January 2010).

[16]

http://last.fm/api (access: January 2010).

[17]

D. Lübbers and M. Jarke. Adaptive Multimodal Exploration of Music Collections. In Proc. of ISMIR, Kobe, Japan, 2009.

[18]

C. Mourlas and P. Germanakos, editors. Intelligent User Interfaces. Information Science Reference, Hershey, New York, USA, 2009.

[19]

E. Pampalk. Islands of Music: Analysis, Organization, and Visualization of Music Archives. Master's thesis, Vienna University of Technology, Vienna, Austria, 2001.

[20]

E. Pampalk, S. Dixon, and G. Widmer. Exploring Music Collections by Browsing Different Views. Computer Music Journal, 28(3), 2004.

Digital Library

[21]

E. Pampalk and M. Goto. MusicRainbow: A New User Interface to Discover Artists Using Audio-based Similarity and Web-based Labeling. In Proc. of ISMIR, Victoria, Canada, 2006.

[22]

E. Pampalk and M. Goto. MusicSun: A New Approach to Artist Recommendation. In Proc. of ISMIR, Vienna, Austria, 2007.

[23]

E. Pampalk, A. Rauber, and D. Merkl. Content-based Organization and Visualization of Music Archives. In Proc. of ACM Multimedia, Juan les Pins, France, 2002.

Digital Library

[24]

E. Pampalk, A. Rauber, and D. Merkl. Using Smoothed Data Histograms for Cluster Visualization in Self-Organizing Maps. In Proc. of ICANN, Madrid, Spain, 2002.

Digital Library

[25]

T. Pohle, P. Knees, M. Schedl, E. Pampalk, and G. Widmer. "Reinventing the Wheel": A Novel Approach to Music Player Interfaces. IEEE Transactions on Multimedia, 9, 2007.

Digital Library

[26]

M. Schedl, P. Knees, K. Seyerlehner, and T. Pohle. The CoMIRVA Toolkit for Visualizing Music-Related Data. In Proc. of EuroVis, Norrköping, Sweden, 2007.

Digital Library

[27]

D. Schnitzer, T. Pohle, P. Knees, and G. Widmer. One-Touch Access to Music on Mobile Devices. In Proc. of MUM, Oulu, Finland, 2007.

Digital Library

[28]

M. R. Schröder, B. S. Atal, and J. L. Hall. Optimizing Digital Speech Coders by Exploiting Masking Properties of the Human Ear. Journal of the Acoustical Society of America, 66:1647--1652, 1979.

[29]

D. J. Sheskin. Handbook of Parametric and Nonparametric Statistical Procedures. Chapman & Hall/CRC, Boca Raton, London, New York, Washington, DC, 3rd edition, 2004.

[30]

S. S. Stevens. A Scale for the Measurement of the Psychological Magnitude: Loudness. Psychological Review, 43(5):405--416, 1936.

[31]

E. Terhardt. Calculating Virtual Pitch. Hearing Research, 1:155--182, 1979.

[32]

D. Turnbull, R. Liu, L. Barrington, and G. Lanckriet. A Game-based Approach for Collecting Semantic Annotations of Music. In Proc. of ISMIR, Vienna, Austria, 2007.

[33]

R. C. Veltkamp. Multimedia Retrieval Algorithmics. In Proc. of the SOFSEM), Harrachov, Czech Republic, 2007.

Digital Library

[34]

J. Vesanto. SOM-Based Data Visualization Methods. Intelligent Data Analysis, 3(2):111--126, 1999.

Digital Library

[35]

E. Zwicker and H. Fastl. Psychoacoustics, Facts and Models, volume 22 of Springer Series of Information Sciences. Springer, Berlin, Germany, 2nd updated edition, 1999.

Cited By

Tsukuda KTakahashi TIshida KHamasaki MGoto M(2024)Kiite World: Socializing Map-Based Music Exploration Through Playlist Sharing and Synchronized ListeningMultiMedia Modeling10.1007/978-981-96-2061-6_15(197-211)Online publication date: 31-Dec-2024
https://doi.org/10.1007/978-981-96-2061-6_15
Melchiorre APenz DGanhör CLesota OFragoso VFritzl FParada-Cabaleiro ESchubert FSchedl M(2023)Emotion-aware music tower blocks (EmoMTB ): an intelligent audiovisual interface for music discovery and recommendationInternational Journal of Multimedia Information Retrieval10.1007/s13735-023-00275-812:1Online publication date: 2-Jun-2023
https://doi.org/10.1007/s13735-023-00275-8
Schedl MMayr MKnees PGurrin CÞór Jónsson BKando NSchoeffmann KChen PO'Connor N(2020)Music Tower Blocks: Multi-Faceted Exploration Interface for Web-Scale Music AccessProceedings of the 2020 International Conference on Multimedia Retrieval10.1145/3372278.3391928(388-392)Online publication date: 8-Jun-2020
https://dl.acm.org/doi/10.1145/3372278.3391928
Show More Cited By

Index Terms

Large-scale music exploration in hierarchically organized landscapes using prototypicality information
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
      1. Virtual reality
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
    2. Interaction techniques
      1. Auditory feedback

Recommendations

Music Tower Blocks: Multi-Faceted Exploration Interface for Web-Scale Music Access
ICMR '20: Proceedings of the 2020 International Conference on Multimedia Retrieval

We present Music Tower Blocks, a novel browsing interface for interactive music visualization, capable of dealing with web-scale music collections nowadays offered by major music streaming services. Based on a clustering created from fused metadata and ...
Calliope: A Co-creative Interface for Multi-Track Music Generation
C&C '22: Proceedings of the 14th Conference on Creativity and Cognition

Calliope is a web application for co-creative multi-track music composition (MMM) in the symbolic domain. It is built to facilitate the use of multi-track music machine (MMM). The user can upload Musical Instrument Digital Interface (MIDI) files, ...
Using chord distance descriptors to enhance music information retrieval: student research abstract
SAC '17: Proceedings of the Symposium on Applied Computing

Music Information Retrieval (MIR) is an established field that provides solutions to analyze, retrieve, classify, recommend, or visualize music. From many applications, however, only a fraction will provide results that are meaningful for musicians [4]. ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ICMR '11: Proceedings of the 1st ACM International Conference on Multimedia Retrieval

April 2011

512 pages

ISBN:9781450303361

DOI:10.1145/1991996

General Chairs:
Francesco G. B. De Natale
University of Trento, Italy
,
Alberto Del Bimbo
University of Florence, Italy
,
Program Chairs:
Alan Hanjalic
University of Amsterdam, Netherlands
,
B. S. Manjunath
University of California, Santa Barbara
,
Shin'ichi Satoh
NII, Japan

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMM: ACM Special Interest Group on Multimedia

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 April 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Austrian Science Fund

Conference

ICMR'11

Sponsor:

SIGMM

ICMR'11: International Conference on Multimedia Retrieval

April 18 - 20, 2011

Trento, Italy

Acceptance Rates

Overall Acceptance Rate 254 of 830 submissions, 31%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
149
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)0

Reflects downloads up to 02 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Tsukuda KTakahashi TIshida KHamasaki MGoto M(2024)Kiite World: Socializing Map-Based Music Exploration Through Playlist Sharing and Synchronized ListeningMultiMedia Modeling10.1007/978-981-96-2061-6_15(197-211)Online publication date: 31-Dec-2024
https://doi.org/10.1007/978-981-96-2061-6_15
Melchiorre APenz DGanhör CLesota OFragoso VFritzl FParada-Cabaleiro ESchubert FSchedl M(2023)Emotion-aware music tower blocks (EmoMTB ): an intelligent audiovisual interface for music discovery and recommendationInternational Journal of Multimedia Information Retrieval10.1007/s13735-023-00275-812:1Online publication date: 2-Jun-2023
https://doi.org/10.1007/s13735-023-00275-8
Schedl MMayr MKnees PGurrin CÞór Jónsson BKando NSchoeffmann KChen PO'Connor N(2020)Music Tower Blocks: Multi-Faceted Exploration Interface for Web-Scale Music AccessProceedings of the 2020 International Conference on Multimedia Retrieval10.1145/3372278.3391928(388-392)Online publication date: 8-Jun-2020
https://dl.acm.org/doi/10.1145/3372278.3391928
Schedl MGraus MFerwerda BSchedl MTkalcic MWillemsen MGermanakos P(2017)Intelligent User Interfaces for Social Music Discovery and Exploration of Large-scale Music RepositoriesProceedings of the 2017 ACM Workshop on Theory-Informed User Modeling for Tailoring and Personalizing Interfaces10.1145/3039677.3039678(7-11)Online publication date: 13-Mar-2017
https://dl.acm.org/doi/10.1145/3039677.3039678
Ianigro SBown O(2016)PlectoProceedings of the 5th International Conference on Evolutionary and Biologically Inspired Music, Sound, Art and Design - Volume 959610.1007/978-3-319-31008-4_5(63-78)Online publication date: 30-Mar-2016
https://dl.acm.org/doi/10.1007/978-3-319-31008-4_5
Wu XQiao YTang XZhou XSmeaton ATian QBulterman DShen HMayer-Patel KYan S(2015)MILProceedings of the 23rd ACM international conference on Multimedia10.1145/2733373.2806388(1011-1014)Online publication date: 13-Oct-2015
https://dl.acm.org/doi/10.1145/2733373.2806388
Hamasaki MGoto MNakano TChung CBroder AShim KSuel T(2014)SongriumProceedings of the 23rd International Conference on World Wide Web10.1145/2567948.2576944(523-528)Online publication date: 7-Apr-2014
https://dl.acm.org/doi/10.1145/2567948.2576944
Schedl MGómez EGoto MJaimes ASebe NBoujemaa NGatica-Perez DShamma DWorring MZimmermann R(2013)Multimedia information retrievalProceedings of the 21st ACM international conference on Multimedia10.1145/2502081.2502237(1117-1118)Online publication date: 21-Oct-2013
https://dl.acm.org/doi/10.1145/2502081.2502237
Hamasaki MGoto MAguiar ARiehle D(2013)SongriumProceedings of the 9th International Symposium on Open Collaboration10.1145/2491055.2491059(1-10)Online publication date: 5-Aug-2013
https://dl.acm.org/doi/10.1145/2491055.2491059
Huber SSchedl MKnees PIp HRui Y(2012)nepDroidProceedings of the 2nd ACM International Conference on Multimedia Retrieval10.1145/2324796.2324862(1-2)Online publication date: 5-Jun-2012
https://dl.acm.org/doi/10.1145/2324796.2324862

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten