Skip to main content
SpringerLink
Log in

MUSIPER: a system for modeling music similarity perception based on objective feature subset selection

  • Original Paper
  • Published:
User Modeling and User-Adapted Interaction Aims and scope Submit manuscript

Abstract

We explore the use of objective audio signal features to model the individualized (subjective) perception of similarity between music files. We present MUSIPER, a content-based music retrieval system which constructs music similarity perception models of its users by associating different music similarity measures to different users. Specifically, a user-supplied relevance feedback procedure and related neural network-based incremental learning allows the system to determine which subset of a set of objective features approximates more accurately the subjective music similarity perception of a specific user. Our implementation and evaluation of MUSIPER verifies the relation between subsets of objective features and individualized music similarity perception and exhibits significant improvement in individualized perceived similarity in subsequent music retrievals.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Albrecht D.W., Zukerman I. and Nicholson A. (1998). Bayesian models for keyhole plan recognition in an adventure game. User Model. User Adapt. Interact. 8: 5–47

    Article  Google Scholar 

  • Arakawa, K., Odagawa, S., Matsushita, F., Kodama, Y., Shioda, T.: Analysis of listeners’ favorite music by music features. In: Proc. The International Conference on Consumer Electronics (ICCE), IEEE, pp. 427–428 (2006)

  • Balabanovic M. (1998). Exploring versus exploiting when learning user models for text recommendation. User Model. User Adapt. Interact. 8: 71–102

    Article  Google Scholar 

  • Bianchi-Berthouze N. (2002). Mining multimedia subjective feedback. J. Intell. Inf. Syst. 19(1): 43–59

    Article  Google Scholar 

  • Brusilovsky P., Tasso and C. (2004). Special issue on user modeling in Web information retrieval. User Model. User Adapt. Interact. 14(2–3): 147–288

    Article  Google Scholar 

  • Chen Q., Norcio A. and Wang J. (2006). Neural network-based stereotyping for user profiles. Neural Comput. Appl. 9(4): 259–265

    Article  Google Scholar 

  • Chin N.D. (2001). Empirical evaluation of user models and user-adapted systems. User Model. User Adapt. Interact. 11: 181–194

    Article  MATH  Google Scholar 

  • Foote, J.: Content-based retrieval of music and audio. In: Proc. Storage and Retrieval for Image and Video Databases (SPIE), vol. 3229, pp. 138–147 (1997)

  • Gmytrasiewicz P.J., Noh S. and Kellogg A. (1998). Bayesian update of recursive agent models. User Model. User Adapt. Interact. 8: 48–69

    Article  Google Scholar 

  • Grimaldi, M., Cunningham, P.: Experimenting with music taste prediction by user profiling. In: Proc. Music Information Retrieval 2004 (MIR’04). New York, USA (2004)

  • Hanani U., Shapira B. and Shoval P. (2001). Information filtering: overview of issues, research and systems. User Model. User Adapt. Interact. 11(3): 203–259

    Article  MATH  Google Scholar 

  • Haykin, S.: Neural Networks, 2 edn. Prentice Hall (1999)

  • Hoashi, K., Matsumo, K., Inoue, N.: Personalization of user profiles for content-based music retrieval based on relevance feedback. In: Proc. ACM International Conference on Multimedia 2003, pp. 110–119. ACM press (2003)

  • Jeribi L. and Rumple B. (2002). Instance cooperative memory to improve query expansion in Information Retrieval Systems. J. Universal Comput. Sci. 8(6): 591–601

    Google Scholar 

  • Kelly, D., Belkin, N.: A user modeling system for personalized interaction and tailored retrieval in interactive information retrieval. In: Proc. 65th Asist Annual Meeting, vol. 39, pp. 316–325 (2002)

  • Kumamoto, T.: Design and evaluation of a music retrieval scheme that adapts to the user’s impressions. In: Proc. User Modeling 2005, Lecture Notes in Artificial Intelligence, vol. 3538, pp. 287–296 (2005)

  • Lame, http://lame.sourceforge.net

  • Lampropoulos, A.S., Lampropoulou, P.S., Tsihrintzis, G.A.: A middleware system for Web-based digital music libraries. In: Proc. 2005 IEEE/WIC/ACM International Joint Conference on Web Intelligence. Compiegne University of Technology, France (2005a)

  • Lampropoulos, A.S., Lampropoulou, P.S., Tsihrintzis, G.A.: Musical genre classification enhanced by source separation techniques. In: Proc. 6th International Conference on Music Information Retrieval, pp. 576–581. London, UK (2005b)

  • Lampropoulos, A.S., Sotiropoulos, D.N., Tsihrintzis, G.A.: Individualization of music similarity perception via feature subset selection. In: Proc. IEEE International Conference on Systems, Man, and Cybernetics 2004. The Hague, The Netherlands (2004)

  • Lampropoulos, A.S., Tsihrintzis, G.A.: Semantically meaningful music retrieval with content-based features and fuzzy clustering. In: Proc. 5th International Workshop on Image Analysis for Multimedia Interactive Services. Lisboa, Portugal (2004)

  • Last, M., Shapira, B., Elovici, Y., Zaafrany, O., Kandel, A.: Content-based methodology for anomaly detection on the web. In: Menasalvas, E. et al. (eds.) Advances in Web Intelligence, vol. 2663, pp. 113–123. Springer-Verlag, Lecture Notes in Artificial Intelligence (2003)

  • Li, T., Ogihara, M., Li, Q.: A comparative study on content based music genre classification. In: Proc. 26th annual international ACM SIGIR conference on Research and development in Informaion Retrieval. Toronto, Canada (2003)

  • Magnini, B., Strapparava, C.: Improving user modeling with content-based techniques. In: Proc. User Modeling, vol. 2109, pp. 74–83. Lecture Notes in Artificial Intelligence (2001)

  • Mandel M., Poliner G. and Ellis D. (2006). Support vector machine active learning for music retrieval ACM multimedia systems journal. ACM Multimedia Syst. J. 12(1): 3–13

    Article  Google Scholar 

  • Moghaddam B., Tian Q., Lesh N., Shen C. and Huang T. (2004). Visualization and user-modeling for browsing personal photo libraries. Int. J. Comput. Vision, Special Issue 56(1–2): 109–130

    Article  Google Scholar 

  • Mostafa J., Mukhopadhyay S. and Palakal M. (2003). Simulation studies of different dimensions of users interests and their impact on user modeling and information filtering. Informat. Retrieval 6(2): 199–223

    Article  Google Scholar 

  • Oard D.W. (1997). The state of the art in text filtering. User Model. User Adapt. Interact. 7(3): 141–178

    Article  Google Scholar 

  • Park K.S., Yoon W.J., Lee K.K., Oh S.H. and Kim K.M. (2005). MRTB framework: a robust content-based music retrieval and browsing system. IEEE Transact. Consum. Electr. 51(1): 117–122

    Article  Google Scholar 

  • Pierrakos D., Papatheodorou G.P.C. and Spyropoulos C. (2003). Web usage mining as a tool for personalization: a survey. User Model. User Adapt. Interact. 13(4): 311–372

    Article  Google Scholar 

  • Rui Y., Huang T., Ortega M. and Mehrotra S. (1998). Relevance feedback: a power tool in interactive content-based image retrieval. IEEE Transact. Circ. Syst. Video Technol. 8(5): 644–655

    Article  Google Scholar 

  • Sison R., Numao M. and Masamichi S. (1998). Discovering error classes from discrepancies in novice behaviors via multistrategy conceptual clustering. User Model. User Adapt. Interact. 8: 102–129

    Article  Google Scholar 

  • Sotiropoulos, D.N., Lampropoulos, A.S., Tsihrintzis, G.A.: Artificial immune system-based music piece similarity measures and database organization. In: Proc. 5th EURASIP Conference on Speech and Image Processing, Multimedia Communications and Services. Smolenice, Slovak Republic (2005)

  • Sotiropoulos, D.N., Tsihrintzis, G.A.: Feature selection-based relevance feedback in content-based retrieval systems. In: Proc. 5th International Workshop on Image Analysis for Multimedia Interactive Services. Lisboa, Portugal (2004)

  • Tian, Q., Moghaddam, B., Huang, T.: Visualization, estimation and user-modeling for interactive browsing of image libraries. In: Proc. Image and Video Retrieval, vol. 2383, pp. 7–16. Lecture Notes in Computer Science (2002)

  • Tzanetakis, G.: Manipulation, analysis and retrieval systems for audio signals. Ph.D. thesis, Princeton University (2002)

  • Tzanetakis G. and Cook P. (2000). MARSYAS: a framework for audio analysis. Organised Sound 4(3): 169–175

    Article  Google Scholar 

  • Tzanetakis G. and Cook P. (2002). Musical genre classification of audio signals. IEEE Transact. Speech Audio Process. 10(5): 293–302

    Article  Google Scholar 

  • Vignoli, F., Pauws, S.: A music retrieval system based on user driven similarity and its evaluation. In: Proc. 6th International Conference on Music Information Retrieval, pp. 272–279. London, UK (2005)

  • Virvou M. (1999). Automatic reasoning and help about human errors in using an operating system. Interact. Comput. 11: 545–573

    Article  Google Scholar 

  • Virvou M. and Boulay B. (1999). Human plausible reasoning for intelligent help. User Model. User Adapt. Interact. 9: 321–375

    Article  Google Scholar 

  • Virvou, M., Kabassi, K.: Adapting the human plausible reasoning theory to a graphical user interface. In: Proc. IEEE International Conference on Systems, Man, and Cybernetics 2004. The Hague, The Netherlands (2004)

  • Webb G. (1997). Preface to UMUAI special issue on machine learning for user modeling. User Model. User Adapt. Interact. 8: 1–3

    Article  MathSciNet  Google Scholar 

  • Webb G., Pazzani M. and Billsus D. (2001). Machine learning for user modeling. User Model. User Adapt. Interact. 11(1–2): 19–29

    Article  MATH  Google Scholar 

  • Wolpert R.S. (1990). Recognition of melody, harmonic accompaniment and instrumentation: musicians vs. non-musicians. Music Percept. 8(1): 95–106

    Google Scholar 

  • Yang J., Li Q. and Zhuang Y. (2004). Towards data-adaptive and user-adaptive image retrieval by peer indexing. Int. J. Comput Vision, Special Issue 56(1–2): 47–63

    Article  Google Scholar 

  • Yasdi R. (2000). A literature survey on applications of neural networks for human–computer interaction. Neural Comput. Appl. 9(4): 245–258

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Informatics, University of Piraeus, Piraeus, 185 34, Greece

    Dionysios N. Sotiropoulos, Aristomenis S. Lampropoulos & George A. Tsihrintzis

Authors
  1. Dionysios N. Sotiropoulos
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Aristomenis S. Lampropoulos
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. George A. Tsihrintzis
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to George A. Tsihrintzis.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Sotiropoulos, D.N., Lampropoulos, A.S. & Tsihrintzis, G.A. MUSIPER: a system for modeling music similarity perception based on objective feature subset selection. User Model User-Adap Inter 18, 315–348 (2008). https://doi.org/10.1007/s11257-007-9035-8

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11257-007-9035-8

Keywords

Search

Navigation