Skip to main content
SpringerLink
Log in

Relevance feedback for category search in music retrieval based on semantic concept learning

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Traditional content-based music retrieval systems retrieve a specific music object which is similar to what a user has requested. However, the need exists for the development of category search for the retrieval of a specific category of music objects which share a common semantic concept. The concept of category search in content-based music retrieval is subjective and dynamic. Therefore, this paper investigates a relevance feedback mechanism for category search of polyphonic symbolic music based on semantic concept learning. For the consideration of both global and local properties of music objects, a segment-based music object modeling approach is presented. Furthermore, in order to discover the user semantic concept in terms of discriminative features of discriminative segments, a concept learning mechanism based on data mining techniques is proposed to find the discriminative characteristics between relevant and irrelevant objects. Moreover, three strategies, the Most-Positive, the Most-Informative, and the Hybrid, to return music objects concerning user relevance judgments are investigated. Finally, comparative experiments are conducted to evaluate the effectiveness of the proposed relevance feedback mechanism. Experimental results show that, for a database of 215 polyphonic music objects, 60% average precision can be achieved through the use of the proposed relevance feedback mechanism.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Agrawal R, Srikant R (1994) Fast algorithms for mining association rules. In Proc International Conference on Very Large Data Bases, pp 487–499

  2. Baeza-Yates R, Riberio-Neto B (1999) Modern information retrieval. Addison Wesley, Reading, MA, USA

    Google Scholar 

  3. Chai W (2006) Semantic segmentation and summarization of music: methods based tonality and recurrent structure. IEEE Signal Process Mag 23(2):124–132

    Article  Google Scholar 

  4. Doulamis N, Doulamis A, Varvarigou T (2003) Adaptive algorithms for interactive multimedia. IEEE Multimed 10(4):2–11

    Article  Google Scholar 

  5. Foote JT (1997) Content-based retrieval of music and audio. Proc SPIE Multimedia Storage Archiving Syst II 3229:138–147

    Google Scholar 

  6. Gondra, Heisterkamp DR (2004) Learning in region-based image retrieval with generalized support vector machines. In Proc IEEE Computer Vision and Pattern Recognition Workshop

  7. He XF, King O, Ma WY, Li MJ, Jiang HJ (2003) Learning a semantic space from user’s relevance feedback for image retrieval. IEEE Trans Circuits Syst Video Technol 13:39–48

    Article  Google Scholar 

  8. Hoashi K, Matsumoto K, Inoue N (2003) Personalization of user profiles for content-based music retrieval based on relevance feedback. In Proc ACM International Conference on Multimedia pp 110–119, Nov

  9. Hoashi K, Zeitler E, Inoue N (2002) Implementation of relevance feedback for content-based music retrieval based on user preferences. In Proc ACM International Conference on Research and Development in Information Retrieval, pp 385–386, Aug

  10. Hsu JL, Liu CC, Chen ALP (2001) Discovering non-trivial repeating patterns in music data. IEEE Trans Multimedia 3(3):311–325

    Article  Google Scholar 

  11. Jing F, Li MJ, Zhang HJ, Zhang B (2004) Relevance feedback in region-based image retrieval. IEEE Trans Circuits Syst Video Technol 14(5):672–681

    Article  Google Scholar 

  12. Jing F, Li MJ, Zhang HJ, Zhang B (2004) An efficient and effective region-based image retrieval framework. IEEE Trans Image Process 13(5):699–709

    Article  Google Scholar 

  13. Kuo FF, Shan MK (2002) Music style mining and classification by melody. In Proc IEEE International Conference on Multimedia and Expo, Aug

  14. Liu B, Hsu W, Ma Y (1998) Integrating classification and association rule mining. In Proc ACM International Conference on Knowledge Discovery and Data Mining, pp 80–86, Aug

  15. Liu CC, Hsu JL, Chen ALP (1999) An approximating string matching algorithm for content-based music data retrieval. In Proc IEEE International Conference on Multimedia Computing and Systems, pp 451–456, Jun

  16. Mandel MI, Poliner GE, Ellis DPW (2006) Support vector machine active learning for music retrieval. Multimedia Syst 12(1):3–13

    Article  Google Scholar 

  17. Mandl T, Womser-Hacker C (2002) Learning to cope with diversity in music retrieval. In Proc International Conference on Music Information Retrieval

  18. Mandl T, Womser-Hacker C (2003) Learning to cope with diversity in music retrieval. J New Music Res 32(2):133–141

    Article  Google Scholar 

  19. Mermelstein D (1980) Comparison of parametric representations for monosyllabic word recognition in continuously spoken sentences. IEEE Transactions on Acoustics, Speech and Signal Processing 28(4)

  20. Pardo B (2006) Music information retrieval. Commun ACM 49(8):29–31

    Article  MathSciNet  Google Scholar 

  21. Rui Y, Huang TS, Ortega M, Mehrotra S (1998) Relevance feedback: a power tool for interactive content-based image retrieval. IEEE Trans Circuits Syst Video Technol 8(5):644–655

    Article  Google Scholar 

  22. Shan MK, Ho MC (2007) Theme-based music structural analysis. Submitted to IEEE Multimedia

  23. Stein L (1979) Structure and style. Summy-Birchard, New York, NY, USA

    Google Scholar 

  24. Tong S, Chang E (2001) Support vector machine active learning for image retrieval. In Proc ACM International Conference on Multimedia, pp 107–118, Sep

  25. Uitdenbgerd, Zobel J (1999) Melodic matching techniques for large music databases. In Proc ACM International Conference on Multimedia, pp 57–66, Oct

  26. Zhou XS, Huang TS (2003) Relevance feedback in image retrieval: a comprehensive review. Multimedia Syst 8(6):536–544

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science, National Chengchi University, Taipei, Taiwan

    Man-Kwan Shan & Meng-Fen Chiang

  2. Department of Computer Science, National Chiao Tung University, Hsinchu, Taiwan

    Fang-Fei Kuo

Authors
  1. Man-Kwan Shan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Meng-Fen Chiang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Fang-Fei Kuo
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Man-Kwan Shan.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Shan, MK., Chiang, MF. & Kuo, FF. Relevance feedback for category search in music retrieval based on semantic concept learning. Multimed Tools Appl 39, 243–262 (2008). https://doi.org/10.1007/s11042-008-0201-8

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-008-0201-8

Keywords

Search

Navigation