Skip to main content
SpringerLink
Log in

Compact feature subset-based multi-label music categorization for mobile devices

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Music categorization based on acoustic features extracted from music clips and user-defined tags forms the basis of recent music recommendation applications, because relevant tags can be automatically assigned based on the feature values and their relation to tags. In practice, especially for handheld lightweight mobile devices, there is a certain limitation on the computational capacity, owing to consumers’ usage behavior or battery consumption. This also limits the maximum number of acoustic features to be extracted, and results in the necessity of identifying a compact feature subset that is used for the music categorization process. In this study, we propose an approach to compact feature subset-based multi-label music categorization for mobile music recommendation services. Experimental results using various multi-labeled music datasets reveal that the proposed approach yields better performance when compared to conventional approach.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2

Similar content being viewed by others

References

  1. Bai J, Feng L, Peng J, Shi J, Luo K, Li Z, Liao L, Wang Y (2016) Dimensional music emotion recognition by machine learning. Int J Cogn Inf Nat Intell 10(4):74–89

    Article  Google Scholar 

  2. Baltrunas L, Kaminskas M, Ludwig B, Moling O, Ricci F, Aydin A, Lüke K-H, Schwaiger R (2011) Incarmusic: context-aware music recommendations in a car. In: Proceedings of the 12th international conference on electronic commerce and web technologies. Toulouse, pp 89-100

  3. Blume H, Bischl B, Botteck M, Igel C, Martin R, Roetter G, Rudolph G, Theimer W, Vatolkin I, Weihs C (2011) Huge music archives on mobile devices. IEEE Signal Process Mag 28(4):24–39

    Article  Google Scholar 

  4. Cano A, Luna JM, Gibaja EL, Ventura S (2016) LAIM discretization for multi-label data. Inform Sci 330(1):370–384

    Article  Google Scholar 

  5. Deb K, Pratap A, Agarwal S, Meyarivan T (2002) A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans Evol Comput 6(2):182–197

    Article  Google Scholar 

  6. Doquire G, Verleysen M (2013) Mutual information-based feature selection for multilabel classification. Neurocomputing 122(1):148–155

    Article  MATH  Google Scholar 

  7. Fu Z, Lu G, Ting KM, Zhang D (2011) A survey of audio-based music classification and annotation. IEEE Trans Multimed 13(2):303–319

    Article  Google Scholar 

  8. Kaminskas M, Ricci F (2011) Location-adapted music recommendation using tags. In: Proceedings of the 19th international conference on user modeling, adaptation, and personalization. Girona, pp 183-194

  9. Kong D, Ding C, Huang H, Zhao H (2012) Multi-label ReliefF and F-statistic feature selections for image annotation. In: Proceeding of IEEE Conference on computer vision and pattern recognition. Providence, pp 2352–2359

  10. Lartillot O, Toiviainen P (2007) A matlab toolbox for musical feature extraction from audio. In: Proceedings of the 10th International conference on digital audio effects. Bordeaux, pp 237–244

  11. Lee J, Kim D-W (2015) Fast multi-label feature selection based on information-theoretic feature ranking. Pattern Recogn 48(9):2761–2771

    Article  MATH  Google Scholar 

  12. Lee J, Kim D-W (2015) Memetic feature selection algorithm for multi-label classification. Inform Sci 293(1):80–96

    Article  Google Scholar 

  13. Lee J, Kim D-W (2017) SCLS: multi-label feature selection based on scalable criterion for large label set. Pattern Recogn 66(1):342–352

    Article  MathSciNet  Google Scholar 

  14. Lee J, Jo J-H, Lim H, Chae J-H, Lee S-U, Kim D-W (2015) Investigating relation of music data: emotion and audio signals. Lect Notes Electr Eng 330(1):251–256

    Article  Google Scholar 

  15. Lee J, Kim H, Kim N-R, Lee J-H (2016) An approach for multi-label classification by directed acyclic graph with label correlation maximization. Inform Sci 351(1):101–114

    Article  Google Scholar 

  16. Liebman E, Saar-Tsechansky M, Stone P (2015) Dj-mc: a reinforcement-learning agent for music playlist recommendation. In: Proceedings of the 2015 International conference on autonomous agents and multiagent systems. IStanbul, pp 591–599

  17. Lin Y, Hu Q, Liu J, Duan J (2015) Multi-label feature selection based on max-dependency and min-redundancy. Neurocomputing 168(1):92–103

    Article  Google Scholar 

  18. Magalhaes-Mendes J (2013) A comparative study of crossover operators for genetic algorithms to solve the job shop scheduling problem. WSEAS Trans Comput 12(4):164–173

    Google Scholar 

  19. Min F, Xu J (2016) Semi-greedy heuristics for feature selection with test cost constraints. Granular Comput 1(3):199–211

    Article  Google Scholar 

  20. Naula P, Airola A, Salakoski T, Pahikkala T (2014) Multi-label learning under feature extraction budgets. Pattern Recogn Lett 40(1):56–65

    Article  MATH  Google Scholar 

  21. Ness SR, Theocharis A, Tzanetakis G, Martins LG (2009) Improving automatic music tag annotation using stacked generalization of probabilistic SVM outputs. In: Proceedings of the 17th ACM international conference on multimedia. Beijing, pp 705–708

  22. Nguyen HB, Xue B, Andreae P (2016) Mutual information for feature selection: estimation or counting? Evol Intel 9(3):95–110

    Article  Google Scholar 

  23. Papanikolaou Y, Katakis I, Tsoumakas G (2016) Hierarchical partitioning of the output space in multi-label data arXiv:1612.06083

  24. Read J (2008) A pruned problem transformation method for multi-label classification. In: Proceedings of New Zealand computer science research student conference. Christchurch, pp 143–150

  25. Spolaôr N, Monard MC, Tsoumakas G, Lee HD (2016) A systematic review of multi-label feature selection and a new method based on label construction. Neurocomputing 180(1):3–15

    Article  Google Scholar 

  26. Sun Y, Wong A, Kamel M (2009) Classification of imbalanced data: a review International. J Pattern Recogn Artif Intell 23(4):687–719

    Article  Google Scholar 

  27. Teng Y-C, Kuo Y-S, Yang Y-H (2013) A large in-situ dataset for context-aware music recommendation on smartphones. In: Proceedings of the 2013 IEEE international conference on multimedia and expo workshops. San Jose, pp 1–4

  28. Xue B, Zhang M, Browne WN, Yao X (2016) A survey on evolutionary computation approaches to feature selection. IEEE Trans Evol Comput 20(4):606–626

    Article  Google Scholar 

  29. Yan Q, Ding C, Yin J, Lv Y (2015) Improving music auto-tagging with trigger-based context model. In: Proceedings of the 2015 IEEE international conference on acoustics, speech and signal processing. Brisbane, pp 434–438

  30. Yang H, Xu Z, Lyu MR, King I (2015) Budget constrained non-monotonic feature selection. Neural Netw 71(1):214–224

    Article  MATH  Google Scholar 

  31. Yin J, Tao T, Xu J (2015) A multi-label feature selection algorithm based on multi-objective optimization. In: Proceedings of the 2015 International joint conference on neural networks. Killarney, pp 1–7

  32. Zhang M-L, Wu L (2015) LIFT: multi-label learning with label-specific features. IEEE Trans Pattern Anal Mach Intell 37(1):107–120

    Article  Google Scholar 

  33. Zhang M-L, Zhou Z-H (2007) ML-kNN: a lazy learning approach to multi-label learning. Pattern Recogn 40(7):2038–2048

    Article  MATH  Google Scholar 

  34. Zhang M-L, Zhou Z-H (2014) A review on multi-label learning algorithms. IEEE Trans Knowl Data Eng 26(8):1819–1837

    Article  Google Scholar 

  35. Zhang M-L, Peña JM, Robles V (2009) Feature selection for multi-label naive Bayes classification. Inform Sci 179(19):3218–3229

    Article  MATH  Google Scholar 

  36. Zhang Y, Gong D-W, Rong M (2015) Multi-objective differential evolution algorithm for multi-label feature selection in classification. Lect Notes Comput Sci 9140(1):339–345

    Google Scholar 

  37. Zhang Y, Gong D-W, Sun X-Y, Guo Y-N (2017) A PSO-based multi-objective multi-label feature selection method in classification. Sci Rep 7(376):1–12

    Google Scholar 

  38. Zhu Z, Ong Y-S, Dash M (2007) Wrapper–filter feature selection algorithm using a memetic framework. IEEE Int Conf Syst Man Cybern Part B 37(1):70–76

    Article  Google Scholar 

  39. Zhu Z, Jia S, Ji Z (2010) Towards a memetic feature selection paradigm. IEEE Comput Intell Mag 5(2):41–53

    Article  Google Scholar 

Download references

Acknowledgements

This research was supported by the Chung-Ang University Research Scholarship Grants in 2018 and by Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Science, ICT and Future Planning (NRF-2016R1C1B1014774).

Author information

Authors and Affiliations

  1. Chung-Ang University, Seoul, Republic of Korea

    Jaesung Lee, Wangduk Seo, Jin-Hyeong Park & Dae-Won Kim

Authors
  1. Jaesung Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Wangduk Seo
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jin-Hyeong Park
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Dae-Won Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Dae-Won Kim.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lee, J., Seo, W., Park, JH. et al. Compact feature subset-based multi-label music categorization for mobile devices. Multimed Tools Appl 78, 4869–4883 (2019). https://doi.org/10.1007/s11042-018-6100-8

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-018-6100-8

Keywords

Search

Navigation