skip to main content
10.1145/3405962.3405963acmotherconferencesArticle/Chapter ViewAbstractPublication PageswimsConference Proceedingsconference-collections
research-article

Lyrics or Audio for Music Recommendation?

Published:24 August 2020Publication History

ABSTRACT

Music recommender systems (RS) aim to aid people with finding relevant enjoyable music without having to sort through the enormous amount of available content. Music RS often rely on collaborative filtering methods, which however limits predicting capabilities in cold-start situations or for users who deviate from main-stream music preferences. Therefore, this paper evaluates various content-based music recommendation methods that may be used in combination with collaborative filtering to overcome such issues. Specifically, the paper focuses on the ability of lyrics-based embedding methods such as tf-idf, word2vec or bert to estimate songs similarity compared to state-of-the-art audio and meta-data based embeddings. Results indicate that both audio and lyrics methods perform similarly, which may favor lyrics-based approaches due to the much simpler processing. We also show that although lyrics-based methods do not outperform meta-data based approaches, they provide much more diverse, yet reasonably relevant recommendations, which is suitable in exploration-oriented music RS.

References

  1. Shahin Amiriparian, Michael Freitag, Nicholas Cummins, and Björn Schuller. 2017. Sequence to Sequence Autoencoders for Unsupervised Representation Learning from Audio. In Detection and Classification of Acoustic Scenes and Events 2017 Workshop (DCASE2017). 17--21.Google ScholarGoogle Scholar
  2. P. Bedi, A. Gautam, Richa, and C. Sharma. 2014. Using novelty score of unseen items to handle popularity bias in recommender systems. In 2014 International Conference on Contemporary Computing and Informatics (IC3I). 934--939.Google ScholarGoogle Scholar
  3. Kyunghyun Cho, Bart van Merrienboer, Çaglar Gülçehre, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. 2014. Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation. CoRR abs/1406.1078 (2014).Google ScholarGoogle Scholar
  4. Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. arXiv:cs.CL/1810.04805Google ScholarGoogle Scholar
  5. Sander Dieleman and Benjamin Schrauwen. 2013. Multiscale approaches to music audio feature learning. In 14th international society for music information retrieval conference. Pontifícia Universidade Católica do Paraná, 116--121.Google ScholarGoogle Scholar
  6. Derek Gossi and Mehmet Hadi Gunes. 2016. Lyric-Based Music Recommendation. In Complex Networks VII - Proceedings of the 7th Workshop on Complex Networks, CompleNet 2016, Dijon, France, March 23-25, 2016 (Studies in Computational Intelligence), Hocine Cherifi, Bruno Gonçalves, Ronaldo Menezes, and Roberta Sinatra (Eds.), Vol. 644. Springer, 301--310.Google ScholarGoogle Scholar
  7. Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long Short-term Memory. Neural computation 9 (12 1997), 1735--80.Google ScholarGoogle Scholar
  8. Erich Peter Klement, Radko Mesiar, and Endre Pap. 2013. Triangular norms. Vol. 8. Springer Science & Business Media.Google ScholarGoogle Scholar
  9. Beth Logan, Andrew Kositsky, and Pedro Moreno. 2004. Semantic analysis of song lyrics. In 2004 IEEE International Conference on Multimedia and Expo (ICME), Vol. 2. 827--830 Vol.2.Google ScholarGoogle ScholarCross RefCross Ref
  10. Brian McFee, Luke Barrington, and Gert Lanckriet. 2012. Learning content similarity for music recommendation. IEEE transactions on audio, speech, and language processing 20, 8 (2012), 2207--2218.Google ScholarGoogle Scholar
  11. Tomas Mikolov, Kai Chen, Greg Corrado, and Jeffrey Dean. 2013. Efficient Estimation of Word Representations in Vector Space. CoRR abs/1301.3781 (2013).Google ScholarGoogle Scholar
  12. Braja Gopal Patra, Dipankar Das, and Sivaji Bandyopadhyay. 2017. Retrieving Similar Lyrics for Music Recommendation System. In Proceedings of the 14th International Conference on Natural Language Processing (ICON-2017). NLP Association of India, Kolkata, India, 290--297.Google ScholarGoogle Scholar
  13. Karl Pearson. 1901. LIII. On lines and planes of closest fit to systems of points in space. (Nov 1901). https://doi.org/10.1080/14786440109462720Google ScholarGoogle Scholar
  14. Ladislav Peška and Stepan Balcar. 2019. Fuzzy D'Hondt's Algorithm for On-line Recommendations Aggregation. In ORSUM '19 (Proceedings of Machine Learning Research), Vol. 109. PMLR, 2--11. http://proceedings.mlr.press/v109/peska19a.htmlGoogle ScholarGoogle Scholar
  15. Qi Qi, Zhenyu Chen, Jia Liu, Chengfeng Hui, and Qing Wu. 2012. Using Inferred Tag Ratings to Improve User-Based Collaborative Filtering. In 27th Annual ACM Symposium on Applied Computing (SAC '12). Association for Computing Machinery, New York, NY, USA, 2008--2013.Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Markus Schedl, Hamed Zamani, Ching-Wei Chen, Yashar Deldjoo, and Mehdi Elahi. 2017. Current challenges and visions in music recommender systems research. Int. J. Multimed. Inf. Retr. 7 (2017), 95--116.Google ScholarGoogle ScholarCross RefCross Ref
  17. Harald Steck.2018. Calibrated Recommendations. In Proceedings of the 12th ACM Conference on Recommender Systems (RecSys '18). ACM, New York, NY, USA, 154--162. https://doi.org/10.1145/3240323.3240372Google ScholarGoogle Scholar
  18. Tsegaye Misikir Tashu and Tomás Horváth. 2019. Semantic-Based Feedback Recommendation for Automatic Essay Evaluation. In Intelligent Systems and Applications - Proceedings of the 2019 Intelligent Systems Conference, IntelliSys 2019, London, UK, September 5-6, 2019, Volume 2 (Advances in Intelligent Systems and Computing), Yaxin Bi, Rahul Bhatia, and Supriya Kapoor (Eds.), Vol. 1038. Springer, 334--346. https://doi.org/10.1007/978-3-030-29513-4_24Google ScholarGoogle Scholar
  19. Alexandros Tsaptsinos. 2017. Lyrics-Based Music Genre Classification Using a Hierarchical Attention Network. CoRR abs/1707.04678 (2017).Google ScholarGoogle Scholar
  20. Aaron van den Oord, Sander Dieleman, and Benjamin Schrauwen. 2013. Deep content-based music recommendation. In Advances in Neural Information Processing Systems 26. Curran Associates, Inc., 2643--2651.Google ScholarGoogle Scholar
  21. Dongjing Wang, Shuiguang Deng, Xin Zhang, and Guandong Xu. 2016. Learning Music Embedding with Metadata for Context Aware Recommendation. In 2016 ACM International Conference on Multimedia Retrieval. 249--253.Google ScholarGoogle Scholar
  22. Hamed Zamani, Markus Schedl, Paul Lamere, and Ching-Wei Chen. 2019. An Analysis of Approaches Taken in the ACM RecSys Challenge 2018 for Automatic Music Playlist Continuation. ACM Trans. Intell. Syst. Technol. 10, 5, Article 57 (2019).Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Lyrics or Audio for Music Recommendation?

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in
        • Published in

          cover image ACM Other conferences
          WIMS 2020: Proceedings of the 10th International Conference on Web Intelligence, Mining and Semantics
          June 2020
          279 pages
          ISBN:9781450375429
          DOI:10.1145/3405962

          Copyright © 2020 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 24 August 2020

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article
          • Research
          • Refereed limited

          Acceptance Rates

          WIMS 2020 Paper Acceptance Rate35of63submissions,56%Overall Acceptance Rate140of278submissions,50%

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader