skip to main content
10.1145/2930238.2930280acmconferencesArticle/Chapter ViewAbstractPublication PagesumapConference Proceedingsconference-collections
short-paper

Moodplay: Interactive Mood-based Music Discovery and Recommendation

Authors Info & Claims
Published:13 July 2016Publication History

ABSTRACT

A large body of research in recommender systems focuses on optimizing prediction and ranking. However, recent work has highlighted the importance of other aspects of the recommendations, including transparency, control and user experience in general. Building on these aspects, we introduce MoodPlay, a hybrid recommender system music which integrates content and mood-based filtering in an interactive interface. We show how MoodPlay allows the user to explore a music collection by latent affective dimensions, and we explain how to integrate user input at recommendation time with predictions based on a pre-existing user profile. Results of a user study (N=240) are discussed, with four conditions being evaluated with varying degrees of visualization, interaction and control. Results show that visualization and interaction in a latent space improve acceptance and understanding of both metadata and item recommendations. However, too much of either can result in cognitive overload and a negative impact on user experience.

References

  1. M. J. Albers. Cognitive strain as a factor in effective document design. In Proceedings of the 15th Annual International Conference on Computer Documentation, SIGDOC '97, pages 1--6, New York, NY, USA, 1997. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. C. Baccigalupo and E. Plaza. Case-based sequential ordering of songs for playlist recommendation. In Advances in Case-Based Reasoning, pages 286--300. Springer, 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. L. Baltrunas and X. Amatriain. Towards time-dependant recommendation based on implicit feedback. In Workshop on context-aware recommender systems (CARS'09), 2009.Google ScholarGoogle Scholar
  4. T. Bertin-Mahieux, D. P. Ellis, B. Whitman, and P. Lamere. The million song dataset. In Proceedings of the 12th International Conference on Music Information Retrieval (ISMIR 2011), 2011.Google ScholarGoogle Scholar
  5. S. Bostandjiev, J. O'Donovan, and T. Höllerer. Tasteweights: a visual interactive hybrid recommender system. In Proceedings of the sixth ACM conference on Recommender systems, pages 35--42. ACM, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. V. Castaignet and F. Vavrille. About musicovery. {Online; accessed 10-May-2015}.Google ScholarGoogle Scholar
  7. O. Celma and P. Herrera. A new approach to evaluating novel recommendations. In Proceedings of the 2008 ACM Conference on Recommender Systems, RecSys '08, pages 179--186, New York, NY, USA, 2008. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. L. Chen and P. Pu. Interaction design guidelines on critiquing-based recommender systems. User Modeling and User-Adapted Interaction, 19(3):167--206, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. G. L. Collier. Beyond valence and activity in the emotional connotations of music. Psychology of Music, 35(1):110--131, 2007.Google ScholarGoogle ScholarCross RefCross Ref
  10. R. Corp. Rovi API. http://developer.rovicorp.com/docs.Google ScholarGoogle Scholar
  11. EchoNest. EchoNest API. http://developer.echonest.com/docs/v4.Google ScholarGoogle Scholar
  12. B. Faltings, P. Pu, M. Torrens, and P. Viappiani. Designing example-critiquing interaction. In Proceedings of the 9th international conference on Intelligent user interfaces, pages 22--29. ACM, 2004. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. I. Fernández-Tobías, I. Cantador, and L. Plaza. An emotion dimensional model based on social tags: Crossing folksonomies and enhancing recommendations. In E-Commerce and Web Technologies, pages 88--100. Springer, 2013.Google ScholarGoogle ScholarCross RefCross Ref
  14. G. Gonzalez, J. L. De La Rosa, M. Montaner, and S. Delfin. Embedding emotional context in recommender systems. In Data Engineering Workshop, 2007 IEEE 23rd International Conference on, pages 845--852. IEEE, 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. L. Gou, F. You, J. Guo, L. Wu, and X. L. Zhang. Sfviz: interest-based friends exploration and recommendation in social networks. In Proceedings of the 2011 Visual Information Communication-International Symposium, page 15. ACM, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. B. Gretarsson, J. O'Donovan, S. Bostandjiev, C. Hall, and T. Höllerer. Smallworlds: Visualizing social recommendations. In Computer Graphics Forum, volume 29, pages 833--842. Wiley Online Library, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. B.-j. Han, S. Rho, S. Jun, and E. Hwang. Music emotion classification and context-based music recommendation. Multimedia Tools and Applications, 47(3):433--460, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. N. Hariri, B. Mobasher, and R. Burke. Context-aware music recommendation based on latenttopic sequential patterns. In Proceedings of the Sixth ACM Conference on Recommender Systems, RecSys '12, pages 131--138, New York, NY, USA, 2012. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. C. He, D. Parra, and K. Verbert. Interactive recommender systems: a survey of the state of the art and future research challenges and opportunities. Expert Systems with Applications, 2016. in press. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Y. Hijikata, Y. Kai, and S. Nishida. The relation between user intervention and user satisfaction for information recommendation. In Proceedings of the 27th Annual ACM Symposium on Applied Computing, pages 2002--2007. ACM, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. B. P. Knijnenburg, S. Bostandjiev, J. O'Donovan, and A. Kobsa. Inspectability and control in social recommenders. In Proceedings of the sixth ACM conference on Recommender systems, pages 43--50. ACM, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. S. Koelsch. A neuroscientific perspective on music therapy. Annals of the New York Academy of Sciences, 1169(1):374--384, 2009.Google ScholarGoogle ScholarCross RefCross Ref
  23. J. A. Konstan and J. Riedl. Recommender systems: from algorithms to user experience. User Modeling and User-Adapted Interaction, 22(1--2):101--123, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. B. Logan. Music recommendation from song sets. In ISMIR, 2004.Google ScholarGoogle Scholar
  25. F. Maillet, D. Eck, G. Desjardins, P. Lamere, et al. Steerable playlist generation by learning song similarity from radio station playlists. In ISMIR, pages 345--350, 2009.Google ScholarGoogle Scholar
  26. J. Masthoff. The pursuit of satisfaction: affective state in group recommender systems. In User Modeling 2005, pages 297--306. Springer, 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. B. McFee and G. R. G. Lanckriet. Large-scale music similarity search with spatial trees. In A. Klapuri and C. Leider, editors, ISMIR, pages 55--60. University of Miami, 2011.Google ScholarGoogle Scholar
  28. S. M. McNee, J. Riedl, and J. A. Konstan. Being accurate is not enough: how accuracy metrics have hurt recommender systems. In CHI'06 extended abstracts on Human factors in computing systems, pages 1097--1101. ACM, 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. S. Nagulendra and J. Vassileva. Understanding and controlling the filter bubble through interactive visualization: A user study. In Proceedings of the 25th ACM Conference on Hypertext and Social Media, HT '14, pages 107--115, New York, NY, USA, 2014. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. K. Oatley, D. Keltner, and J. M. Jenkins. Understanding emotions . Blackwell publishing, 2006.Google ScholarGoogle Scholar
  31. J. O'Donovan, B. Smyth, B. Gretarsson, S. Bostandjiev, and T. Höllerer. Peerchooser: visual interactive recommendation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pages 1085--1088. ACM, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. H.-S. Park, J.-O. Yoo, and S.-B. Cho. A context-aware music recommendation system using fuzzy bayesian networks with utility theory. In Fuzzy systems and knowledge discovery, pages 970--979. Springer, 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. D. Parra and X. Amatriain. Walk the talk: Analyzing the relation between implicit and explicit feedback for preference elicitation. In Proceedings of the 19th International Conference on User Modeling, Adaption, and Personalization, UMAP'11, pages 255--268, Berlin, Heidelberg, 2011. Springer-Verlag. Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. D. Parra, P. Brusilovsky, and C. Trattner. See what you want to see: Visual user-driven approach for hybrid recommendation. In Proceedings of the 19th International Conference on Intelligent User Interfaces, IUI '14, pages 235--240, New York, NY, USA, 2014. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. T. Pedersen and M. Jason. WordNet::Similarity. http://maraca.d.umn.edu/cgi-bin/similarity/similarity.cgi.Google ScholarGoogle Scholar
  36. R. W. Picard. Affective computing. MIT press, 2000. Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. P. Pu, B. Faltings, L. Chen, J. Zhang, and P. Viappiani. Usability guidelines for product recommenders based on example critiquing research. In F. Ricci, L. Rokach, B. Shapira, and P. B. Kantor, editors, Recommender Systems Handbook, pages 511--545. Springer US, 2011.Google ScholarGoogle ScholarCross RefCross Ref
  38. Qualtrics. Qualtrics. https://www.qualtrics.com.Google ScholarGoogle Scholar
  39. J. Russell. A circumplex model of affect. Journal of personality and social psychology, 39(6):1161--1178, 1980.Google ScholarGoogle Scholar
  40. N. J. Salkind, editor. Encyclopedia of Research Design. SAGE Publications, Inc., 0 edition, 2010.Google ScholarGoogle ScholarCross RefCross Ref
  41. B. Shneiderman. The eyes have it: A task by data type taxonomy for information visualizations. In Visual Languages, 1996. Proceedings., IEEE Symposium on, pages 336--343. IEEE, 1996. Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. S. Stober and A. Nürnberger. Adaptive music retrieval--a state of the art. Multimedia Tools Appl., 65(3):467--494, Aug. 2013. Google ScholarGoogle ScholarDigital LibraryDigital Library
  43. G. Team. Habu music. {Online; accessed 10-May-2015}.Google ScholarGoogle Scholar
  44. M. Tkal\vci\vc, U. Burnik, and A. Ko\vsir. Using affective parameters in a content-based recommender system for images. User Modeling and User-Adapted Interaction, 20(4):279--311, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  45. M. Tkalcic, A. Kosir, and J. Tasic. Affective recommender systems: the role of emotions in recommender systems. In Proc. The RecSys 2011 Workshop on Human Decision Making in Recommender Systems, pages 9--13. Citeseer, 2011.Google ScholarGoogle Scholar
  46. P. University. WordNet. https://wordnet.princeton.edu.Google ScholarGoogle Scholar
  47. K. Verbert, D. Parra, P. Brusilovsky, and E. Duval. Visualizing recommendations to support exploration, transparency and controllability. In Proceedings of the 2013 international conference on Intelligent user interfaces, IUI '13, pages 351--362, New York, NY, USA, 2013. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  48. X. Wang, D. Rosenblum, and Y. Wang. Context-aware mobile music recommendation for daily activities. In Proceedings of the 20th ACM international conference on Multimedia, pages 99--108. ACM, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  49. Y.-H. Yang, Y.-C. Lin, H. T. Cheng, and H. H. Chen. Mr. emo: music retrieval in the emotion plane. In A. El-Saddik, S. Vuong, C. Griwodz, A. D. Bimbo, K. S. Candan, and A. Jaimes, editors, ACM Multimedia, pages 1003--1004. ACM, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  50. M. Zentner and T. EEROLA. Self-report measures and models. Handbook of Music and Emotion: Theory, Research, Applications, 2011.Google ScholarGoogle Scholar
  51. M. Zentner, D. Grandjean, and K. R. Scherer. Emotions evoked by the sound of music: Characterization, classification, and measurement. Emotion, 8(4):494--521, 2008.Google ScholarGoogle ScholarCross RefCross Ref
  52. S. Zhao, M. X. Zhou, X. Zhang, Q. Yuan, W. Zheng, and R. Fu. Who is doing what and when: Social map-based recommendation for content-centric social web sites. ACM Transactions on Intelligent Systems and Technology (TIST), 3(1):5, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Moodplay: Interactive Mood-based Music Discovery and Recommendation

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        UMAP '16: Proceedings of the 2016 Conference on User Modeling Adaptation and Personalization
        July 2016
        366 pages
        ISBN:9781450343688
        DOI:10.1145/2930238

        Copyright © 2016 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 13 July 2016

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • short-paper

        Acceptance Rates

        UMAP '16 Paper Acceptance Rate21of123submissions,17%Overall Acceptance Rate162of633submissions,26%

        Upcoming Conference

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader