João Sá
ABSTRACT
Personalized algorithms focusing uniquely on accuracy might provide highly relevant recommendations, but the recommended items could be too similar to current users' preferences. Therefore, recommenders might prevent users from exploring new products and brands (filter bubbles). This is especially critical for luxury fashion recommendations because luxury shoppers expect to discover exclusive and rare items. Thus, recommender systems for fashion need to consider diversity and elevate the shopping experience by recommending new brands and products from the catalog. In this work, we explored a handful of diversification strategies to rerank the output of a relevance-focused recommender system. Subsequently, we conducted a multi-objective offline experiment optimizing for relevance and diversity simultaneously. We measured diversity with commonly used metrics such as coverage, serendipity, and neighborhood distance, whereas, for relevance, we selected ranking metrics such as recall. The best diversification strategy offline improved user engagement by 2% in click-through rate and presented an uplift of 46% in distinct brands recommended when AB tested against real users. These results reinforced the importance of considering accuracy and diversity metrics when developing a recommender system.
Supplemental Material
- Gediminas Adomavicius and Young Ok Kwon. 2012. Improving aggregate recommendation diversity using ranking-based techniques. IEEE Transactions on Knowledge and Data Engineering 24 (2012), 896--911.Google Scholar
Digital Library
- Rubi Boim, Tova Milo, and Slava Novgorodov. 2011. Diversification and Refinement in Collaborative Filtering Recommender (Full Version).Google Scholar
- Keith Bradley and Barry Smyth. 2001. Improving Recommendation Diversity.Google Scholar
- Mouzhi Ge, Carla Delgado-Battenfeld, and Dietmar Jannach. 2010. Beyond accuracy: Evaluating recommender systems by coverage and serendipity. In RecSys'10 - Proceedings of the 4th ACM Conference on Recommender Systems. 257--260. https://doi.org/10.1145/1864708.1864761Google ScholarDigital Library
- Diogo Goncalves, Liwei Liu, João Sá, Tiago Otto, Ana Magalhães, and Paula Brochado. 2021. The Importance of Brand Affinity in Luxury Fashion Recommendations. In Recommender Systems in Fashion and Retail, Nima Dokoohaki, Shatha Jaradat, Humberto Jesús Corona Pampín, and Reza Shirvany (Eds.). Springer International Publishing, Cham, 3--19.Google Scholar
- Jonathan L. Herlocker, Joseph A. Konstan, Loren G. Terveen, and John T. Riedl. 2004. Evaluating collaborative filtering recommender systems. ACM Trans. Inf. Syst. 22 (January 2004), 5--53. Issue 1. https://doi.org/10.1145/963770.963772Google ScholarDigital Library
- Rong Hu and Pearl Pu. 2011. Helping Users Perceive Recommendation Diversity. http://paw-project.sourceforge.netGoogle Scholar
- Neil Hurley and Mi Zhang. 2011. Novelty and Diversity in top-N recommendation-Analysis and evaluation. ACM Transactions on Internet Technology 10 (3 2011).Google Scholar
- Chang Li, Haoyun Feng, and Maarten De Rijke. 2020. Cascading Hybrid Bandits: Online Learning to Rank for Relevance and Diversity. In RecSys 2020 - 14th ACM Conference on Recommender Systems. Association for Computing Machinery, Inc, 33--42. https://doi.org/10.1145/3383313.3412245Google ScholarDigital Library
- Rishabh Mehrotra, Niannan Xue, and Mounia Lalmas. 2020. Bandit Based Optimization of Multiple Objectives on a Music Streaming Platform. Association for Computing Machinery, New York, NY, USA, 3224--3233. https://doi.org/10.1145/3394486.3403374Google ScholarDigital Library
- Patrick Ngatchou, Anahita Zarei, and M A El-Sharkawi. 2005. Pareto Multi Objective Optimization.Google Scholar
- Pedro Nogueira, Diogo Gonçalves, Vanessa Queiroz Marinho, Ana Rita Magalhães, and João Sá. 2022. A Critical Analysis of Offline Evaluation Decisions Against Online Results: A Real-Time Recommendations Case Study. In Recommender Systems in Fashion and Retail. Springer International Publishing, Cham, 73--94.Google Scholar
- Javier Parapar and Filip Radlinski. 2021. Towards unified metrics for accuracy and diversity for recommender systems. In RecSys 2021 - 15th ACM Conference on Recommender Systems. Association for Computing Machinery, Inc, 75--84. https://doi.org/10.1145/3460231.3474234Google ScholarDigital Library
- Francesco Ricci, Lior Rokach, Bracha Shapira, and Paul B. Kantor. 2011. Recommender systems handbook. Springer, New York; London.Google ScholarDigital Library
- Guy Shani and Asela Gunawardana. 2011. Evaluating Recommendation Systems. Springer US, Boston, MA. 257--297 pages. https://doi.org/10.1007/978-0--387--85820--3_8Google Scholar
- Barry Smyth and Paul McClave. 2001. Similarity vs. Diversity. In Proceedings of the 4th International Conference on Case-Based Reasoning.Google Scholar
- Saúl Vargas, Sandoval Supervisor, and Pablo Castells Azpilicueta. 2012. Novelty and Diversity Enhancement and Evaluation in Recommender Systems.Google Scholar
- Yuan Cao Zhang, Diarmuid Ó Séaghdha, Daniele Quercia, and Tamas Jambor. 2012. Auralist: introducing serendipity into music recommendation. In WSDM '12. Association for Computing Machinery, New York, NY, USA.Google ScholarDigital Library
- Cai-Nicolas Ziegler, Sean M McNee, Gebäude Nr, Joseph A Konstan, and Georg Lausen. 2005. Improving Recommendation Lists Through Topic Diversification.Google Scholar
Index Terms
- Diversity Vs Relevance: A Practical Multi-objective Study in Luxury Fashion Recommendations
Recommendations
A Clustering Approach for Personalizing Diversity in Collaborative Recommender Systems
UMAP '17: Proceedings of the 25th Conference on User Modeling, Adaptation and PersonalizationMuch of the focus of recommender systems research has been on the accurate prediction of users' ratings for unseen items. Recent work has suggested that objectives such as diversity and novelty in recommendations are also important factors in the ...
A Novel Framework for Improving Recommender Diversity
International Workshop on Behavior and Social Informatics on Behavior and Social Computing - Volume 8178Recommender systems are being used to assist users in finding relevant items from a large set of alternatives in many online applications. However, while most research up to this point has focused on improving the accuracy of recommender systems, other ...
Enhancing the diversity of conversational collaborative recommendations: a comparison
In conversational collaborative recommender systems, user feedback influences the recommendations. We report mechanisms for enhancing the diversity of the recommendations made by collaborative recommenders. We focus on techniques for increasing ...
Comments