Patrik Dokoupil
ABSTRACT
Group recommendations are a specific case of recommender systems (RS), where instead of recommending for each individual independently, shared recommendations are produced for groups of users. Usually, group recommendation techniques (i.e., group aggregators) are built on top of common ”single-user” RS and the resulting group recommendation should reflect both the overall utility of the recommendation as well as fairness among the utilities of individual group members.
Off-line evaluations of group recommendations were so far resolved either as a tightly coupled pair with the underlying RS or in a decoupled fashion. In the latter case, the relevance scores estimated by underlying RS serves as a ground truth for the evaluation of group aggregators. Both coupled and decoupled evaluation may suffer from different biases that provide illicit advantages to some classes of group recommending strategies.
In this paper, we focus on the decoupled evaluation protocol and possible polarity bias of the underlying RS. We define polarity bias as situations when RS either locally or globally under-estimate or over-estimate the true user preferences. We propose several polarity de-biasing strategies and in the experimental part, we focus on the capability of group aggregation strategies to cope with the polarity biased input data.
Supplemental Material
- Himan Abdollahpouri, Masoud Mansoury, Robin Burke, and Bamshad Mobasher. 2020. The Connection Between Popularity Bias, Calibration, and Fairness in Recommendation. Association for Computing Machinery, New York, NY, USA, 726–731. https://doi.org/10.1145/3383313.3418487Google Scholar
- Asia J. Biega, Krishna P. Gummadi, and Gerhard Weikum. 2018. Equity of Attention: Amortizing Individual Fairness in Rankings. In SIGIR ’18 (Ann Arbor, MI, USA). ACM, 405–414. https://doi.org/10.1145/3209978.3210063Google Scholar
- Federica Cena, Cristina Gena, Pierluigi Grillo, Tsvi Kuflik, Fabiana Vernero, and Alan J. Wecker. 2017. How scales influence user rating behaviour in recommender systems. Behaviour & Information Technology 36, 10 (2017), 985–1004. https://doi.org/10.1080/0144929X.2017.1322145Google ScholarDigital Library
- F. Maxwell Harper and Joseph A. Konstan. 2015. The MovieLens Datasets: History and Context. ACM Trans. Interact. Intell. Syst. 5, 4, Article 19 (Dec. 2015), 19 pages.Google ScholarDigital Library
- Mesut Kaya, Derek Bridge, and Nava Tintarev. 2020. Ensuring Fairness in Group Recommendations by Rank-Sensitive Balancing of Relevance. In Fourteenth ACM Conference on Recommender Systems(Virtual Event, Brazil) (RecSys ’20). Association for Computing Machinery, New York, NY, USA, 101–110. https://doi.org/10.1145/3383313.3412232Google ScholarDigital Library
- Yunqi Li, Yingqiang Ge, and Yongfeng Zhang. 2021. Tutorial on Fairness of Machine Learning in Recommender Systems. Association for Computing Machinery, New York, NY, USA, 2654–2657. https://doi.org/10.1145/3404835.3462814Google Scholar
- Ladislav Malecek and Ladislav Peska. 2021. Fairness-Preserving Group Recommendations With User Weighting. In Adjunct Proceedings of the 29th ACM Conference on User Modeling, Adaptation and Personalization (Utrecht, Netherlands) (UMAP ’21). Association for Computing Machinery, New York, NY, USA, 4–9. https://doi.org/10.1145/3450614.3461679Google ScholarDigital Library
- Ladislav Malecek and Ladislav Peska. 2021. Fairness-Preserving Group Recommendations With User Weighting. In UMAP ’21. ACM, 4–9. https://doi.org/10.1145/3450614.3461679Google Scholar
- Judith Masthoff. 2004. Group Modeling: Selecting a Sequence of Television Items to Suit a Group of Viewers. User Modeling and User-Adapted Interaction 14, 1 (01 Feb 2004), 37–85. https://doi.org/10.1023/B:USER.0000010138.79319.fdGoogle Scholar
- Judith Masthoff. 2011. Group Recommender Systems: Combining Individual Models. Springer US, Boston, MA, 677–702. https://doi.org/10.1007/978-0-387-85820-3_21Google Scholar
- Judith Masthoff. 2015. Group Recommender Systems: Aggregation, Satisfaction and Group Attributes. Springer US, Boston, MA, 743–776. https://doi.org/10.1007/978-1-4899-7637-6_22Google Scholar
- Judith Masthoff and Albert Gatt. 2006. In pursuit of satisfaction and the prevention of embarrassment: affective state in group recommender systems. User Model User-adapt Interact 16, 3 (01 Sep 2006), 281–319. https://doi.org/10.1007/s11257-006-9008-3Google Scholar
- Sergio Oramas, Vito Claudio Ostuni, Tommaso Di Noia, Xavier Serra, and Eugenio Di Sciascio. 2016. Sound and Music Recommendation with Knowledge Graphs. ACM Trans. Intell. Syst. Technol. 8, 2, Article 21 (Oct. 2016), 21 pages. https://doi.org/10.1145/2926718Google ScholarDigital Library
- Javier Parapar and Filip Radlinski. 2021. Towards Unified Metrics for Accuracy and Diversity for Recommender Systems. In RecSys ’21. ACM, 75–84. https://doi.org/10.1145/3460231.3474234Google Scholar
- Ladislav Peska and Ladislav Malecek. 2021. Coupled or Decoupled Evaluation for Group Recommendation Methods?. In Proceedings of the Perspectives on the Evaluation of Recommender Systems Workshop 2021 co-located with the 15th ACM Conference on Recommender Systems (RecSys 2021), Amsterdam, The Netherlands, September 25, 2021(CEUR Workshop Proceedings, Vol. 2955), Eva Zangerle, Christine Bauer, and Alan Said (Eds.). CEUR-WS.org. http://ceur-ws.org/Vol-2955/paper1.pdfGoogle Scholar
- István Pilászy, Dávid Zibriczky, and Domonkos Tikk. 2010. Fast Als-Based Matrix Factorization for Explicit and Implicit Feedback Datasets. In Proceedings of the Fourth ACM Conference on Recommender Systems (Barcelona, Spain) (RecSys ’10). Association for Computing Machinery, New York, NY, USA, 71–78. https://doi.org/10.1145/1864708.1864726Google ScholarDigital Library
- Dimitris Sacharidis. 2019. Top-N Group Recommendations with Fairness. In Proceedings of the 34th ACM/SIGAPP Symposium on Applied Computing (Limassol, Cyprus) (SAC ’19). Association for Computing Machinery, New York, NY, USA, 1663–1670. https://doi.org/10.1145/3297280.3297442Google ScholarDigital Library
- Tobias Schnabel, Adith Swaminathan, Ashudeep Singh, Navin Chandak, and Thorsten Joachims. 2016. Recommendations as Treatments: Debiasing Learning and Evaluation. In Proceedings of The 33rd International Conference on Machine Learning(Proceedings of Machine Learning Research, Vol. 48), Maria Florina Balcan and Kilian Q. Weinberger (Eds.). PMLR, New York, New York, USA, 1670–1679.Google Scholar
- Dimitris Serbos, Shuyao Qi, Nikos Mamoulis, Evaggelia Pitoura, and Panayiotis Tsaparas. 2017. Fairness in Package-to-Group Recommendations. In Proceedings of the 26th International Conference on World Wide Web (Perth, Australia) (WWW ’17). International World Wide Web Conferences Steering Committee, Republic and Canton of Geneva, CHE, 371–379. https://doi.org/10.1145/3038912.3052612Google Scholar
- Lin Xiao, Zhang Min, Zhang Yongfeng, Gu Zhaoquan, Liu Yiqun, and Ma Shaoping. 2017. Fairness-Aware Group Recommendation with Pareto-Efficiency. In Proceedings of the Eleventh ACM Conference on Recommender Systems (Como, Italy) (RecSys ’17). Association for Computing Machinery, New York, NY, USA, 107–115. https://doi.org/10.1145/3109859.3109887Google ScholarDigital Library
- Longqi Yang, Yin Cui, Yuan Xuan, Chenyang Wang, Serge Belongie, and Deborah Estrin. 2018. Unbiased Offline Recommender Evaluation for Missing-Not-at-Random Implicit Feedback. In Proceedings of the 12th ACM Conference on Recommender Systems (Vancouver, British Columbia, Canada) (RecSys ’18). Association for Computing Machinery, New York, NY, USA, 279–287. https://doi.org/10.1145/3240323.3240355Google ScholarDigital Library
Recommendations
Fairness-preserving Group Recommendations With User Weighting
UMAP '21: Adjunct Proceedings of the 29th ACM Conference on User Modeling, Adaptation and PersonalizationGroup recommendations are an extension of ”single-user” personalized recommender systems (RS), where the final recommendations should comply with preferences of several group members. An important challenge in group RS is the problem of fairness, i.e., ...
Single User Group Recommendations
UMAP '22 Adjunct: Adjunct Proceedings of the 30th ACM Conference on User Modeling, Adaptation and PersonalizationGoing to restaurants is also a social activity; people often go to restaurants with family, friends, or colleagues. However, most restaurant finder systems, such as TripAdvisor, allow users to search for restaurants matching only one user’s ...
Naïve filterbots for robust cold-start recommendations
KDD '06: Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data miningThe goal of a recommender system is to suggest items of interest to a user based on historical behavior of a community of users. Given detailed enough history, item-based collaborative filtering (CF) often performs as well or better than almost any ...
Comments