skip to main content
10.1145/3539618.3592033acmconferencesArticle/Chapter ViewAbstractPublication PagesirConference Proceedingsconference-collections
short-paper

Optimizing Reciprocal Rank with Bayesian Average for improved Next Item Recommendation

Published:18 July 2023Publication History

ABSTRACT

Next item recommendation is a crucial task of session-based recommendation. However, the gap between the optimization objective (Binary Cross Entropy) and the ranking metric (Mean Reciprocal Rank) has not been well-explored, resulting in sub-optimal recommendations. In this paper, we propose a novel objective function, namely Adjusted-RR, to directly optimize Mean Reciprocal Rank. Specifically, Adjusted-RR adopts Bayesian Average to adjust Reciprocal Rank loss with Normal Rank loss by creating position-aware weights between them. Adjusted-RR is a plug-and-play objective that is compatible with various models. We apply Adjusted-RR on two base models and two datasets, and experimental results show that it makes a significant improvement in the next item recommendation.

Skip Supplemental Material Section

Supplemental Material

SIGIR23-srp9789.mp4

mp4

120.7 MB

References

  1. Suhrid Balakrishnan and Sumit Chopra. 2012. Collaborative ranking. In WSDM. ACM, 143--152. https://doi.org/10.1145/2124295.2124314Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Andrew Brown, Weidi Xie, Vicky Kalogeiton, and Andrew Zisserman. 2020. Smooth-AP: Smoothing the Path Towards Large-Scale Image Retrieval. In ECCV, Vol. 12354. 677--694. https://doi.org/10.1007/978-3-030-58545-7_39Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Fatih Cakir, Kun He, Xide Xia, Brian Kulis, and Stan Sclaroff. 2019. Deep Metric Learning to Rank. In CVPR. 1861--1870. https://doi.org/10.1109/CVPR.2019.00196Google ScholarGoogle ScholarCross RefCross Ref
  4. Paul Henderson and Vittorio Ferrari. 2016. End-to-End Training of Object Class Detectors for Mean Average Precision. In ACCV, Vol. 10115. Springer, 198--213. https://doi.org/10.1007/978-3-319-54193-8_13Google ScholarGoogle ScholarCross RefCross Ref
  5. Alan Herschtal and Bhavani Raskutti. 2004. Optimising area under the ROC curve using gradient descent. In ICML, Vol. 69. ACM. https://doi.org/10.1145/1015330.1015366Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Hang Li. 2011. A Short Introduction to Learning to Rank. IEICE Transactions, Vol. 94-D (10 2011), 1854--1862.Google ScholarGoogle ScholarCross RefCross Ref
  7. Pritish Mohapatra, Michal Rolínek, C. V. Jawahar, Vladimir Kolmogorov, and M. Pawan Kumar. 2018. Efficient Optimization for Rank-Based Loss Functions. In CVPR. Computer Vision Foundation / IEEE Computer Society, 3693--3701.Google ScholarGoogle Scholar
  8. Yitong Pang, Lingfei Wu, Qi Shen, Yiming Zhang, Zhihua Wei, Fangli Xu, Ethan Chang, Bo Long, and Jian Pei. 2022. Heterogeneous Global Graph Neural Networks for Personalized Session-based Recommendation. In WSDM. ACM, 775--783. https://doi.org/10.1145/3488560.3498505Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Michal Rolinek, Vit Musil, Anselm Paulus, Marin Vlastelica, Claudio Michaelis, and Georg Martius. 2020. Optimizing Rank-Based Metrics With Blackbox Differentiation. In CVPR.Google ScholarGoogle Scholar
  10. Song-Qing Shen, Bin-Bin Yang, and Wei Gao. 2020. AUC Optimization with a Reject Option. In AAAI. AAAI Press, 5684--5691. https://ojs.aaai.org/index.php/AAAI/article/view/6023Google ScholarGoogle Scholar
  11. Yue Shi, Alexandros Karatzoglou, Linas Baltrunas, Martha A. Larson, Nuria Oliver, and Alan Hanjalic. 2012. CLiMF: learning to maximize reciprocal rank with collaborative less-is-more filtering. In RecSys. ACM, 139--146. https://doi.org/10.1145/2365952.2365981Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Yue Shi, Martha A. Larson, and Alan Hanjalic. 2010. List-wise learning to rank with matrix factorization for collaborative filtering. In RecSys. ACM, 269--272. https://doi.org/10.1145/1864708.1864764Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Hyun Oh Song, Yu Xiang, Stefanie Jegelka, and Silvio Savarese. 2016. Deep Metric Learning via Lifted Structured Feature Embedding. In CVPR. IEEE Computer Society, 4004--4012. https://doi.org/10.1109/CVPR.2016.434Google ScholarGoogle ScholarCross RefCross Ref
  14. Shuang Tang, Fangyuan Luo, and Jun Wu. 2022. Smooth-AUC: Smoothing the Path Towards Rank-based CTR Prediction. In SIGIR. ACM, 2400--2404. https://doi.org/10.1145/3477495.3531865Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Shoujin Wang, Longbing Cao, Yan Wang, Quan Z. Sheng, Mehmet A. Orgun, and Defu Lian. 2022. A Survey on Session-based Recommender Systems. ACM Comput. Surv., Vol. 54, 7 (2022), 154:1--154:38. https://doi.org/10.1145/3465401Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Ziyang Wang, Wei Wei, Gao Cong, Xiao-Li Li, Xianling Mao, and Minghui Qiu. 2020. Global Context Enhanced Graph Neural Networks for Session-based Recommendation. In SIGIR. ACM, 169--178. https://doi.org/10.1145/3397271.3401142Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Shu Wu, Yuyuan Tang, Yanqiao Zhu, Liang Wang, Xing Xie, and Tieniu Tan. 2019a. Session-Based Recommendation with Graph Neural Networks. In AAAI. AAAI Press, 346--353. https://doi.org/10.1609/aaai.v33i01.3301346Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Shu Wu, Yuyuan Tang, Yanqiao Zhu, Liang Wang, Xing Xie, and Tieniu Tan. 2019b. Session-Based Recommendation with Graph Neural Networks. In AAAI. AAAI Press, 346--353. https://doi.org/10.1609/aaai.v33i01.3301346Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Mengqi Zhang, Shu Wu, Meng Gao, Xin Jiang, Ke Xu, and Liang Wang. 2022. Personalized Graph Neural Networks With Attention Mechanism for Session-Aware Recommendation. IEEE Trans. Knowl. Data Eng., Vol. 34, 8 (2022), 3946--3957. https://doi.org/10.1109/TKDE.2020.3031329Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Optimizing Reciprocal Rank with Bayesian Average for improved Next Item Recommendation

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        SIGIR '23: Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval
        July 2023
        3567 pages
        ISBN:9781450394086
        DOI:10.1145/3539618

        Copyright © 2023 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 18 July 2023

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • short-paper

        Acceptance Rates

        Overall Acceptance Rate792of3,983submissions,20%
      • Article Metrics

        • Downloads (Last 12 months)157
        • Downloads (Last 6 weeks)17

        Other Metrics

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader