Lei Chen
Meng Wang
ABSTRACT
As users often express their preferences with binary behavior data~(implicit feedback), such as clicking items or buying products, implicit feedback based Collaborative Filtering~(CF) models predict the top ranked items a user might like by leveraging implicit user-item interaction data. For each user, the implicit feedback is divided into two sets: an observed item set with limited observed behaviors, and a large unobserved item set that is mixed with negative item behaviors and unknown behaviors. Given any user preference prediction model, researchers either designed ranking based optimization goals or relied on negative item mining techniques for better optimization. Despite the performance gain of these implicit feedback based models, the recommendation results are still far from satisfactory due to the sparsity of the observed item set for each user. To this end, in this paper, we explore the unique characteristics of the implicit feedback and propose Set2setRank framework for recommendation. The optimization criteria of Set2setRank are two folds: First, we design an item to an item set comparison that encourages each observed item from the sampled observed set is ranked higher than any unobserved item from the sampled unobserved set. Second, we model set level comparison that encourages a margin between the distance summarized from the observed item set and the most "hard'' unobserved item from the sampled negative set. Further, an adaptive sampling technique is designed to implement these two goals. We have to note that our proposed framework is model-agnostic and can be easily applied to most recommendation prediction approaches, and is time efficient in practice. Finally, extensive experiments on three real-world datasets demonstrate the superiority of our proposed approach.
Supplemental Material
- Suhrid Balakrishnan and Sumit Chopra. 2012. Collaborative ranking. In WSDM. 143--152.Google Scholar
- Zhe Cao, Tao Qin, Tie-Yan Liu, Ming-Feng Tsai, and Hang Li. 2007. Learning to rank: from pairwise approach to listwise approach. In ICML . 129--136.Google Scholar
- Dong-Kyu Chae, Jihoo Kim, Duen Horng Chau, and Sang-Wook Kim. 2020. AR-CF: Augmenting Virtual Users and Items in Collaborative Filtering for Addressing Cold-Start Problems. In SIGIR. 1251--1260.Google Scholar
- Chong Chen, Min Zhang, Weizhi Ma, Yiqun Liu, and Shaoping Ma. 2020 c. Jointly non-sampling learning for knowledge graph enhanced recommendation. In SIGIR . 189--198.Google Scholar
- Lei Chen, Le Wu, Richang Hong, Kun Zhang, and Meng Wang. 2020 a. Revisiting Graph Based Collaborative Filtering: A Linear Residual Graph Convolutional Network Approach. In AAAI, Vol. 34. 27--34.Google ScholarCross Ref
- Zhihong Chen, Rong Xiao, Chenliang Li, Gangfeng Ye, Haochuan Sun, and Hongbo Deng. 2020 b. Esam: Discriminative domain adaptation with non-displayed items to improve long-tail performance. In SIGIR. 579--588.Google Scholar
- Yiming Cui, Wanxiang Che, Ting Liu, Bing Qin, Ziqing Yang, Shijin Wang, and Guoping Hu. 2020. Pre-training with whole word masking for chinese bert. In EMNLP. 657--668.Google Scholar
- Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of deep bidirectional transformers for language understanding. In NAACL. 4171--4186.Google Scholar
- Jingtao Ding, Fuli Feng, Xiangnan He, Guanghui Yu, Yong Li, and Depeng Jin. 2018. An improved sampler for bayesian personalized ranking by leveraging view data. In WWW . 13--14.Google Scholar
- Zeno Gantner, Lucas Drumond, Christoph Freudenthaler, and Lars Schmidt-Thieme. 2012. Personalized ranking for non-uniformly sampled items. In SIGKDD. 231--247.Google Scholar
- Mihajlo Grbovic and Haibin Cheng. 2018. Real-time personalization using embeddings for search ranking at airbnb. In SIGKDD . 311--320.Google Scholar
- Xiangnan He, Kuan Deng, Xiang Wang, Yan Li, Yongdong Zhang, and Meng Wang. 2020. Lightgcn: Simplifying and powering graph convolution network for recommendation. In SIGIR. 639--648.Google ScholarDigital Library
- Cheng-Kang Hsieh, Longqi Yang, Yin Cui, Tsung-Yi Lin, Serge Belongie, and Deborah Estrin. 2017. Collaborative metric learning. In WWW. 193--201.Google Scholar
- Shanshan Huang, Shuaiqiang Wang, Tie-Yan Liu, Jun Ma, Zhumin Chen, and Jari Veijalainen. 2015. Listwise collaborative filtering. In SIGIR. 343--352.Google Scholar
- Mohsen Jamali and Martin Ester. 2010. A matrix factorization technique with trust propagation for recommendation in social networks. In RecSys. 135--142.Google Scholar
- Yehuda Koren, Robert Bell, and Chris Volinsky. 2009. Matrix factorization techniques for recommender systems. Computer , Vol. 42, 8 (2009), 30--37.Google ScholarDigital Library
- Defu Lian, Qi Liu, and Enhong Chen. 2020. Personalized Ranking with Importance Sampling. In WWW. 1093--1103.Google Scholar
- Junjie Liang, Jinlong Hu, Shoubin Dong, and Vasant Honavar. 2018. Top-N-Rank: A Scalable List-wise Ranking Method for Recommender Systems. In Big Data . 1052--1058.Google Scholar
- Nathan N Liu, Evan W Xiang, Min Zhao, and Qiang Yang. 2010. Unifying explicit and implicit feedback for collaborative filtering. In ICKM . 1445--1448.Google Scholar
- Qi Liu, Zhenya Huang, Yu Yin, Enhong Chen, Hui Xiong, Yu Su, and Guoping Hu. 2019. Ekt: Exercise-aware knowledge tracing for student performance prediction. TKDE , Vol. 33, 1 (2019), 100--115.Google ScholarDigital Library
- Yong Liu, Peilin Zhao, Aixin Sun, and Chunyan Miao. 2015. A boosting algorithm for item recommendation with implicit feedback. In IJCAI . 1792--1798.Google Scholar
- Hongyu Lu, Min Zhang, Weizhi Ma, Ce Wang, Feng xia, Yiqun Liu, Leyu Lin, and Shaoping Ma. 2019. Effects of User Negative Experience in Mobile News Streaming. In SIGIR. 705--714.Google Scholar
- Mindspore. 2020. . https://www.mindspore.cn/Google Scholar
- Shan Ouyang, Lin Li, Weike Pan, and Zhong Ming. 2019. Asymmetric Bayesian personalized ranking for one-class collaborative filtering. In RecSys . 373--377.Google Scholar
- Rong Pan, Yunhong Zhou, Bin Cao, Nathan N Liu, Rajan Lukose, Martin Scholz, and Qiang Yang. 2008. One-class collaborative filtering. In ICDM. 502--511.Google Scholar
- Weike Pan and Li Chen. 2013a. Cofiset: Collaborative filtering via learning pairwise preferences over item-sets. In SIAM . 180--188.Google Scholar
- Weike Pan and Li Chen. 2013b. Gbpr: Group preference based bayesian personalized ranking for one-class collaborative filtering. In IJCAI. 2691--2697.Google ScholarDigital Library
- Liang Pang, Jun Xu, Qingyao Ai, Yanyan Lan, Xueqi Cheng, and Jirong Wen. 2020. Setrank: Learning a permutation-invariant ranking model for information retrieval. In SIGIR . 499--508.Google ScholarDigital Library
- Lianyong Qi, Ruili Wang, Chunhua Hu, Shancang Li, Qiang He, and Xiaolong Xu. 2019. Time-aware distributed service recommendation with privacy-preservation. Information Sciences , Vol. 480 (2019), 354--364.Google ScholarDigital Library
- Steffen Rendle and Christoph Freudenthaler. 2014. Improving pairwise learning for item recommendation from implicit feedback. In WSDM . 273--282.Google Scholar
- Steffen Rendle, Christoph Freudenthaler, Zeno Gantner, and Lars Schmidt-Thieme. 2009. BPR: Bayesian personalized ranking from implicit feedback. In UAI. 452--461.Google ScholarDigital Library
- Shaoyun Shi, Weizhi Ma, Min Zhang, Yongfeng Zhang, Xinxing Yu, Houzhi Shan, Yiqun Liu, and Shaoping Ma. 2020. Beyond User Embedding Matrix: Learning to Hash for Modeling Large-Scale Users in Recommendation. In SIGIR. 319--328.Google Scholar
- Yue Shi, Alexandros Karatzoglou, Linas Baltrunas, Martha Larson, Alan Hanjalic, and Nuria Oliver. 2012a. Tfmap: optimizing map for top-n context-aware recommendation. In SIGIR . 155--164.Google Scholar
- Yue Shi, Alexandros Karatzoglou, Linas Baltrunas, Martha Larson, Nuria Oliver, and Alan Hanjalic. 2012b. CLiMF: learning to maximize reciprocal rank with collaborative less-is-more filtering. In RecSys . 139--146.Google Scholar
- Yue Shi, Martha Larson, and Alan Hanjalic. 2010. List-wise learning to rank with matrix factorization for collaborative filtering. In RecSys. 269--272.Google Scholar
- Harald Steck. 2011. Item popularity and recommendation accuracy. In RecSys. 125--132.Google Scholar
- Peijie Sun, Le Wu, and Meng Wang. 2018. Attentive recurrent social recommendation. In SIGIR. 185--194.Google Scholar
- Chao Wang, Hengshu Zhu, Chen Zhu, Chuan Qin, and Hui Xiong. 2020. SetRank: A Setwise Bayesian Approach for Collaborative Ranking from Implicit Feedback.. In AAAI. 6127--6136.Google Scholar
- Huazheng Wang, Sonwoo Kim, Eric McCord-Snook, Qingyun Wu, and Hongning Wang. 2019 c. Variance reduction in gradient exploration for online learning to rank. In SIGIR . 835--844.Google Scholar
- Pengfei Wang, Hanxiong Chen, Yadong Zhu, Huawei Shen, and Yongfeng Zhang. 2019 a. Unified collaborative filtering over graph embeddings. In SIGIR. 155--164.Google Scholar
- Shuaiqiang Wang, Shanshan Huang, Tie-Yan Liu, Jun Ma, Zhumin Chen, and Jari Veijalainen. 2016. Ranking-oriented collaborative filtering: A listwise approach. TOIS , Vol. 35, 2 (2016), 1--28.Google ScholarDigital Library
- Xiang Wang, Xiangnan He, Meng Wang, Fuli Feng, and Tat-Seng Chua. 2019 b. Neural graph collaborative filtering. In SIGIR. 165--174.Google Scholar
- Ga Wu, Maksims Volkovs, Chee Loong Soon, Scott Sanner, and Himanshu Rai. 2019. Noise Contrastive Estimation for One-Class Collaborative Filtering. In SIGIR . 135--144.Google Scholar
- Le Wu, Xiangnan He, Xiang Wang, Kun Zhang, and Meng Wang. 2021. A Survey on Neural Recommendation: From Collaborative Filtering to Content and Context Enriched Recommendation. arXiv preprint arXiv:2104.13030 (2021).Google Scholar
- Liwei Wu, Cho-Jui Hsieh, and James Sharpnack. 2018. SQL-Rank: A Listwise Approach to Collaborative Ranking. In ICML. 5315--5324.Google Scholar
- Le Wu, Yonghui Yang, Kun Zhang, Richang Hong, Yanjie Fu, and Meng Wang. 2020. Joint item recommendation and attribute inference: An adaptive graph convolutional network approach. In SIGIR. 679--688.Google Scholar
- Fen Xia, Tie-Yan Liu, Jue Wang, Wensheng Zhang, and Hang Li. 2008. Listwise approach to learning to rank: theory and algorithm. In ICML. 1192--1199.Google Scholar
- Hong-Jian Xue, Xinyu Dai, Jianbing Zhang, Shujian Huang, and Jiajun Chen. 2017. Deep Matrix Factorization Models for Recommender Systems.. In IJCAI. 3203--3209.Google Scholar
- Hsiang-Fu Yu, Mikhail Bilenko, and Chih-Jen Lin. 2017. Selection of negative samples for one-class matrix factorization. In SIAM . 363--371.Google Scholar
- Runlong Yu, Qi Liu, Yuyang Ye, Mingyue Cheng, Enhong Chen, and Jianhui Ma. 2020. Collaborative List-and-Pairwise Filtering from Implicit Feedback. TKDE (2020).Google Scholar
- Runlong Yu, Yunzhou Zhang, Yuyang Ye, Le Wu, Chao Wang, Qi Liu, and Enhong Chen. 2018. Multiple pairwise ranking with implicit feedback. In CIKM. 1727--1730.Google Scholar
- Wenhui Yu and Zheng Qin. 2020. Sampler Design for Implicit Feedback Data by Noisy-label Robust Learning. In SIGIR . 861--870.Google Scholar
- Hafed Zarzour, Ziad Al-Sharif, Mahmoud Al-Ayyoub, and Yaser Jararweh. 2018. A new collaborative filtering recommendation algorithm based on dimensionality reduction and clustering techniques. In ICICS. 102--106.Google Scholar
- Weinan Zhang, Tianqi Chen, Jun Wang, and Yong Yu. 2013. Optimizing top-n collaborative filtering via dynamic negative item sampling. In SIGIR . 785--788.Google Scholar
- Hao Zhong, Weike Pan, Congfu Xu, Zhi Yin, and Zhong Ming. 2014. Adaptive pairwise preference learning for collaborative recommendation with implicit feedbacks. In CIKM. 1999--2002.Google Scholar
Index Terms
- Set2setRank: Collaborative Set to Set Ranking for Implicit Feedback based Recommendation
Recommendations
Generalized Collaborative Personalized Ranking for Recommendation
Web and Big DataAbstractData sparsity is a common problem in collaborative ranking for personalized recommendation with implicit feedback. Several previous work tried to ‘borrow’ feedback information from users’ neighborhood as their prior preferences to alleviate this ...
One-class collaborative filtering based on rating prediction and ranking prediction
One-Class Collaborative Filtering (OCCF) has recently received much attention in recommendation communities due to their close relationship with real industry problem settings. However, the problem with previous research studies on OCCF is that they ...
Collaborative Multi-objective Ranking
CIKM '18: Proceedings of the 27th ACM International Conference on Information and Knowledge ManagementThis paper proposes to jointly resolve row-wise and column-wise ranking problems when an explicit rating matrix is given. The row-wise ranking problem, also known as personalized ranking, aims to build user-specific models such that the correct order of ...
Comments