skip to main content
10.1145/3539618.3592053acmconferencesArticle/Chapter ViewAbstractPublication PagesirConference Proceedingsconference-collections
short-paper

Review-based Multi-intention Contrastive Learning for Recommendation

Published: 18 July 2023 Publication History

Abstract

Real recommendation systems contain various features, which are often high-dimensional, sparse, and difficult to learn effectively. In addition to numerical features, user reviews contain rich semantic information including user preferences, which are used as auxiliary features by researchers. The methods of supplementing data features based on reviews have certain effects. However, most of them simply concatenate review representations and other features together, without considering that the text representation contains a lot of noise information. In addition, the important intentions contained in user reviews are not modeled effectively. In order to solve the above problems, we propose a novel Review-based Multi-intention Contrastive Learning (RMCL) method. In detail, RMCL proposes an intention representation method based on mixed Gaussian distribution hypothesis. Further, RMCL adopts a multi-intention contrastive strategy, which establishes a fine-grained connection between user reviews and item reviews. Extensive experiments on five real-world datasets demonstrate significant improvements of our proposed RMCL model over the state-of-the-art methods.

Supplemental Material

MP4 File
In our presentation video, we introduce the background and methods of the research in detail. Real recommendation systems contain various features, which are often difficult to learn. In addition to numerical features, user reviews contain rich semantic information including user preferences, which are used as auxiliary features by researchers. However, the important intentions contained in reviews are not effectively modeled in previous work. Therefore, we propose a novel review-based multi-intention contrastive learning (RMCL) method. In detail, RMCL proposes an intention representation method based on mixed Gaussian distribution hypothesis. Further, RMCL adopts a multi-intention contrastive strategy, which establishes a fine-grained connection between user reviews and item reviews. Extensive experiments on five real-world datasets demonstrate effectiveness of our proposed RMCL model over the baseline methods.

References

[1]
Yijin Cai, Yilei Wang, Weijin Wang, and Wenting Chen. 2022. RI-GCN: Reviewaware Interactive Graph Convolutional Network for Review-based Item Recommendation. In 2022 IEEE International Conference on Big Data (Big Data). IEEE, 475--484.
[2]
Chong Chen, Min Zhang, Yiqun Liu, and Shaoping Ma. 2018. Neural attentional rating regression with review-level explanations. In Proceedings of the 2018 World Wide Web Conference. 1583--1592.
[3]
Yongjun Chen, Zhiwei Liu, Jia Li, Julian McAuley, and Caiming Xiong. 2022. Intent contrastive learning for sequential recommendation. In Proceedings of the ACM Web Conference 2022. 2172--2182.
[4]
Yoonhyuk Choi, Jiho Choi, Taewook Ko, Hyungho Byun, and Chong-Kwon Kim. 2022. Based Domain Disentanglement without Duplicate Users or Contexts for Cross-Domain Recommendation. In Proceedings of the 31st ACM International Conference on Information & Knowledge Management. 293--303.
[5]
Paul Covington, Jay Adams, and Emre Sargin. 2016. Deep neural networks for youtube recommendations. In Proceedings of the 10th ACM conference on recommender systems. 191--198.
[6]
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018).
[7]
Xin Dong, Jingchao Ni, Wei Cheng, Zhengzhang Chen, Bo Zong, Dongjin Song, Yanchi Liu, Haifeng Chen, and Gerard De Melo. 2020. Asymmetrical hierarchical networks with attentive interactions for interpretable review-based recommendation. In Proceedings of the AAAI conference on artificial intelligence, Vol. 34. 7667--7674.
[8]
Jingyue Gao, Yang Lin, Yasha Wang, Xiting Wang, Zhao Yang, Yuanduo He, and Xu Chu. 2020. Set-sequence-graph: A multi-view approach towards exploiting reviews for recommendation. In Proceedings of the 29th ACM International Conference on Information & Knowledge Management. 395--404.
[9]
Xinyu Guan, Zhiyong Cheng, Xiangnan He, Yongfeng Zhang, Zhibo Zhu, Qinke Peng, and Tat-Seng Chua. 2019. Attentive aspect modeling for review-aware recommendation. ACM Transactions on Information Systems (TOIS) 37, 3 (2019), 1--27.
[10]
Xiangnan He, Lizi Liao, Hanwang Zhang, Liqiang Nie, Xia Hu, and Tat-Seng Chua. 2017. Neural collaborative filtering. In Proceedings of the 26th international conference on world wide web. 173--182.
[11]
Yidan Hu, Yong Liu, Chunyan Miao, Gongqi Lin, and Yuan Miao. 2022. Aspectguided syntax graph learning for explainable recommendation. IEEE Transactions on Knowledge and Data Engineering (2022).
[12]
Samuel Humeau, Kurt Shuster, Marie-Anne Lachaux, and Jason Weston. 2019. Poly-encoders: Transformer architectures and pre-training strategies for fast and accurate multi-sentence scoring. arXiv preprint arXiv:1905.01969 (2019).
[13]
Donghyun Kim, Chanyoung Park, Jinoh Oh, Sungyoung Lee, and Hwanjo Yu. 2016. Convolutional matrix factorization for document context-aware recommendation. In Proceedings of the 10th ACM conference on recommender systems. 233--240.
[14]
Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014).
[15]
Himabindu Lakkaraju, Julian McAuley, and Jure Leskovec. 2013. What's in a name? understanding the interplay between titles, content, and communities in social media. In Proceedings of the International AAAI Conference on Web and Social Media, Vol. 7.
[16]
Bohan Li, Hao Zhou, Junxian He, MingxuanWang, Yiming Yang, and Lei Li. 2020. On the sentence embeddings from pre-trained language models. arXiv preprint arXiv:2011.05864 (2020).
[17]
Zhe Li, Honglong Chen, Zhichen Ni, Xiaogang Deng, Baodi Liu, and Weifeng Liu. 2022. ARPCNN: Auxiliary Review-Based Personalized Attentional CNN for Trustworthy Recommendation. IEEE Transactions on Industrial Informatics 19, 1 (2022), 1018--1029.
[18]
Donghua Liu, Jing Li, Bo Du, Jun Chang, and Rong Gao. 2019. Daml: Dual attention mutual learning between ratings and reviews for item recommendation. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 344--352.
[19]
Hongtao Liu, Wenjun Wang, Hongyan Xu, Qiyao Peng, and Pengfei Jiao. 2020. Neural unified review recommendation with cross attention. In Proceedings of the 43rd international ACM SIGIR conference on research and development in information retrieval. 1789--1792.
[20]
Weiming Liu, Xiaolin Zheng, Mengling Hu, and Chaochao Chen. 2022. Collaborative Filtering with Attribution Alignment for Review-based Non-overlapped Cross Domain Recommendation. In Proceedings of the ACM Web Conference 2022. 1181--1190.
[21]
Ping Nie, Yuyu Zhang, Xiubo Geng, Arun Ramamurthy, Le Song, and Daxin Jiang. 2020. Dc-bert: Decoupling question and document for efficient contextual encoding. In Proceedings of the 43rd international ACM SIGIR conference on research and development in information retrieval. 1829--1832.
[22]
Sicheng Pan, Dongsheng Li, Hansu Gu, Tun Lu, Xufang Luo, and Ning Gu. 2022. Accurate and Explainable Recommendation via Review Rationalization. In Proceedings of the ACM Web Conference 2022. 3092--3101.
[23]
Nicole Peinelt, Dong Nguyen, and Maria Liakata. 2020. tBERT: Topic models and BERT joining forces for semantic similarity detection. In Proceedings of the 58th annual meeting of the association for computational linguistics. 7047--7055.
[24]
Qiyao Peng, Hongtao Liu, Yang Yu, Hongyan Xu, Weidi Dai, and Pengfei Jiao. 2020. Mutual Self Attention Recommendation with Gated Fusion Between Ratings and Reviews. In International Conference on Database Systems for Advanced Applications. Springer, 540--556.
[25]
Pengpeng Qiao, Zhiwei Zhang, Zhetao Li, Yuanxing Zhang, Kaigui Bian, Yanzhou Li, and Guoren Wang. 2022. TAG: Joint Triple-hierarchical Attention and GCN for Review-based Social Recommender System. IEEE Transactions on Knowledge and Data Engineering (2022).
[26]
Dimitrios Rafailidis and Fabio Crestani. 2019. Adversarial training for reviewbased recommendations. In Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval. 1057--1060.
[27]
Nils Reimers and Iryna Gurevych. 2019. Sentence-bert: Sentence embeddings using siamese bert-networks. arXiv preprint arXiv:1908.10084 (2019).
[28]
Sungyong Seo, Jing Huang, Hao Yang, and Yan Liu. 2017. Interpretable convolutional neural networks with dual local and global attention for review rating prediction. In Proceedings of the eleventh ACM conference on recommender systems. 297--305.
[29]
Jie Shuai, Kun Zhang, LeWu, Peijie Sun, Richang Hong, MengWang, and Yong Li. 2022. A review-aware graph contrastive learning framework for recommendation. In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval. 1283--1293.
[30]
Sandeep Subramanian, Adam Trischler, Yoshua Bengio, and Christopher J Pal. 2018. Learning general purpose distributed sentence representations via large scale multi-task learning. arXiv preprint arXiv:1804.00079 (2018).
[31]
Zhulin Tao, Yinwei Wei, Xiang Wang, Xiangnan He, Xianglin Huang, and Tat- Seng Chua. 2020. Mgat: Multimodal graph attention network for recommendation. Information Processing & Management 57, 5 (2020), 102277.
[32]
Xi Wang, Iadh Ounis, and Craig Macdonald. 2021. Leveraging review properties for effective recommendation. In Proceedings of the Web Conference 2021. 2209-- 2219.
[33]
YinweiWei, XiangWang, Liqiang Nie, Xiangnan He, Richang Hong, and Tat-Seng Chua. 2019. MMGCN: Multi-modal graph convolution network for personalized recommendation of micro-video. In Proceedings of the 27th ACM international conference on multimedia. 1437--1445.
[34]
LibingWu, Cong Quan, Chenliang Li, QianWang, Bolong Zheng, and Xiangyang Luo. 2019. A context-aware user-item representation learning for item recommendation. ACM Transactions on Information Systems (TOIS) 37, 2 (2019), 1--29.
[35]
Kun Xiong,Wenwen Ye, Xu Chen, Yongfeng Zhang,Wayne Xin Zhao, Binbin Hu, Zhiqiang Zhang, and Jun Zhou. 2021. Counterfactual review-based recommendation. In Proceedings of the 30th ACM International Conference on Information & Knowledge Management. 2231--2240.
[36]
Guipeng Xv, Xinyi Liu, Chen Lin, Hui Li, Chenliang Li, and Zhenhua Huang. 2022. Lightweight Unbiased Multi-teacher Ensemble for Review-based Recommendation. In Proceedings of the 31st ACM International Conference on Information & Knowledge Management. 4620--4624.
[37]
Zixuan Yi, Xi Wang, Iadh Ounis, and Craig Macdonald. 2022. Multi-modal graph contrastive learning for micro-video recommendation. In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval. 1807--1811.
[38]
Lei Zheng, Vahid Noroozi, and Philip S Yu. 2017. Joint deep modeling of users and items using reviews for recommendation. In Proceedings of the tenth ACM international conference on web search and data mining. 425--434.

Cited By

View all
  • (2025)Interactive, Enhanced Dual Hypergraph Model for Explainable Contrastive Learning RecommendationElectronics10.3390/electronics1402021614:2(216)Online publication date: 7-Jan-2025
  • (2024)Graph Diffusive Self-Supervised Learning for Social RecommendationProceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3626772.3657962(2442-2446)Online publication date: 10-Jul-2024
  • (2023)Multimodal Optimal Transport Knowledge Distillation for Cross-domain RecommendationProceedings of the 32nd ACM International Conference on Information and Knowledge Management10.1145/3583780.3614983(2959-2968)Online publication date: 21-Oct-2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
SIGIR '23: Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval
July 2023
3567 pages
ISBN:9781450394086
DOI:10.1145/3539618
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 July 2023

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. contrastive learning
  2. multiple intentions
  3. review-based recommendation

Qualifiers

  • Short-paper

Conference

SIGIR '23
Sponsor:

Acceptance Rates

Overall Acceptance Rate 792 of 3,983 submissions, 20%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)235
  • Downloads (Last 6 weeks)23
Reflects downloads up to 05 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2025)Interactive, Enhanced Dual Hypergraph Model for Explainable Contrastive Learning RecommendationElectronics10.3390/electronics1402021614:2(216)Online publication date: 7-Jan-2025
  • (2024)Graph Diffusive Self-Supervised Learning for Social RecommendationProceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3626772.3657962(2442-2446)Online publication date: 10-Jul-2024
  • (2023)Multimodal Optimal Transport Knowledge Distillation for Cross-domain RecommendationProceedings of the 32nd ACM International Conference on Information and Knowledge Management10.1145/3583780.3614983(2959-2968)Online publication date: 21-Oct-2023
  • (2023)Modal-aware Bias Constrained Contrastive Learning for Multimodal RecommendationProceedings of the 31st ACM International Conference on Multimedia10.1145/3581783.3612568(6369-6378)Online publication date: 26-Oct-2023

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media