skip to main content
10.1145/3477495.3532077acmconferencesArticle/Chapter ViewAbstractPublication PagesirConference Proceedingsconference-collections
research-article

Variational Reasoning about User Preferences for Conversational Recommendation

Published: 07 July 2022 Publication History

Abstract

Conversational recommender systems (CRSs) provide recommendations through interactive conversations. CRSs typically provide recommendations through relatively straightforward interactions, where the system continuously inquires about a user's explicit attribute-aware preferences and then decides which items to recommend. In addition, topic tracking is often used to provide naturally sounding responses. However, merely tracking topics is not enough to recognize a user's real preferences in a dialogue.
In this paper, we address the problem of accurately recognizing and maintaining user preferences in CRSs. Three challenges come with this problem: (1) An ongoing dialogue only provides the user's short-term feedback; (2) Annotations of user preferences are not available; and (3) There may be complex semantic correlations among items that feature in a dialogue. We tackle these challenges by proposing an end-to-end variational reasoning approach to the task of conversational recommendation. We model both long-term preferences and short-term preferences as latent variables with topical priors for explicit long-term and short-term preference exploration, respectively. We use an efficient stochastic gradient variational Bayesian (SGVB) estimator for optimizing the derived evidence lower bound. A policy network is then used to predict topics for a clarification utterance or items for a recommendation response. The use of explicit sequences of preferences with multi-hop reasoning in a heterogeneous knowledge graph helps to provide more accurate conversational recommendation results.
Extensive experiments conducted on two benchmark datasets show that our proposed method outperforms state-of-the-art baselines in terms of both objective and subjective evaluation metric

Supplementary Material

MP4 File (SIGIR22-fp0545.mp4)
We address the problem of accurately maintaining user preferences in conversational recommender systems. Three challenges come with this problem: 1. An ongoing dialogue only provides the user's short-term feedback; 2. annotations of user preferences are not available; and 3. there may be complex semantic correlations among items that feature in a dialogue. We tackle these challenges by proposing a variational reasoning approach to conversational recommendation. We model both long-term preferences and short-term preferences as latent variables. A policy network is used to predict topics for a clarification utterance or items for a recommendation response. The use of explicit sequences of preferences with multi-hop reasoning in a heterogeneous knowledge graph helps to provide more accurate conversational recommendation results. Experiments conducted on two benchmark datasets show that our proposed method outperforms state-of-the-art baselines in terms of both objective and subjective evaluation metrics.

References

[1]
Sören Auer, Christian Bizer, Georgi Kobilarov, Jens Lehmann, Richard Cyganiak, and Zachary Ives. 2007. DBpedia: A Nucleus for a Web of Open Data. In The Semantic Web. Springer, 722--735.
[2]
Bartoz Balcer, Martin Halvey, Stephen A Brewster, and Joemon M Jose. 2012. COPE: Interactive Image Retrieval Using Conversational Recommendation. In Proceedings of BCS-HCI. 1--10.
[3]
Qibin Chen, Junyang Lin, Yichang Zhang, Ming Ding, Yukuo Cen, Hongxia Yang, and Jie Tang. 2019. Towards Knowledge-Based Recommender Dialog System. In Proceedings of EMNLP. 1803--1813.
[4]
Konstantina Christakopoulou, Alex Beutel, Rui Li, Sagar Jain, and Ed H Chi. 2018. Q&R: A Two-stage Approach toward Interactive Recommendation. In Proceedings of KDD. 139--148.
[5]
Konstantina Christakopoulou, Filip Radlinski, and Katja Hofmann. 2016. Towards Conversational Recommender Systems. In Proceedings of KDD. 815--824.
[6]
Yang Deng, Yaliang Li, Fei Sun, Bolin Ding, and Wai Lam. 2021. Unified Con- versational Recommendation Policy Learning via Graph-based Reinforcement Learning. In Proceedings of SIGIR. 1431--1441.
[7]
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In Proceedings of NAACL-HLT. 4171--4186.
[8]
Bhuwan Dhingra, Lihong Li, Xiujun Li, Jianfeng Gao, Yun-Nung Chen, Faisal Ahmed, and Li Deng. 2017. Towards End-to-End Reinforcement Learning of Dialogue Agents for Information Access. In Proceedings of ACL. 484--495.
[9]
Matt W Gardner and SR Dorling. 1998. Artificial Neural Networks (The Multilayer Perceptron) Review of Applications in the Atmospheric Sciences. Atmospheric environment 32, 14--15 (1998), 2627--2636.
[10]
Ian Goodfellow, Yoshua Bengio, and Aaron Courville. 2016. Deep Learning. MIT press.
[11]
Jiatao Gu, Zhengdong Lu, Hang Li, and Victor OK Li. 2016. Incorporating Copying Mechanism in Sequence-to-Sequence Learning. In Proceedings of ACL.
[12]
Yangyang Guo, Zhiyong Cheng, Liqiang Nie, Yinglong Wang, Jun Ma, and Mohan Kankanhalli. 2019. Attentive Long Short-term Preference Modeling for Per- sonalized Product Search. ACM Transactions on Information Systems (TOIS) 37, 2 (2019), 1--27.
[13]
Yoon Kim. 2014. Convolutional Neural Networks for Sentence Classification. In Proceedings of EMNLP. 1746--1751.
[14]
Diederik P Kingma and Jimmy Ba. 2015. Adam: A Method for Stochastic Optimization. In Proceedings of ICLR.
[15]
Diederik P Kingma and Max Welling. 2014. Auto-Encoding Variational Bayes. In Proceedings of ICLR.
[16]
Yuquan Le, Xian Li, Suixue Wang, Peng Wang, Haiqian Lin, and Guanyu Jiang. 2018. CVTE SLU: A Hybrid System for Command Understanding Task Oriented to the Music Field. In Proceedings of CCKS. 13--18.
[17]
Chih-Hen Lee, Jun-En Ding, Chih-Ming Chen, Jing-Kai Lou, Ming-Feng Tsai, and Chuan-Ju Wang. 2021. LSTPR: Graph-based Matrix Factorization with Long Short-term Preference Ranking. In Proceedings of SIGIR. 2222--2226.
[18]
Wenqiang Lei, Xiangnan He, Yisong Miao, Qingyun Wu, Richang Hong, Min- Yen Kan, and Tat-Seng Chua. 2020. Estimation-Action-Reflection: Towards Deep Interaction Between Conversational and Recommender Systems. In Proceedings of WSDM. 304--312.
[19]
Wenqiang Lei, Gangyi Zhang, Xiangnan He, Yisong Miao, Xiang Wang, Liang Chen, and Tat-Seng Chua. 2020. Interactive Path Reasoning on Graph for Conversational Recommendation. In Proceedings of KDD. 2073--2083.
[20]
Jiwei Li, Michel Galley, Chris Brockett, Jianfeng Gao, and Bill Dolan. 2016. A Diversity-Promoting Objective Function for Neural Conversation Models. In Proceedings of NAACL. 110--119.
[21]
Raymond Li, Samira Ebrahimi Kahou, Hannes Schulz, Vincent Michalski, Laurent Charlin, and Chris Pal. 2018. Towards Deep Conversational Recommendations. In Proceedings of NeurIPS. 9748--9758.
[22]
Shijun Li, Wenqiang Lei, Qingyun Wu, Xiangnan He, Peng Jiang, and Tat-Seng Chua. 2021. Seamlessly Unifying Attributes and Items: Conversational Recommendation for Cold-start Users. ACM Transactions on Information Systems 39, 4 (2021), 1--29.
[23]
Rongzhong Lian, Min Xie, Fan Wang, Jinhua Peng, and Hua Wu. 2019. Learning to Select Knowledge for Response Generation in Dialog Systems. In Proceedings of IJCAI. 5081--5087.
[24]
Lizi Liao, Ryuichi Takanobu, Yunshan Ma, Xun Yang, Minlie Huang, and Tat-Seng Chua. 2019. Deep Conversational Recommender in Travel. CoRR abs/1907.00710 (2019).
[25]
Yong Liu, Yingtai Xiao, Qiong Wu, Chunyan Miao, Juyong Zhang, Binqiang Zhao, and Haihong Tang. 2020. Diversified Interactive Recommendation with Implicit Feedback. In Proceedings of AAAI. 4932--4939.
[26]
Yu Liu, Haiping Zhu, Yan Chen, Feng Tian, Dailusi Ma, Jiangwei Zeng, and Qinghua Zheng. 2020. Long- and Short-Term Preference Model Based on Graph Embedding for Sequential Recommendation. In Proceedings of DASFAA. 241--257.
[27]
Zeming Liu, Haifeng Wang, Zheng-Yu Niu, Hua Wu, Wanxiang Che, and Ting Liu. 2020. Towards Conversational Recommendation over Multi-Type Dialogs. In Proceedings of ACL. 1036--1049.
[28]
Yu Lu, Junwei Bao, Yan Song, Zichen Ma, Shuguang Cui, Youzheng Wu, and Xiaodong He. 2021. RevCore: Review-Augmented Conversational Recommendation. In Proceedings of ACL-IJCNLP. 1161--1173.
[29]
Kai Luo, Hojin Yang, Ga Wu, and Scott Sanner. 2020. Deep Critiquing for VAE- based Recommender Systems. In Proceedings of SIGIR. 1269--1278.
[30]
Shengnan Lyu, Arpit Rana, Scott Sanner, and Mohamed Reda Bouadjenek. 2021. A Workflow Analysis of Context-driven Conversational Recommendation. In Proceedings of WWW. 866--877.
[31]
Wenchang Ma, Ryuichi Takanobu, and Minlie Huang. 2021. CR-Walker: Tree-Structured Graph Reasoning and Dialog Acts for Conversational Recommenda- tion. In Proceedings of EMNLP. 1839--1851.
[32]
Chuan Meng, Pengjie Ren, Zhumin Chen, Weiwei Sun, Zhaochun Ren, Zhaopeng Tu, and Maarten de Rijke. 2020. DukeNet: A Dual Knowledge Interaction Network for Knowledge-Grounded Conversation. In Proceedings of SIGIR. 1151--1160.
[33]
Kevin P Murphy. 2012. Machine Learning: A Probabilistic Perspective. MIT press.
[34]
Xuhui Ren, Hongzhi Yin, Tong Chen, Hao Wang, Zi Huang, and Kai Zheng. 2021. Learning to Ask Appropriate Questions in Conversational Recommendation. In Proceedings of SIGIR. 808--817.
[35]
Rajdeep Sarkar, Koustava Goswami, Mihael Arcan, and John P. McCrae. 2020. Suggest Me a Movie for Tonight: Leveraging Knowledge Graphs for Conversational Recommendation. In Proceedings of COLING. 4179--4189.
[36]
Michael Schlichtkrull, Thomas N Kipf, Peter Bloem, Rianne van den Berg, Ivan Titov, and Max Welling. 2018. Modeling Relational Data with Graph Convolutional Networks. In Proceedings of ESWC. 593--607.
[37]
Suvash Sedhain, Aditya Krishna Menon, Scott Sanner, and Lexing Xie. 2015. Autorec: Autoencoders Meet Collaborative Filtering. In Proceedings of WWW. 111--112.
[38]
Robyn Speer, Joshua Chin, and Catherine Havasi. 2017. ConceptNet 5.5: An Open Multilingual Graph of General Knowledge. In Proceedings of AAAI. 4444--4451.
[39]
Yueming Sun and Yi Zhang. 2018. Conversational Recommender System. In Proceedings of SIGIR. 235--244.
[40]
Cynthia A Thompson, Mehmet H Goker, and Pat Langley. 2004. A Personalized System for Conversational Recommendations. Journal of Artificial Intelligence Research 21 (2004), 393--428.
[41]
Thanh Tran, Di You, and Kyumin Lee. 2020. Quaternion-Based Self-Attentive Long Short-term User Preference Encoding for Recommendation. In Proceedings of CIKM. 1455--1464.
[42]
Quan Tu, Shen Gao, Yanran Li, Jianwei Cui, Bin Wang, and Rui Yan. 2022. Con- versational Recommendation via Hierarchical Information Modeling. In Proceedings of SIGIR.
[43]
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, ?ukasz Kaiser, and Illia Polosukhin. 2017. Attention Is All You Need. In Proceedings of NeurIPS. 5998--6008.
[44]
Ivan Vendrov, Tyler Lu, Qingqing Huang, and Craig Boutilier. 2020. Gradient- Based Optimization for Bayesian Preference Elicitation. In Proceedings of AAAI. 10292--10301.
[45]
Huazheng Wang, Qingyun Wu, and Hongning Wang. 2017. Factorization Bandits for Interactive Recommendation. In Proceedings of AAAI. 2695--2702.
[46]
Qing Wang, Chunqiu Zeng, Wubai Zhou, Tao Li, S Sitharama Iyengar, Larisa Shwartz, and Genady Ya Grabarnik. 2018. Online Interactive Collaborative Filtering Using Multiarmed Bandit with Dependent Arms. IEEE Transactions on Knowledge and Data Engineering 31, 8 (2018), 1569--1580.
[47]
Tsung-Hsien Wen, David Vandyke, Nikola Mrksic, Milica Gasic, Lina M Rojas- Barahona, Pei-Hao Su, Stefan Ultes, and Steve Young. 2017. A Network-based End-to-End Trainable Task-oriented Dialogue System. In Proceedings of EACL. 438--449.
[48]
Ronald J Williams and David Zipser. 1989. A Learning Algorithm for Continually Running Fully Recurrent Neural Networks. Neural computation 1, 2 (1989), 270--280.
[49]
Kerui Xu, Jingxuan Yang, Jun Xu, Sheng Gao, Jun Guo, and Ji-Rong Wen. 2021. Adapting User Preference to Online Feedback in Multi-round Conversational Recommendation. In Proceedings of WSDM. 364--372.
[50]
Lantao Yu, Weinan Zhang, Jun Wang, and Yong Yu. 2017. SeqGAN: Sequence Generative Adversarial Nets with Policy Gradient. In Proceedings of AAAI. 2852--2858.
[51]
Xiaoying Zhang, Hong Xie, Hang Li, and John Lui. 2019. Toward Building Conversational Recommender Systems: A Contextual Bandit Approach. arXiv preprint arXiv:1906.01219 (2019).
[52]
Yongfeng Zhang, Xu Chen, Qingyao Ai, Liu Yang, and W Bruce Croft. 2018. Towards Conversational Search and Recommendation: System Ask, User Respond. In Proceedings of CIKM. 177--186.
[53]
Zheng Zhang, Minlie Huang, Zhongzhou Zhao, Feng Ji, Haiqing Chen, and Xiaoyan Zhu. 2019. Memory-augmented Dialogue Management for Task-oriented Dialogue Systems. ACM Transactions on Information Systems 37, 3 (2019), 1--30.
[54]
Xiaoxue Zhao, Weinan Zhang, and Jun Wang. 2013. Interactive Collaborative Filtering. In Proceedings of CIKM. 1411--1420.
[55]
Jinfeng Zhou, Bo Wang, Ruifang He, and Yuexian Hou. 2021. CRFR: Improving Conversational Recommender Systems via Flexible Fragments Reasoning on Knowledge Graphs. In Proceedings of EMNLP. 4324--4334.
[56]
Kun Zhou, Wayne Xin Zhao, Shuqing Bian, Yuanhang Zhou, Ji-Rong Wen, and Jingsong Yu. 2020. Improving Conversational Recommender Systems via Knowl- edge Graph Based Semantic Fusion. In Proceedings of KDD. 1006--1014.
[57]
Kun Zhou, Yuanhang Zhou, Wayne Xin Zhao, Xiaoke Wang, and Ji-Rong Wen. 2020. Towards Topic-Guided Conversational Recommender System. In Proceed- ings of COLING. 4128--4139.
[58]
Yuanhang Zhou, Kun Zhou, Wayne Xin Zhao, Cheng Wang, Peng Jiang, and He Hu. 2022. C2-CRS: Coarse-to-Fine Contrastive Learning for Conversational Recommender System. In Proceedings of WSDM. 1488--1496.
[59]
Jie Zou, Yifan Chen, and Evangelos Kanoulas. 2020. Towards Question-based Recommender Systems. In Proceedings of SIGIR. 881--890.
[60]
Jie Zou, Evangelos Kanoulas, Pengjie Ren, Zhaochun Ren, Aixin Sun, and Cheng Long. 2022. Improving Conversational Recommender Systems via Transformer-based Sequential Modelling. In Proceedings of SIGIR.
[61]
Lixin Zou, Long Xia, Pan Du, Zhuo Zhang, Ting Bai, Weidong Liu, Jian-Yun Nie, and Dawei Yin. 2020. Pseudo Dyna-Q: A Reinforcement Learning Framework for Interactive Recommendation. In Proceedings of WSDM. 816--824.
[62]
Lixin Zou, Long Xia, Yulong Gu, Xiangyu Zhao, Weidong Liu, Jimmy Xiangji Huang, and Dawei Yin. 2020. Neural Interactive Collaborative Filtering. In Proceedings of SIGIR. 749--75

Cited By

View all
  • (2025)Proactive Conversational AI: A Comprehensive Survey of Advancements and OpportunitiesACM Transactions on Information Systems10.1145/3715097Online publication date: 24-Jan-2025
  • (2025)Augmentation with Neighboring Information for Conversational RecommendationACM Transactions on Information Systems10.1145/371258843:3(1-49)Online publication date: 17-Jan-2025
  • (2025)Efficient and Effective Role Player: A Compact Knowledge-grounded Persona-based Dialogue Model Enhanced by LLM DistillationACM Transactions on Information Systems10.1145/371185743:3(1-29)Online publication date: 10-Jan-2025
  • Show More Cited By

Index Terms

  1. Variational Reasoning about User Preferences for Conversational Recommendation

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      SIGIR '22: Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval
      July 2022
      3569 pages
      ISBN:9781450387323
      DOI:10.1145/3477495
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 07 July 2022

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. conversational recommendation
      2. task-oriented dialogue systems
      3. user preference tracking
      4. variational inference

      Qualifiers

      • Research-article

      Funding Sources

      • Shandong University multidisciplinary research and innovation team of young scholars
      • Fundamental Research Funds of Shandong University
      • Key Scientific and Technological Innovation Program of Shandong Province
      • Dutch Ministry of Education, Culture and Science through the Netherlands Organisation for Scientific Research
      • Hybrid Intelligence Center
      • Natural Science Foundation of China
      • Tencent WeChat Rhino-Bird Focused Research Program
      • Meituan

      Conference

      SIGIR '22
      Sponsor:

      Acceptance Rates

      Overall Acceptance Rate 792 of 3,983 submissions, 20%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)118
      • Downloads (Last 6 weeks)16
      Reflects downloads up to 28 Feb 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2025)Proactive Conversational AI: A Comprehensive Survey of Advancements and OpportunitiesACM Transactions on Information Systems10.1145/3715097Online publication date: 24-Jan-2025
      • (2025)Augmentation with Neighboring Information for Conversational RecommendationACM Transactions on Information Systems10.1145/371258843:3(1-49)Online publication date: 17-Jan-2025
      • (2025)Efficient and Effective Role Player: A Compact Knowledge-grounded Persona-based Dialogue Model Enhanced by LLM DistillationACM Transactions on Information Systems10.1145/371185743:3(1-29)Online publication date: 10-Jan-2025
      • (2024)Knowledge-Enhanced Conversational Recommendation via Transformer-Based Sequential ModelingACM Transactions on Information Systems10.1145/367737642:6(1-27)Online publication date: 18-Oct-2024
      • (2024)Towards Empathetic Conversational Recommender SystemsProceedings of the 18th ACM Conference on Recommender Systems10.1145/3640457.3688133(84-93)Online publication date: 8-Oct-2024
      • (2024)DiffGCA: A Diffusion Recommendation Model with Global Attention Mechanism2024 7th International Conference on Data Science and Information Technology (DSIT)10.1109/DSIT61374.2024.10880988(1-5)Online publication date: 20-Dec-2024
      • (2024)Multi-aspect Knowledge-enhanced Hypergraph Attention Network for Conversational Recommendation SystemsKnowledge-Based Systems10.1016/j.knosys.2024.112119299(112119)Online publication date: Sep-2024
      • (2024)Improving conversational recommender systems via multi-preference modelling and knowledge-enhancedKnowledge-Based Systems10.1016/j.knosys.2023.111361286:COnline publication date: 17-Apr-2024
      • (2024)Graph-based dynamic attribute clipping for conversational recommendationDiscover Computing10.1007/s10791-024-09437-627:1Online publication date: 10-May-2024
      • (2024)uTransfer: Unified Transferability Metric Incorporating Heterogeneous User Data in Social NetworkDatabase Systems for Advanced Applications10.1007/978-981-97-5572-1_12(185-202)Online publication date: 31-Aug-2024
      • Show More Cited By

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media