Rongmei Zhao
Ning Yang
ABSTRACT
Conversational recommender systems model user dynamic preferences and recommend items based on multi-turn interactions. Though the conversational recommender system has achieved good performance, it has two limitations. On the one hand, researchers usually random select an anchor item from user's historical interactions to simulate the interaction with the real user, but some items in the historical interactions do not fit the user realistic preferences (item noise). On the other hand, it pays too much attention to user dynamic preferences, but nurses some static preferences that are difficult to change over a short period. In fact, when there is no explicit attribute preference in user's conversation, the user static preferences can also be used to make recommendations. To address the aforementioned issues, a novel method that combines graph path reasoning with multi-turn conversation is proposed, called Graph Path reasoning for conversational Recommendation (GPR). In GPR, a soft-clustering is designed to classify items and then set operations are utilized to filter the noise in the user's historical interactions. To capture user dynamic preferences and take account of the user inherent static preferences, GPR asks questions about attributes in the attribute-level reasoning and asks whether the items fit user static preferences in the item-level reasoning on a heterogeneous graph. In the multi-turn of two-level graph path reasoning, a reinforcement learning is used to obtain the optimal path and accurately recommend items to users. Extensive experiments conducted on two benchmark datasets verify that GPR can significantly improve recommendation performance and reduce the turn of path reasoning.
Supplemental Material
- Keping Bi, Qingyao Ai, Yongfeng Zhang, and W Bruce Croft. 2019. Conversational product search based on negative feedback. In Proceedings of the 28th acm international conference on information and knowledge management. ACM, 359--368.Google Scholar
Digital Library
- Ismael MG Cardoso, Jorge LV Barbosa, Bruno M Alves, Lucas PS Dias, and Luan C Nesi. 2022. Vulcont: A recommender system based on context history ontology. IET Software, Vol. 16, 1 (2022), 111--123.Google ScholarCross Ref
- Konstantina Christakopoulou, Alex Beutel, Rui Li, Sagar Jain, and Ed H Chi. 2018. Q&R: A two-stage approach toward interactive recommendation. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. ACM, 139--148.Google ScholarDigital Library
- Konstantina Christakopoulou, Filip Radlinski, and Katja Hofmann. 2016. Towards conversational recommender systems. In Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining. ACM, 815--824.Google ScholarDigital Library
- Bhuwan Dhingra, Lihong Li, Xiujun Li, Jianfeng Gao, Yun-Nung Chen, Faisal Ahmed, and Li Deng. 2017. Towards end-to-end reinforcement learning of dialogue agents for information access., Vol. 1 (2017), 484--495.Google ScholarCross Ref
- Reza Gharibi, Atefeh Safdel, Seyed Mostafa Fakhrahmad, and Mohammad Hadi Sadreddini. 2021. A content-based model for tag recommendation in software information sites. Comput. J., Vol. 64, 11 (2021), 1680--1691.Google ScholarCross Ref
- Dietmar Jannach, Ahtsham Manzoor, Wanling Cai, and Li Chen. 2021. A survey on conversational recommender systems. ACM Computing Surveys (CSUR), Vol. 54, 5 (2021), 1--36.Google ScholarDigital Library
- Bo Jiang, Junchen Yang, Yanbin Qin, Tian Wang, Muchou Wang, and Weifeng Pan. 2021. A Service Recommendation Algorithm Based on Knowledge Graph and Collaborative Filtering. IEEE Access, Vol. 9 (2021), 50880--50892.Google ScholarCross Ref
- Wenqiang Lei, Xiangnan He, Yisong Miao, Qingyun Wu, Richang Hong, Min-Yen Kan, and Tat-Seng Chua. 2020a. Estimation-action-reflection: Towards deep interaction between conversational and recommender systems. In Proceedings of the 13th International Conference on Web Search and Data Mining. ACM, 304--312.Google ScholarDigital Library
- Wenqiang Lei, Gangyi Zhang, Xiangnan He, Yisong Miao, Xiang Wang, Liang Chen, and Tat-Seng Chua. 2020b. Interactive path reasoning on graph for conversational recommendation. In Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. ACM, 2073--2083.Google ScholarDigital Library
- Yu Lei and Wenjie Li. 2019. Interactive recommendation with user-specific deep reinforcement learning. ACM Transactions on Knowledge Discovery from Data (TKDD), Vol. 13, 6 (2019), 1--15.Google Scholar
- Raymond Li, Samira Ebrahimi Kahou, Hannes Schulz, Vincent Michalski, Laurent Charlin, and Chris Pal. 2018. Towards deep conversational recommendations. (2018), 9748--9758.Google Scholar
- Shijun Li, Wenqiang Lei, Qingyun Wu, Xiangnan He, Peng Jiang, and Tat-Seng Chua. 2021. Seamlessly unifying attributes and items: Conversational recommendation for cold-start users. ACM Transactions on Information Systems (TOIS), Vol. 39, 4 (2021), 1--29.Google ScholarDigital Library
- Jie Liao, Wei Zhou, Fengji Luo, Junhao Wen, Min Gao, Xiuhua Li, and Jun Zeng. 2022. SocialLGN: Light Graph Convolution Network for Social Recommendation. Information Sciences, Vol. 589 (2022), 595--607.Google ScholarDigital Library
- Lizi Liao, Yunshan Ma, Xiangnan He, Richang Hong, and Tat-seng Chua. 2018. Knowledge-aware multimodal dialogue systems. In Proceedings of the 26th ACM international conference on Multimedia. ACM, 801--809.Google ScholarDigital Library
- Danyang Liu, Jianxun Lian, Zheng Liu, Xiting Wang, Guangzhong Sun, and Xing Xie. 2021b. Reinforced Anchor Knowledge Graph Generation for News Recommendation Reasoning. In Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining. ACM, 1055--1065.Google ScholarDigital Library
- Huiting Liu, Lingling Guo, Peipei Li, Peng Zhao, and Xindong Wu. 2021a. Collaborative filtering with a deep adversarial and attention network for cross-domain recommendation. Information Sciences, Vol. 565 (2021), 370--389.Google ScholarDigital Library
- Shaopeng Liu, Guohui Tian, Ying Zhang, Mengyang Zhang, and Shuo Liu. 2022. Active Object Detection Based on A Novel Deep Q-learning Network and Long-term Learning Strategy for Service Robot. IEEE Transactions on Industrial Electronics, Vol. 69, 6 (2022), 5984--5993.Google ScholarCross Ref
- Kai Luo, Scott Sanner, Ga Wu, Hanze Li, and Hojin Yang. 2020. Latent linear critiquing for conversational recommender systems. In Proceedings of The Web Conference 2020. ACM / IW3C2, 2535--2541.Google ScholarDigital Library
- Wenchang Ma, Ryuichi Takanobu, and Minlie Huang. 2021. CR-Walker: Tree-Structured Graph Reasoning and Dialog Acts for Conversational Recommendation. (2021), 1839--1851.Google Scholar
- Sung-Jun Park, Dong-Kyu Chae, Hong-Kyun Bae, Sumin Park, and Sang-Wook Kim. 2022. Reinforcement Learning over Sentiment-Augmented Knowledge Graphs towards Accurate and Explainable Recommendation. In Proceedings of the Fifteenth ACM International Conference on Web Search and Data Mining. ACM, 784--793.Google ScholarDigital Library
- Steffen Rendle. 2010. Factorization machines. In 2010 IEEE International conference on data mining. IEEE, 995--1000.Google ScholarDigital Library
- Yueming Sun and Yi Zhang. 2018. Conversational recommender system. In The 41st international acm sigir conference on research & development in information retrieval. ACM, 235--244.Google Scholar
- Takafumi Suzuki, Satoshi Oyama, and Masahito Kurihara. 2020. A Framework for Recommendation Algorithms Using Knowledge Graph and Random Walk Methods. In 2020 IEEE International Conference on Big Data (Big Data). IEEE, 3085--3087.Google ScholarCross Ref
- Xiang Wang, Dingxian Wang, Canran Xu, Xiangnan He, Yixin Cao, and Tat-Seng Chua. 2019. Explainable reasoning over knowledge graphs for recommendation. In Proceedings of the AAAI conference on artificial intelligence, Vol. 33. AAAI Press, 5329--5336.Google ScholarDigital Library
- Yikun Xian, Zuohui Fu, Shan Muthukrishnan, Gerard De Melo, and Yongfeng Zhang. 2019. Reinforcement knowledge graph reasoning for explainable recommendation. In Proceedings of the 42nd international ACM SIGIR conference on research and development in information retrieval. ACM, 285--294.Google ScholarDigital Library
- Kerui Xu, Jingxuan Yang, Jun Xu, Sheng Gao, Jun Guo, and Ji-Rong Wen. 2021b. Adapting user preference to online feedback in multi-round conversational recommendation. In Proceedings of the 14th ACM international conference on web search and data mining. ACM, 364--372.Google ScholarDigital Library
- Wenyi Xu, Xiaofeng Gao, Yin Sheng, and Guihai Chen. 2021a. Recommendation System with Reasoning Path Based on DQN and Knowledge Graph. In 2021 15th International Conference on Ubiquitous Information Management and Communication (IMCOM). IEEE, 1--8.Google Scholar
- Tong Yu, Yilin Shen, and Hongxia Jin. 2019. A visual dialog augmented interactive recommender system. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. ACM, 157--165.Google ScholarDigital Library
- Xiaoying Zhang, Hong Xie, Hang Li, and John CS Lui. 2020. Conversational contextual bandit: Algorithm and application. In Proceedings of The Web Conference 2020. 662--672.Google ScholarDigital Library
- Yongfeng Zhang, Xu Chen, Qingyao Ai, Liu Yang, and W Bruce Croft. 2018. Towards conversational search and recommendation: System ask, user respond. In Proceedings of the 27th acm international conference on information and knowledge management. ACM, 177--186.Google ScholarDigital Library
- Gustav Zickert and Can Evren Yarman. 2022. Gaussian mixture model decomposition of multivariate signals. Signal, Image and Video Processing, Vol. 16, 2 (2022), 429--436.Google ScholarCross Ref
Index Terms
- Two-Level Graph Path Reasoning for Conversational Recommendation with User Realistic Preference
Recommendations
Learning to Infer User Implicit Preference in Conversational Recommendation
SIGIR '22: Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information RetrievalConversational recommender systems (CRS) enable traditional recommender systems to interact with users by asking questions about attributes and recommending items. The attribute-level and item-level feedback of users can be utilized to estimate users' ...
Interactive Path Reasoning on Graph for Conversational Recommendation
KDD '20: Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data MiningTraditional recommendation systems estimate user preference on items from past interaction history, thus suffering from the limitations of obtaining fine-grained and dynamic user preference. Conversational recommendation system (CRS) brings revolutions ...
DeepCPR: Deep Path Reasoning Using Sequence of User-Preferred Attributes for Conversational Recommendation
Conversational recommender systems (CRS) have garnered significant attention in academia and industry because of their ability to capture user preferences via system questions and user responses. Typically, in a CRS, reinforcement learning (RL) is ...
Comments