skip to main content
10.1145/3523227.3547376acmotherconferencesArticle/Chapter ViewAbstractPublication PagesrecsysConference Proceedingsconference-collections
tutorial

Conversational Recommender System Using Deep Reinforcement Learning

Published: 13 September 2022 Publication History

Abstract

Deep Reinforcement Learning (DRL) uses the best of both Reinforcement Learning and Deep Learning for solving problems which cannot be addressed by them individually. Deep Reinforcement Learning has been used widely for games, robotics etc. Limited work has been done for applying DRL for Conversational Recommender System (CRS). Hence, this tutorial covers the application of DRL for CRS. We give conceptual introduction to Reinforcement Learning and Deep Reinforcement Learning and cover Deep Q-Network, Dyna, REINFORCE and Actor Critic methods. We then cover various real life case studies with increasing complexity starting from CRS, deep CRS, adaptivity, topic guided CRS, deep and large-scale CRSs. We plan to share pre-read for Reinforcement Learning and Deep Reinforcement learning so that participants can grasp the material well.

References

[1]
Richard Sutton et. al., Reinforcement Learning an Introduction 2nd Edition (Book)
[2]
David Silver, Introduction to Reinforcement Learning (Course)
[3]
Sun Y. and Zhang Y., Conversational Recommender System, SIGIR 2018
[4]
Li R., et. al., Towards Deep Conversational Recommendations, NIPS 2018
[5]
Lei W., et. al., Estimation–Action–Reflection: Towards Deep Interaction Between Conversational and Recommender Systems, WSDM 2020
[6]
Learning and Adaptivity in Interactive Recommender Systems, ICEC 2007
[7]
Zhou K., et. al., Towards Topic-Guided Conversational Recommender System
[8]
Lei W., et. al, Interactive Path Reasoning on Graph for Conversational Recommendation, KDD 2020
[9]
Zhao X., et. al., Recommendations with Negative Feedback via Pairwise Deep Reinforcement Learning, KDD 2018
[10]
Deng Y., et. al., Unified Conversational Recommendation Policy Learning via Graph-based Reinforcement Learning, SIGIR 2021
[11]
Greco C., et. al., Exploiting Deep Learning and Hierarchical Reinforcement Learning for Conversational Recommender Systems, 2017
[12]
Chen H., et. al., Large-scale Interactive Recommendation with Tree-structured Policy Gradient, AAAI 2019
[13]
Zou L., et. al., Pseudo Dyna-Q: A Reinforcement Learning Framework for Interactive Recommendation, WSDM 2020
[14]
Montazeralghaem A., et. al. Large-scale Interactive Conversational Recommendation System using Actor-Critic Framework, RecSys 2021
[15]
Sonie Omprakash., et. al, concept2code: Deep Reinforcement Learning for Conversational AI, KDD 2022

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
RecSys '22: Proceedings of the 16th ACM Conference on Recommender Systems
September 2022
743 pages
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 September 2022

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Conversational AI
  2. Conversational Recommender System
  3. Deep Reinforcement Learning
  4. Reinforcement Learning

Qualifiers

  • Tutorial
  • Research
  • Refereed limited

Conference

Acceptance Rates

Overall Acceptance Rate 254 of 1,295 submissions, 20%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 454
    Total Downloads
  • Downloads (Last 12 months)81
  • Downloads (Last 6 weeks)12
Reflects downloads up to 05 Mar 2025

Other Metrics

Citations

Cited By

View all

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media