skip to main content
10.1145/3640457.3691697acmconferencesArticle/Chapter ViewAbstractPublication PagesrecsysConference Proceedingsconference-collections
demonstration

GenUI(ne) CRS: UI Elements and Retrieval-Augmented Generation in Conversational Recommender Systems with LLMs

Published: 08 October 2024 Publication History

Abstract

Previous research has used Large Language Models (LLMs) to develop personalized Conversational Recommender Systems (CRS) with text-based user interfaces (UIs). However, the potential of LLMs to generate interactive graphical elements that enhance user experience remains largely unexplored. To address this gap, we introduce "GenUI(ne) CRS," a novel framework designed to leverage LLMs for adaptive and interactive UIs. Our framework supports domain-specific graphical elements such as buttons and cards, in addition to text-based inputs. It also addresses the common LLM issue of outdated knowledge, known as the "knowledge cut-off," by implementing Retrieval-Augmented Generation (RAG). To illustrate its potential, we developed a prototype movie CRS. This work demonstrates the feasibility of LLM-powered interactive UIs and paves the way for future CRS research, including user experience validation, transparent explanations, and addressing LLM biases.

Supplemental Material

MP4 File
Screencast of demo

References

[1]
Choose a License. 2024. Apache Licence 2.0 | Choose a License. Github, Inc. https://choosealicense.com/licenses/apache-2.0/Accessed: 2024-07-22.
[2]
Open AI. 2024. Chat Completions. OpenAI. https://platform.openai.com/docs/guides/chat-completionsAccessed: 2024-07-19.
[3]
Zhikang Dong, Xiulong Liu, Bin Chen, Pawel Polak, and Peng Zhang. 2024. MuseChat: A Conversational Music Recommendation System for Videos. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 12775–12785.
[4]
Luke Friedman, Sameer Ahuja, David Allen, Zhenning Tan, Hakim Sidahmed, Changbo Long, Jun Xie, Gabriel Schubiner, Ajay Patel, Harsh Lara, 2023. Leveraging large language models in conversational recommender systems. arXiv preprint arXiv:2305.07961 (2023).
[5]
Yunfan Gao, Tao Sheng, Youlin Xiang, Yun Xiong, Haofen Wang, and Jiawei Zhang. 2023. Chat-rec: Towards interactive and explainable llms-augmented recommender system. arXiv preprint arXiv:2303.14524 (2023).
[6]
Mateo Gutierrez Granada, Dina Zilbershtein, Daan Odijk, and Francesco Barile. 2023. VideolandGPT: A User Study on a Conversational Recommender System. Fifth Knowledge-aware and Conversational Recommender Systems (KaRS) Workshop (9 2023). https://ceur-ws.org/Vol-3560/demo1.pdf
[7]
Isabel Kathleen Fornell Haugeland, Asbjørn Følstad, Cameron Taylor, and Cato Alexander Bjørkli. 2022. Understanding the user experience of customer service chatbots: An experimental study of chatbot interaction design. International Journal of Human-Computer Studies 161 (2022), 102788. https://doi.org/10.1016/j.ijhcs.2022.102788
[8]
Zhankui He, Zhouhang Xie, Rahul Jha, Harald Steck, Dawen Liang, Yesu Feng, Bodhisattwa Prasad Majumder, Nathan Kallus, and Julian McAuley. 2023. Large language models as zero-shot conversational recommenders. In Proceedings of the 32nd ACM international conference on information and knowledge management. 720–730.
[9]
Andrew Kane. 2024. pgvector. https://github.com/pgvector/pgvector. Accessed: 2024-07-23.
[10]
Junling Liu, Chao Liu, Peilin Zhou, Renjie Lv, Kang Zhou, and Yan Zhang. 2023. Is chatgpt a good recommender? a preliminary study. arXiv preprint arXiv:2304.10149 (2023).
[11]
Michael McTear and Marina Ashurkina. 2024. A New Era in Conversational AI. Apress, Berkeley, CA, 1–16. https://doi.org/10.1007/979-8-8688-0110-5_1
[12]
Fedelucio Narducci, Marco de Gemmis, Pasquale Lops, and Giovanni Semeraro. 2018. Improving the user experience with a conversational recommender system. In AI* IA 2018–Advances in Artificial Intelligence: XVIIth International Conference of the Italian Association for Artificial Intelligence, Trento, Italy, November 20–23, 2018, Proceedings 17. Springer, 528–538.
[13]
Jieun Park, Sangyeon Kim, and Sangwon Lee. 2023. A User Preference and Intent Extraction Framework for Explainable Conversational Recommender Systems. EICS 2023 Companion - Companion of the 2023 ACM SIGCHI Symposium on Engineering Interactive Computing Systems (6 2023), 16–23. https://doi.org/10.1145/3596454.3597178
[14]
Ítallo Silva, Leandro Marinho, Alan Said, and Martijn C Willemsen. 2024. Leveraging ChatGPT for Automated Human-centered Explanations in Recommender Systems. In Proceedings of the 29th International Conference on Intelligent User Interfaces. 597–608.
[15]
Nava Tintarev and Judith Masthoff. 2011. Designing and Evaluating Explanations for Recommender Systems. Recommender Systems Handbook (2011), 479–510. https://doi.org/10.1007/978-0-387-85820-3_15
[16]
Vercel. 2024. Vercel AI SDK RAG Guide Starter Project. https://github.com/vercel/ai-sdk-rag-starter.
[17]
Likang Wu, Zhi Zheng, Zhaopeng Qiu, Hao Wang, Hongchao Gu, Tingjia Shen, Chuan Qin, Chen Zhu, Hengshu Zhu, Qi Liu, 2023. A survey on large language models for recommendation. arXiv preprint arXiv:2305.19860 (2023).
[18]
Gangyi Zhang. 2023. User-Centric Conversational Recommendation: Adapting the Need of User with Large Language Models. In Proceedings of the 17th ACM Conference on Recommender Systems (Singapore, Singapore) (RecSys ’23). Association for Computing Machinery, New York, NY, USA, 1349–1354. https://doi.org/10.1145/3604915.3608885
[19]
Z. Zhao, W. Fan, J. Li, Y. Liu, X. Mei, Y. Wang, Z. Wen, F. Wang, X. Zhao, J. Tang, and Q. Li. 5555. Recommender Systems in the Era of Large Language Models (LLMs). IEEE Transactions on Knowledge & Data Engineering01 (apr 5555), 1–20. https://doi.org/10.1109/TKDE.2024.3392335

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
RecSys '24: Proceedings of the 18th ACM Conference on Recommender Systems
October 2024
1438 pages
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 October 2024

Check for updates

Author Tags

  1. Conversational Recommender Systems
  2. Domain-Specific UI Elements
  3. Intelligent User Interface
  4. LLM
  5. Large Language Model

Qualifiers

  • Demonstration
  • Research
  • Refereed limited

Funding Sources

  • Research Foundation Flanders

Conference

Acceptance Rates

Overall Acceptance Rate 254 of 1,295 submissions, 20%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 213
    Total Downloads
  • Downloads (Last 12 months)213
  • Downloads (Last 6 weeks)35
Reflects downloads up to 18 Feb 2025

Other Metrics

Citations

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media