skip to main content
10.1145/3442381.3450123acmconferencesArticle/Chapter ViewAbstractPublication PageswwwConference Proceedingsconference-collections
research-article

A Workflow Analysis of Context-driven Conversational Recommendation

Published:03 June 2021Publication History

ABSTRACT

A number of recent works have made seminal contributions to the understanding of user intent and recommender interaction in conversational recommendation. However, to date, these studies have not focused explicitly on context-driven interaction that underlies the typical use of more pervasive Question Answering (QA) focused conversational assistants like Amazon Alexa, Apple Siri, and Google Assistant. In this paper, we aim to understand a general workflow of natural context-driven conversational recommendation that arises from a pairwise study of a human user interacting with a human simulating the role of a recommender. In our analysis of this intrinsically organic human-to-human conversation, we observe a clear structure of interaction workflow consisting of a preference elicitation and refinement stage, followed by inquiry and critiquing stages after the first recommendation. To better understand the nature of these stages and the conversational flow within them, we augment existing taxonomies of intent and action to label all interactions at each stage and analyze the workflow. From this analysis, we identify distinct conversational characteristics of each stage, e.g., (i) the preference elicitation stage consists of significant iteration to clarify, refine, and obtain a mutual understanding of preferences, (ii) the inquiry and critiquing stage consists of extensive informational queries to understand features of the recommended item and to (implicitly) specify critiques, and (iii) explanation appears to drive a substantial portion of the post-recommendation interaction, suggesting that beyond the purpose of justification, explanation serves a critical role to direct the evolving conversation itself. Altogether, we contribute a novel qualitative and quantitative analysis of workflow in conversational recommendation that further refines our existing understanding of this important frontier of conversational systems and suggests a number of critical avenues for further research to better automate natural recommendation conversations.

References

  1. Derek Bridge, Mehmet H. Göker, Lorraine McGinty, and Barry Smyth. 2005. Case-based recommender systems. Knowledge Engineering Review 20, 3 (2005), 315–320.Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Wanling Cai and Li Chen. 2019. Towards a Taxonomy of User Feedback Intents for Conversational Recommendations.. In RecSys (Late-Breaking Results). Association for Computing Machinery, New York, NY, USA, 51–55.Google ScholarGoogle Scholar
  3. Wanling Cai and Li Chen. 2020. Predicting User Intents and Satisfaction with Dialogue-Based Conversational Recommendations. In Proceedings of the 28th ACM Conference on User Modeling, Adaptation and Personalization (Genoa, Italy) (UMAP ’20). Association for Computing Machinery, New York, NY, USA, 33–42. https://doi.org/10.1145/3340631.3394856Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Konstantina Christakopoulou, Alex Beutel, Rui Li, Sagar Jain, and Ed H. Chi. 2018. Q&R: A Two-Stage Approach toward Interactive Recommendation. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining(London, United Kingdom) (KDD ’18). Association for Computing Machinery, New York, NY, USA, 139–148.Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Konstantina Christakopoulou, Filip Radlinski, and Katja Hofmann. 2016. Towards Conversational Recommender Systems. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (San Francisco, California, USA) (KDD ’16). Association for Computing Machinery, New York, NY, USA, 815–824.Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Herbert H. Clark and Edward F. Schaefer. 1989. Contributing to Discourse. Cognitive Science 13, 2 (1989), 259–294. https://doi.org/10.1207/s15516709cog1302_7 arXiv:https://onlinelibrary.wiley.com/doi/pdf/10.1207/s15516709cog1302_7Google ScholarGoogle ScholarCross RefCross Ref
  7. Jianfeng Gao, Michel Galley, and Lihong Li. 2018. Neural Approaches to Conversational AI. In The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval (Ann Arbor, MI, USA) (SIGIR ’18). Association for Computing Machinery, New York, NY, USA, 1371–1374. https://doi.org/10.1145/3209978.3210183Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Barney G. Glaser and Anselm L. Strauss. 1967. The Discovery of Grounded Theory: Strategies for Qualitative Research. Aldine de Gruyter, New York, NY.Google ScholarGoogle Scholar
  9. Peter Grasch, Alexander Felfernig, and Florian Reinfrank. 2013. ReComment: Towards Critiquing-Based Recommendation with Speech Interaction. In Proceedings of the 7th ACM Conference on Recommender Systems (Hong Kong, China) (RecSys ’13). Association for Computing Machinery, New York, NY, USA, 157–164. https://doi.org/10.1145/2507157.2507161Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. E. Holliman, J. Godfrey, and J. McDaniel. 1992. SWITCHBOARD: telephone speech corpus for research and development. In Acoustics, Speech, and Signal Processing, IEEE International Conference on, Vol. 1. IEEE Computer Society, Los Alamitos, CA, USA, 517–520. https://doi.org/10.1109/ICASSP.1992.225858Google ScholarGoogle Scholar
  11. Andrea Iovine, Fedelucio Narducci, and Giovanni Semeraro. 2020. Conversational Recommender Systems and natural language:: A study through the ConveRSE framework. Decision Support Systems 131 (2020), 113250. https://doi.org/10.1016/j.dss.2020.113250Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Dietmar Jannach, Ahtsham Manzoor, Wanling Cai, and Li Chen. 2020. A Survey on Conversational Recommender Systems. arxiv:2004.00646 [cs.HC]Google ScholarGoogle Scholar
  13. Chaitanya K. Joshi, Fei Mi, and Boi Faltings. 2017. Personalization in Goal-Oriented Dialog. arxiv:1706.07503 [cs.CL]Google ScholarGoogle Scholar
  14. Jie Kang, Kyle Condiff, Shuo Chang, Joseph A. Konstan, Loren Terveen, and F. Maxwell Harper. 2017. Understanding How People Use Natural Language to Ask for Recommendations. In Proceedings of the Eleventh ACM Conference on Recommender Systems (Como, Italy) (RecSys ’17). Association for Computing Machinery, New York, NY, USA, 229–237. https://doi.org/10.1145/3109859.3109873Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Raymond Li, Samira Ebrahimi Kahou, Hannes Schulz, Vincent Michalski, Laurent Charlin, and Chris Pal. 2018. Towards Deep Conversational Recommendations. In Advances in Neural Information Processing Systems 31, S. Bengio, H. Wallach, H. Larochelle, K. Grauman, N. Cesa-Bianchi, and R. Garnett (Eds.). Curran Associates, Inc., -, 9725–9735.Google ScholarGoogle Scholar
  16. Yukiko I. Nakano, Gabe Reinstein, Tom Stocky, and Justine Cassell. 2003. Towards a Model of Face-to-Face Grounding. In Proceedings of the 41st Annual Meeting on Association for Computational Linguistics - Volume 1 (Sapporo, Japan) (ACL ’03). Association for Computational Linguistics, USA, 553–561. https://doi.org/10.3115/1075096.1075166Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Roberto Pagano, Paolo Cremonesi, Martha Larson, Balázs Hidasi, Domonkos Tikk, Alexandros Karatzoglou, and Massimo Quadrana. 2016. The Contextual Turn: From Context-Aware to Context-Driven Recommender Systems. In Proceedings of the 10th ACM Conference on Recommender Systems (Boston, Massachusetts, USA) (RecSys ’16). Association for Computing Machinery, New York, NY, USA, 249–252. https://doi.org/10.1145/2959100.2959136Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Florian Pecune, Shruti Murali, Vivian Tsai, Yoichi Matsuyama, and Justine Cassell. 2019. A Model of Social Explanations for a Conversational Movie Recommendation System. In Proceedings of the 7th International Conference on Human-Agent Interaction (Kyoto, Japan) (HAI ’19). Association for Computing Machinery, New York, NY, USA, 135–143. https://doi.org/10.1145/3349537.3351899Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Chen Qu, Liu Yang, W. Bruce Croft, Johanne R. Trippas, Yongfeng Zhang, and Minghui Qiu. 2018. Analyzing and Characterizing User Intent in Information-Seeking Conversations. In The 41st International ACM SIGIR Conference on Research and Development in Information Retrieval (Ann Arbor, MI, USA) (SIGIR ’18). Association for Computing Machinery, New York, NY, USA, 989–992. https://doi.org/10.1145/3209978.3210124Google ScholarGoogle Scholar
  20. Arpit Rana and Derek Bridge. 2020. Navigation-by-Preference: A New Conversational Recommender with Preference-Based Feedback. In Proceedings of the 25th International Conference on Intelligent User Interfaces (Cagliari, Italy) (IUI ’20). Association for Computing Machinery, New York, NY, USA, 155–165. https://doi.org/10.1145/3377325.3377496Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Hideo Shimazu. 2002. ExpertClerk: A conversational case-cased reasoning tool for developing salesclerk agents in e-commerce webshops. Artificial Intelligence Review 18, 3-4 (2002), 223–244.Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Barry Smyth. 2007. Case-Based Recommendation. Springer Berlin Heidelberg, Berlin, Heidelberg, 342–376. https://doi.org/10.1007/978-3-540-72079-9_11Google ScholarGoogle Scholar
  23. Barry Smyth and Lorraine McGinty. 2003. An analysis of feedback strategies in conversational recommenders. In the Fourteenth Irish Artificial Intelligence and Cognitive Science Conference (AICS 2003). Citeseer, -, -, 218–223.Google ScholarGoogle Scholar
  24. Yueming Sun and Yi Zhang. 2018. Conversational Recommender System. In The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval (Ann Arbor, MI, USA) (SIGIR ’18). Association for Computing Machinery, New York, NY, USA, 235–244. https://doi.org/10.1145/3209978.3210002Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Taavi T. Taijala, Martijn C. Willemsen, and Joseph A. Konstan. 2018. MovieExplorer: Building an Interactive Exploration Tool from Ratings and Latent Taste Spaces. In Proceedings of the 33rd Annual ACM Symposium on Applied Computing (Pau, France) (SAC ’18). Association for Computing Machinery, New York, NY, USA, 1383–1392. https://doi.org/10.1145/3167132.3167281Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Cynthia A Thompson, Mehmet H Goker, and Pat Langley. 2004. A personalized system for conversational recommendations. Journal of Artificial Intelligence Research 21 (2004), 393–428.Google ScholarGoogle ScholarCross RefCross Ref
  27. N. Tintarev and J. Masthoff. 2007. A Survey of Explanations in Recommender Systems. In 2007 IEEE 23rd International Conference on Data Engineering Workshop. -, -, 801–810.Google ScholarGoogle Scholar
  28. Nava Tintarev and Judith Masthoff. 2011. Designing and Evaluating Explanations for Recommender Systems. Springer US, Boston, MA, 479–510.Google ScholarGoogle Scholar
  29. D. R. TRAUM. 1992. A Speech Acts Approach to Grounding in Conversation. Proceedings of International Conference on Spoken Language Processing (ICSLP’92) -(1992), 137–140.Google ScholarGoogle Scholar
  30. Vivian Tsai, Timo Baumann, Florian Pecune, and Justine Cassell. 2019. Faster Responses Are Better Responses: Introducing Incrementality into Sociable Virtual Personal Assistants. In 9th International Workshop on Spoken Dialogue System Technology, Luis Fernando D’Haro, Rafael E. Banchs, and Haizhou Li (Eds.). Springer Singapore, Singapore, 111–118.Google ScholarGoogle ScholarCross RefCross Ref
  31. Jesse Vig, Shilad Sen, and John Riedl. 2011. Navigating the Tag Genome. In Proceedings of the 16th International Conference on Intelligent User Interfaces (Palo Alto, CA, USA) (IUI ’11). Association for Computing Machinery, New York, NY, USA, 93–102. https://doi.org/10.1145/1943403.1943418Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Norha M. Villegas and Hausi A. Müller. 2010. Managing Dynamic Context to Optimize Smart Interactions and Services. Springer-Verlag, Berlin, Heidelberg, 289–318.Google ScholarGoogle Scholar
  33. Xiaoxue Zang, Abhinav Rastogi, Srinivas Sunkara, Raghav Gupta, Jianguo Zhang, and Jindong Chen. 2020. MultiWOZ 2.2 : A Dialogue Dataset with Additional Annotation Corrections and State Tracking Baselines. In Proceedings of the 2nd Workshop on Natural Language Processing for Conversational AI. Association for Computational Linguistics, Online, 109–117. https://doi.org/10.18653/v1/2020.nlp4convai-1.13Google ScholarGoogle ScholarCross RefCross Ref
  34. Yongfeng Zhang, Xu Chen, Qingyao Ai, Liu Yang, and W. Bruce Croft. 2018. Towards Conversational Search and Recommendation: System Ask, User Respond. In Proceedings of the 27th ACM International Conference on Information and Knowledge Management(Torino, Italy) (CIKM ’18). Association for Computing Machinery, New York, NY, USA, 177–186. https://doi.org/10.1145/3269206.3271776Google ScholarGoogle ScholarDigital LibraryDigital Library

Recommendations

Comments

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Sign in
  • Published in

    cover image ACM Conferences
    WWW '21: Proceedings of the Web Conference 2021
    April 2021
    4054 pages
    ISBN:9781450383127
    DOI:10.1145/3442381

    Copyright © 2021 ACM

    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    • Published: 3 June 2021

    Permissions

    Request permissions about this article.

    Request Permissions

    Check for updates

    Qualifiers

    • research-article
    • Research
    • Refereed limited

    Acceptance Rates

    Overall Acceptance Rate1,899of8,196submissions,23%

    Upcoming Conference

    WWW '24
    The ACM Web Conference 2024
    May 13 - 17, 2024
    Singapore , Singapore

PDF Format

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format .

View HTML Format