ABSTRACT
A number of recent works have made seminal contributions to the understanding of user intent and recommender interaction in conversational recommendation. However, to date, these studies have not focused explicitly on context-driven interaction that underlies the typical use of more pervasive Question Answering (QA) focused conversational assistants like Amazon Alexa, Apple Siri, and Google Assistant. In this paper, we aim to understand a general workflow of natural context-driven conversational recommendation that arises from a pairwise study of a human user interacting with a human simulating the role of a recommender. In our analysis of this intrinsically organic human-to-human conversation, we observe a clear structure of interaction workflow consisting of a preference elicitation and refinement stage, followed by inquiry and critiquing stages after the first recommendation. To better understand the nature of these stages and the conversational flow within them, we augment existing taxonomies of intent and action to label all interactions at each stage and analyze the workflow. From this analysis, we identify distinct conversational characteristics of each stage, e.g., (i) the preference elicitation stage consists of significant iteration to clarify, refine, and obtain a mutual understanding of preferences, (ii) the inquiry and critiquing stage consists of extensive informational queries to understand features of the recommended item and to (implicitly) specify critiques, and (iii) explanation appears to drive a substantial portion of the post-recommendation interaction, suggesting that beyond the purpose of justification, explanation serves a critical role to direct the evolving conversation itself. Altogether, we contribute a novel qualitative and quantitative analysis of workflow in conversational recommendation that further refines our existing understanding of this important frontier of conversational systems and suggests a number of critical avenues for further research to better automate natural recommendation conversations.
- Derek Bridge, Mehmet H. Göker, Lorraine McGinty, and Barry Smyth. 2005. Case-based recommender systems. Knowledge Engineering Review 20, 3 (2005), 315–320.Google ScholarDigital Library
- Wanling Cai and Li Chen. 2019. Towards a Taxonomy of User Feedback Intents for Conversational Recommendations.. In RecSys (Late-Breaking Results). Association for Computing Machinery, New York, NY, USA, 51–55.Google Scholar
- Wanling Cai and Li Chen. 2020. Predicting User Intents and Satisfaction with Dialogue-Based Conversational Recommendations. In Proceedings of the 28th ACM Conference on User Modeling, Adaptation and Personalization (Genoa, Italy) (UMAP ’20). Association for Computing Machinery, New York, NY, USA, 33–42. https://doi.org/10.1145/3340631.3394856Google ScholarDigital Library
- Konstantina Christakopoulou, Alex Beutel, Rui Li, Sagar Jain, and Ed H. Chi. 2018. Q&R: A Two-Stage Approach toward Interactive Recommendation. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining(London, United Kingdom) (KDD ’18). Association for Computing Machinery, New York, NY, USA, 139–148.Google ScholarDigital Library
- Konstantina Christakopoulou, Filip Radlinski, and Katja Hofmann. 2016. Towards Conversational Recommender Systems. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (San Francisco, California, USA) (KDD ’16). Association for Computing Machinery, New York, NY, USA, 815–824.Google ScholarDigital Library
- Herbert H. Clark and Edward F. Schaefer. 1989. Contributing to Discourse. Cognitive Science 13, 2 (1989), 259–294. https://doi.org/10.1207/s15516709cog1302_7 arXiv:https://onlinelibrary.wiley.com/doi/pdf/10.1207/s15516709cog1302_7Google ScholarCross Ref
- Jianfeng Gao, Michel Galley, and Lihong Li. 2018. Neural Approaches to Conversational AI. In The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval (Ann Arbor, MI, USA) (SIGIR ’18). Association for Computing Machinery, New York, NY, USA, 1371–1374. https://doi.org/10.1145/3209978.3210183Google ScholarDigital Library
- Barney G. Glaser and Anselm L. Strauss. 1967. The Discovery of Grounded Theory: Strategies for Qualitative Research. Aldine de Gruyter, New York, NY.Google Scholar
- Peter Grasch, Alexander Felfernig, and Florian Reinfrank. 2013. ReComment: Towards Critiquing-Based Recommendation with Speech Interaction. In Proceedings of the 7th ACM Conference on Recommender Systems (Hong Kong, China) (RecSys ’13). Association for Computing Machinery, New York, NY, USA, 157–164. https://doi.org/10.1145/2507157.2507161Google ScholarDigital Library
- E. Holliman, J. Godfrey, and J. McDaniel. 1992. SWITCHBOARD: telephone speech corpus for research and development. In Acoustics, Speech, and Signal Processing, IEEE International Conference on, Vol. 1. IEEE Computer Society, Los Alamitos, CA, USA, 517–520. https://doi.org/10.1109/ICASSP.1992.225858Google Scholar
- Andrea Iovine, Fedelucio Narducci, and Giovanni Semeraro. 2020. Conversational Recommender Systems and natural language:: A study through the ConveRSE framework. Decision Support Systems 131 (2020), 113250. https://doi.org/10.1016/j.dss.2020.113250Google ScholarDigital Library
- Dietmar Jannach, Ahtsham Manzoor, Wanling Cai, and Li Chen. 2020. A Survey on Conversational Recommender Systems. arxiv:2004.00646 [cs.HC]Google Scholar
- Chaitanya K. Joshi, Fei Mi, and Boi Faltings. 2017. Personalization in Goal-Oriented Dialog. arxiv:1706.07503 [cs.CL]Google Scholar
- Jie Kang, Kyle Condiff, Shuo Chang, Joseph A. Konstan, Loren Terveen, and F. Maxwell Harper. 2017. Understanding How People Use Natural Language to Ask for Recommendations. In Proceedings of the Eleventh ACM Conference on Recommender Systems (Como, Italy) (RecSys ’17). Association for Computing Machinery, New York, NY, USA, 229–237. https://doi.org/10.1145/3109859.3109873Google ScholarDigital Library
- Raymond Li, Samira Ebrahimi Kahou, Hannes Schulz, Vincent Michalski, Laurent Charlin, and Chris Pal. 2018. Towards Deep Conversational Recommendations. In Advances in Neural Information Processing Systems 31, S. Bengio, H. Wallach, H. Larochelle, K. Grauman, N. Cesa-Bianchi, and R. Garnett (Eds.). Curran Associates, Inc., -, 9725–9735.Google Scholar
- Yukiko I. Nakano, Gabe Reinstein, Tom Stocky, and Justine Cassell. 2003. Towards a Model of Face-to-Face Grounding. In Proceedings of the 41st Annual Meeting on Association for Computational Linguistics - Volume 1 (Sapporo, Japan) (ACL ’03). Association for Computational Linguistics, USA, 553–561. https://doi.org/10.3115/1075096.1075166Google ScholarDigital Library
- Roberto Pagano, Paolo Cremonesi, Martha Larson, Balázs Hidasi, Domonkos Tikk, Alexandros Karatzoglou, and Massimo Quadrana. 2016. The Contextual Turn: From Context-Aware to Context-Driven Recommender Systems. In Proceedings of the 10th ACM Conference on Recommender Systems (Boston, Massachusetts, USA) (RecSys ’16). Association for Computing Machinery, New York, NY, USA, 249–252. https://doi.org/10.1145/2959100.2959136Google ScholarDigital Library
- Florian Pecune, Shruti Murali, Vivian Tsai, Yoichi Matsuyama, and Justine Cassell. 2019. A Model of Social Explanations for a Conversational Movie Recommendation System. In Proceedings of the 7th International Conference on Human-Agent Interaction (Kyoto, Japan) (HAI ’19). Association for Computing Machinery, New York, NY, USA, 135–143. https://doi.org/10.1145/3349537.3351899Google ScholarDigital Library
- Chen Qu, Liu Yang, W. Bruce Croft, Johanne R. Trippas, Yongfeng Zhang, and Minghui Qiu. 2018. Analyzing and Characterizing User Intent in Information-Seeking Conversations. In The 41st International ACM SIGIR Conference on Research and Development in Information Retrieval (Ann Arbor, MI, USA) (SIGIR ’18). Association for Computing Machinery, New York, NY, USA, 989–992. https://doi.org/10.1145/3209978.3210124Google Scholar
- Arpit Rana and Derek Bridge. 2020. Navigation-by-Preference: A New Conversational Recommender with Preference-Based Feedback. In Proceedings of the 25th International Conference on Intelligent User Interfaces (Cagliari, Italy) (IUI ’20). Association for Computing Machinery, New York, NY, USA, 155–165. https://doi.org/10.1145/3377325.3377496Google ScholarDigital Library
- Hideo Shimazu. 2002. ExpertClerk: A conversational case-cased reasoning tool for developing salesclerk agents in e-commerce webshops. Artificial Intelligence Review 18, 3-4 (2002), 223–244.Google ScholarDigital Library
- Barry Smyth. 2007. Case-Based Recommendation. Springer Berlin Heidelberg, Berlin, Heidelberg, 342–376. https://doi.org/10.1007/978-3-540-72079-9_11Google Scholar
- Barry Smyth and Lorraine McGinty. 2003. An analysis of feedback strategies in conversational recommenders. In the Fourteenth Irish Artificial Intelligence and Cognitive Science Conference (AICS 2003). Citeseer, -, -, 218–223.Google Scholar
- Yueming Sun and Yi Zhang. 2018. Conversational Recommender System. In The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval (Ann Arbor, MI, USA) (SIGIR ’18). Association for Computing Machinery, New York, NY, USA, 235–244. https://doi.org/10.1145/3209978.3210002Google ScholarDigital Library
- Taavi T. Taijala, Martijn C. Willemsen, and Joseph A. Konstan. 2018. MovieExplorer: Building an Interactive Exploration Tool from Ratings and Latent Taste Spaces. In Proceedings of the 33rd Annual ACM Symposium on Applied Computing (Pau, France) (SAC ’18). Association for Computing Machinery, New York, NY, USA, 1383–1392. https://doi.org/10.1145/3167132.3167281Google ScholarDigital Library
- Cynthia A Thompson, Mehmet H Goker, and Pat Langley. 2004. A personalized system for conversational recommendations. Journal of Artificial Intelligence Research 21 (2004), 393–428.Google ScholarCross Ref
- N. Tintarev and J. Masthoff. 2007. A Survey of Explanations in Recommender Systems. In 2007 IEEE 23rd International Conference on Data Engineering Workshop. -, -, 801–810.Google Scholar
- Nava Tintarev and Judith Masthoff. 2011. Designing and Evaluating Explanations for Recommender Systems. Springer US, Boston, MA, 479–510.Google Scholar
- D. R. TRAUM. 1992. A Speech Acts Approach to Grounding in Conversation. Proceedings of International Conference on Spoken Language Processing (ICSLP’92) -(1992), 137–140.Google Scholar
- Vivian Tsai, Timo Baumann, Florian Pecune, and Justine Cassell. 2019. Faster Responses Are Better Responses: Introducing Incrementality into Sociable Virtual Personal Assistants. In 9th International Workshop on Spoken Dialogue System Technology, Luis Fernando D’Haro, Rafael E. Banchs, and Haizhou Li (Eds.). Springer Singapore, Singapore, 111–118.Google ScholarCross Ref
- Jesse Vig, Shilad Sen, and John Riedl. 2011. Navigating the Tag Genome. In Proceedings of the 16th International Conference on Intelligent User Interfaces (Palo Alto, CA, USA) (IUI ’11). Association for Computing Machinery, New York, NY, USA, 93–102. https://doi.org/10.1145/1943403.1943418Google ScholarDigital Library
- Norha M. Villegas and Hausi A. Müller. 2010. Managing Dynamic Context to Optimize Smart Interactions and Services. Springer-Verlag, Berlin, Heidelberg, 289–318.Google Scholar
- Xiaoxue Zang, Abhinav Rastogi, Srinivas Sunkara, Raghav Gupta, Jianguo Zhang, and Jindong Chen. 2020. MultiWOZ 2.2 : A Dialogue Dataset with Additional Annotation Corrections and State Tracking Baselines. In Proceedings of the 2nd Workshop on Natural Language Processing for Conversational AI. Association for Computational Linguistics, Online, 109–117. https://doi.org/10.18653/v1/2020.nlp4convai-1.13Google ScholarCross Ref
- Yongfeng Zhang, Xu Chen, Qingyao Ai, Liu Yang, and W. Bruce Croft. 2018. Towards Conversational Search and Recommendation: System Ask, User Respond. In Proceedings of the 27th ACM International Conference on Information and Knowledge Management(Torino, Italy) (CIKM ’18). Association for Computing Machinery, New York, NY, USA, 177–186. https://doi.org/10.1145/3269206.3271776Google ScholarDigital Library
Recommendations
Towards Conversational Search and Recommendation: System Ask, User Respond
CIKM '18: Proceedings of the 27th ACM International Conference on Information and Knowledge ManagementConversational search and recommendation based on user-system dialogs exhibit major differences from conventional search and recommendation tasks in that 1) the user and system can interact for multiple semantically coherent rounds on a task through ...
Conversational Collaborative Recommendation --- An Experimental Analysis
Traditionally, collaborative recommender systems have been based on a single-shot model of recommendation where a single set of recommendations is generated based on a user's (past) stored preferences. However, content-based recommender system research ...
Conversational recommendation: Theoretical model and complexity analysis
Highlights- Conversational recommenders help users find relevant items in an interactive way.
AbstractRecommender systems help users find items of interest in situations of information overload in a personalized way, using needs and preferences of individual users. In conversational recommendation approaches, the system acquires needs ...
Comments