Timing of Aspect Suggestion to Encourage Diverse Information Acquisition in Spoken Conversational Search
Pages 145 - 153
Abstract
Spoken conversational search is a type of search where no screens are available and the interactions between users and systems are entirely voice-based. To obtain diverse information in spoken conversational search, it is essential for the system to suggest what should be searched for next. We refer to such a suggestion as an aspect suggestion. In this work, we focus on the timing of when the system should provide aspect suggestions and investigate whether the timing of the suggestion affects the participants' querying behavior. We conducted a user study (N=27) using the Wizard of Oz method, in which we compared three systems: (1) a system without aspect suggestion (no aspect suggestion), (2) a system that provides an aspect suggestion immediately after answering the participant's query (immediate aspect suggestion), and (3) a system that provides an aspect suggestion when the user is facing difficulty in formulating a new query (delayed aspect suggestion). The results of the study revealed that aspect suggestions enabled the participants to obtain more diverse information. Additionally, we observed that the delayed aspect suggestion facilitated the participants to formulate queries more spontaneously compared with the immediate aspect suggestion. Interview results indicated a participant preference for immediate aspect suggestion when lacking domain knowledge or query ideas.
References
[1]
Adobe. 2019. State of Voice. Adobe Digital Insights 2019 (2019), 7.
[2]
Mohammad Aliannejadi, Leif Azzopardi, Hamed Zamani, Evangelos Kanoulas, Paul Thomas, and Nick Craswell. 2021. Analysing Mixed Initiatives and Search Strategies during Conversational Search. In Proceedings of the 30th ACM International Conference on Information and Knowledge Management. 16--26.
[3]
Mohammad Aliannejadi, Hamed Zamani, Fabio Crestani, and W. Bruce Croft. 2019. Asking Clarifying Questions in Open-Domain Information-Seeking Conversations. In Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval. 475--484.
[4]
James. F. Allen, Curry. I. Guinn, and Eric. Horvtz. 1999. Mixed-Initiative Interaction. IEEE Intelligent Systems and their Applications, Vol. 14, 5 (1999), 14--23.
[5]
Avishek Anand, Lawrence Cavedon, Hideo Joho, Mark Sanderson, and Benno Stein. 2020. Conversational Search (Dagstuhl Seminar 19461). Dagstuhl Reports, Vol. 9, 11 (2020), 34--83.
[6]
Negar Arabzadeh, Mahsa Seifikar, and Charles L.A. Clarke. 2022. Unsupervised Question Clarity Prediction through Retrieved Item Coherency. In Proceedings of the 31st ACM International Conference on Information and Knowledge Management. 3811--3816.
[7]
Marcia J. Bates. 1989. The Design of Browsing and Berrypicking Techniques for the Online Search Interface. Online Review, Vol. 13, 5 (1989), 407--424.
[8]
Paolo Boldi, Francesco Bonchi, Carlos Castillo, and Sebastiano Vigna. 2009. From “Dango” to “Japanese Cakes”: Query Reformulation Models and Patterns. In Proceedings of the 2009 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology. 183--190.
[9]
Johan Boye, Beth Ann Hockey, and Manny Rayner. 2000. Asynchronous Dialogue Management: Two Case-Studies. In Gotalog: 4th Workshop on the Semantics and Pragmatics of Dialogue.
[10]
John Brooke. 1996. SUS-A Quick and Dirty Usability Scale. Usability Evaluation in Industry, Vol. 189, 194 (1996), 4--7.
[11]
Ben Carterette, Evangelos Kanoulas, Ashraf Bah, Mark Hall, and Paul Clough. 2013. Overview of the TREC 2013 Session Track. In Proceedings of TREC 2013.
[12]
Nils Dahlbäck, Arne Jönsson, and Lars Ahrenberg. 1993. Wizard of Oz Studies: Why and How. In Proceedings of the 1st International Conference on Intelligent ser Interfaces. 193--200.
[13]
Mateusz Dubiel, Martin Halvey, Leif Azzopardi, and Sylvain Daronnat. 2018. Investigating How Conversational Search Agents Affect User's Behaviour, Performance and Search Experience. In Proceedings of the 2nd International Workshop on Conversational Approaches to Information Retrieval.
[14]
Will Gibson. 2009. Intercultural Communication Online: Conversation Analysis and the Investigation of Asynchronous Written Discourse. Forum: Qualitative Social Research, Vol. 10, 1 (2009), 18.
[15]
Jiafeng Guo, Xueqi Cheng, Gu Xu, and Huawei Shen. 2010. A Structured Approach to Query Recommendation with Social Annotation Data. In Proceedings of the 19th ACM International Conference on Information and Knowledge Management. 619--628.
[16]
Eric Horvitz. 1999. Principles of Mixed-Initiative User Interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 159--166.
[17]
Makoto P. Kato, Tetsuya Sakai, and Katsumi Tanaka. 2012. Structured Query Suggestion for Specialization and Parallel Movement: Effect on Search Behaviors. In Proceedings of the 21st International Conference on World Wide Web. 389--398.
[18]
Diane Kelly. 2009. Methods for Evaluating Interactive Information Retrieval Systems with Users. Foundations and Trends in Information Retrieval.
[19]
Johannes Kiesel, Arefeh Bahrami, Benno Stein, Avishek Anand, and Matthias Hagen. 2018. Toward Voice Query Clarification. In Proceedings of the 41st International ACM SIGIR Conference on Research and Development in Information Retrieval. 1257--1260.
[20]
Gary Marchionini. 1997. Information Seeking in Electronic Environments. Cambridge University Press.
[21]
Gary Marchionini. 2006. Exploratory Search: from Finding to Understanding. Commun. ACM, Vol. 49, 4 (2006), 41--46.
[22]
Chuan Meng, Mohammad Aliannejadi, and Maarten de Rijke. 2023. System Initiative Prediction for Multi-turn Conversational Information Seeking. In Proceedings of the 32nd ACM International Conference on Information and Knowledge Management. 1807--1817.
[23]
Srishti Palani, Yingyi Zhou, Sheldon Zhu, and Steven P. Dow. 2022. InterWeave: Presenting Search Suggestions in Context Scaffolds Information Search and Synthesis. In Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology. 1--16.
[24]
Filip Radlinski and Nick Craswell. 2017. A Theoretical Framework for Conversational Search. In Proceedings of the 2017 Conference on Conference Human Information Interaction and Retrieval. 117--126.
[25]
Gary Ren, Xiaochuan Ni, Manish Malik, and Qifa Ke. 2018. Conversational Query Understanding Using Sequence to Sequence Modeling. In Proceedings of the 2018 World Wide Web Conference. 1715--1724.
[26]
Fumiaki Saito, Yoshiyuki Shoji, and Yusuke Yamamoto. 2020. Highlighting Weasel Sentences for Promoting Critical Information Seeking on the Web. In International Conference on Web Information Systems Engineering. 424--440.
[27]
Tetsuya Sakai and Ruihua Song. 2011. Evaluating Diversified Search Results Using Per-Intent Graded Relevance. In Proceedings of the 34th International ACM SIGIR Conference on Research and Development in Information Retrieval. 1043--1052.
[28]
Iulian Vlad Serban, Ryan Lowe, Peter Henderson, Laurent Charlin, and Joelle Pineau. 2018. A Survey of Available Corpora for Building Data-Driven Dialogue Systems: The Journal Version. Dialogue Discourse, Vol. 9, 1 (2018), 1--49.
[29]
Leila Tavakoli, Hamed Zamani, Falk Scholer, W. Bruce Croft, and Mark Sanderson. 2022. Analyzing Clarification in Asynchronous Information-Seeking Conversations. Journal of the Association for Information Science and Technology, Vol. 73, 3 (2022), 449--471.
[30]
Johanne R. Trippas. 2021. Spoken Conversational Search: Audio-Only Interactive Information Retrieval. In ACM SIGIR Forum. 106--107.
[31]
Johanne R. Trippas, Damiano Spina, Lawrence Cavedon, Hideo Joho, and Mark Sanderson. 2018. Informing the Design of Spoken Conversational Search: Perspective paper. In Proceedings of the 2018 Conference on Human Information Interaction and Retrieval. 32--41.
[32]
Johanne R. Trippas, Damiano Spina, Lawrence Cavedon, and Mark Sanderson. 2017. How Do People Interact in Conversational Speech-Only Search Tasks: A Preliminary Analysis. In Proceedings of the 2017 Conference on Human Information Interaction and Retrieval. 325--328.
[33]
Kazutoshi Umemoto, Takehiro Yamamoto, and Katsumi Tanaka. 2016. Scentbar: A Query Suggestion Interface Visualizing the Amount of Missed Relevant Information for Intrinsically Diverse Search. In Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval. 405--414.
[34]
Alexandra Vtyurina, Denis Savenkov, Eugene Agichtein, and Charles L.A. Clarke. 2017. Exploring Conversational Search With Humans, Assistants, and Wizards. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems. 2187--2193.
[35]
Somin Wadhwa and Hamed Zamani. 2021. Towards System-Initiative Conversational Information Seeking. In Proceedings of the 2nd International Conference on Design of Experimental Search and Information Retrieval Systems. 102--116.
[36]
Ryen W. White and Resa A. Roth. 2009. Exploratory Search: Beyond the Query-Response Paradigm. Morgan and Claypool Publishers.
[37]
Jingjing Xu, Yuechen Wang, Duyu Tang, Nan Duan, Pengcheng Yang, Qi Zeng, Ming Zhou, and Xu Sun. 2019. Asking Clarification Questions in Knowledge-Based Question Answering. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing. 1618--1629.
[38]
Yusuke Yamamoto and Takehiro Yamamoto. 2018. Query Priming for Promoting Critical Thinking in Web Search. In Proceedings of the 2018 Conference on Human Information Interaction and Retrieval. 12--21.
[39]
Hamed Zamani, Bhaskar Mitra, Everest Chen, Gord Lueck, Fernando Diaz, Paul N. Bennett, Nick Craswell, and Susan T. Dumais. 2020. Analyzing and Learning from User Interactions for Search Clarification. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. 1181--1190.
Index Terms
- Timing of Aspect Suggestion to Encourage Diverse Information Acquisition in Spoken Conversational Search
Recommendations
Post-ranking query suggestion by diversifying search results
SIGIR '11: Proceedings of the 34th international ACM SIGIR conference on Research and development in Information RetrievalQuery suggestion refers to the process of suggesting related queries to search engine users. Most existing researches have focused on improving the relevance of suggested queries. In this paper, we introduce the concept of diversifying the content of ...
Mining Web search engines for query suggestion
Queries to Web search engines are usually short and ambiguous, which provides insufficient information needs of users for effectively retrieving relevant Web pages. To address this problem, query suggestion is implemented by most search engines. However,...
Search-based query suggestion
CIKM '08: Proceedings of the 17th ACM conference on Information and knowledge managementIn this paper, we proposed a unified strategy to combine query log and search results for query suggestion. In this way, we leverage both the users' search intentions for popular queries and the power of search engines for unpopular queries. The ...
Comments
Information & Contributors
Information
Published In
December 2024
328 pages
ISBN:9798400707247
DOI:10.1145/3673791
- General Chairs:
- Tetsuya Sakai,
- Emi Ishita,
- Hiroaki Ohshima,
- Program Chairs:
- Faegheh Hasibi,
- Jiaxin Mao,
- Joemon Jose
Copyright © 2024 Owner/Author.
This work is licensed under a Creative Commons Attribution International 4.0 License.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 08 December 2024
Check for updates
Author Tags
Qualifiers
- Research-article
Conference
SIGIR-AP 2024
Sponsor:
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 89Total Downloads
- Downloads (Last 12 months)89
- Downloads (Last 6 weeks)23
Reflects downloads up to 25 Feb 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in