skip to main content
10.1145/3295750.3298961acmconferencesArticle/Chapter ViewAbstractPublication PagesirConference Proceedingsconference-collections
short-paper

Clarifying False Memories in Voice-based Search

Published: 08 March 2019 Publication History

Abstract

Queries containing false memories (i.e., attributes the user misremembered about a searched item) represent a challenge for search systems. A query with a false memory will match inadequate results or even no result, and an automatic query correction is necessary to satisfy the user expectations. For voice-based search interfaces, which aim at a natural, dialog-based search experience, a sensible answer to this kind of unintentionally ill-posed queries is even more crucial. However, the usual solutions in display-based interfaces for queries without matches (e.g., suggesting to drop some query terms) cannot really be transferred to the voice-based setting. Based on the assumption that false memory queries could be identified---a research problem in its own right---, we present the first user study on how voice-based search systems may communicate the respective corrections to a user. Our study compares the user satisfaction in a voice-based search setting for three kinds of false memory clarifications and a baseline case where the system just answers "I don't know.'' Our findings suggest that (1)~users are more satisfied when they receive a clarification that and how the system corrected a false memory, (2)~users even prefer failed correction attempts over no such attempt, and (3)~the tone of the clarification has to be considered for the best possible user satisfaction as well.

References

[1]
James Allan, W. Bruce Croft, Alistair Moffat, and Mark Sanderson. 2012. Frontiers, challenges, and opportunities for information retrieval: Report from SWIRL 2012. SIGIR Forum, Vol. 46, 1 (2012), 2--32.
[2]
Leif Azzopardi, Maarten de Rijke, and Krisztian Balog. 2007. Building simulated queries for known-item topics: an analysis using six european languages. In SIGIR 2007: Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Amsterdam, The Netherlands, July 23--27, 2007. 455--462.
[3]
Sumit Bhatia, Debapriyo Majumdar, and Prasenjit Mitra. 2011. Query suggestions in the absence of query logs. In Proceedings of SIGIR 2011. ACM, 795--804.
[4]
Tristan Blanc-Brude and Dominique L. Scapin. 2007. What do people recall about their documents?: implications for desktop search tools. In Proceedings of the 12th international conference on Intelligent user interfaces (IUI '07). ACM, New York, NY, USA, 102--111.
[5]
Pavel Braslavski, Denis Savenkov, Eugene Agichtein, and Alina Dubatovka. 2017. What Do You Mean Exactly?: Analyzing Clarification Questions in CQA. In Proceedings of CHIIR 2017. ACM, 345--348.
[6]
David Elsweiler, Mark Baillie, and Ian Ruthven. 2008. Exploring memory in email refinding. ACM Trans. Inf. Syst., Vol. 26, 4 (2008), 1--36.
[7]
David Elsweiler, Mark Baillie, and Ian Ruthven. 2011a. What makes re-finding information difficult? A study of email re-finding. In Proceedings of the 33rd European conference on Advances in information retrieval (ECIR'11). Springer-Verlag, Berlin, Heidelberg, 568--579. http://dl.acm.org/citation.cfm?id=1996889.1996963
[8]
David Elsweiler, David E. Losada, José Carlos Toucedo, and Ronald T. Ferná ndez. 2011b. Seeding simulated queries with user-study data forpersonal search evaluation. In Proceeding of the 34th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2011, Beijing, China, July 25-29, 2011. 25--34.
[9]
Matthias Hagen, Daniel W"a gner, and Benno Stein. 2015. A Corpus of Realistic Known-Item Topics with Associated Web Pages in the ClueWeb09. In Advances in Information Retrieval - 37th European Conference on IR Research, ECIR 2015, Vienna, Austria, March 29 - April 2, 2015. Proceedings. 513--525.
[10]
Claudia Hauff, Matthias Hagen, Anna Beyer, and Benno Stein. 2012. Towards realistic known-item topics for the ClueWeb. In Proceedings of the 4th Information Interaction in Context Symposium, IIiX 2012.
[11]
Claudia Hauff and Geert-Jan Houben. 2011. Cognitive Processes in Query Generation. In Advances in Information Retrieval Theory - Third International Conference, ICTIR 2011, Bertinoro, Italy, September 12--14, 2011. Proceedings. 176--187.
[12]
Johannes Kiesel, Arefeh Bahrami, Benno Stein, Avishek Anand, and Matthias Hagen. 2018. Toward Voice Query Clarification. In 41st International ACM Conference on Research and Development in Information Retrieval (SIGIR 2018). ACM, 1257--1260.
[13]
Jinyoung Kim and W. Bruce Croft. 2009. Retrieval experiments using pseudo-desktop collections. In Proceedings of the 18th ACM conference on Information and knowledge management (CIKM '09). ACM, New York, NY, USA, 1297--1306.
[14]
Jinyoung Kim and W. Bruce Croft. 2010. Ranking using multiple document types in desktop search. In Proceedings of the 33rd international ACM SIGIR conference on Research and development in information retrieval (SIGIR '10). ACM, New York, NY, USA, 50--57.
[15]
J Lai and N Yankelovich. 2006. Speech Interface Design. (12 2006).
[16]
Ewa Luger and Abigail Sellen. 2016. "Like Having a Really Bad PA": The Gulf Between User Expectation and Experience of Conversational Agents. In Proceedings of CHI 2016 (CHI '16). ACM, New York, NY, USA, 5286--5297.
[17]
Filip Radlinski and Nick Craswell. 2017. A theoretical framework for conversational search. In Proceedings of CHIIR 2017. ACM, 117--126.
[18]
Fabrizio Silvestri. 2009. Mining query logs: Turning search usage data into knowledge. Foundations and Trends in IR, Vol. 4, 1--2 (2009), 1--174.
[19]
Johanne R Trippas, Damiano Spina, Lawrence Cavedon, Hideo Joho, and Mark Sanderson. 2017. How Do People Interact in Conversational Speech-Only Search Tasks: A Preliminary Analysis. In Proceedings of CHIIR 2017. 325--328.
[20]
Johanne R Trippas, Damiano Spina, Lawrence Cavedon, Hideo Joho, and Mark Sanderson. 2018. Informing the Design of Spoken Conversational Search. (2018).
[21]
Sarah K. Tyler and Jaime Teevan. 2010. Large scale query log analysis of re-finding. In Proceedings of the Third International Conference on Web Search and Web Data Mining, WSDM 2010, New York, NY, USA, February 4-6, 2010. 191--200.
[22]
Alexandra Vtyurina, Denis Savenkov, Eugene Agichtein, and Charles LA Clarke. 2017. Exploring Conversational Search With Humans, Assistants, and Wizards. In Proceedings of CHI 2017. ACM, 2187--2193.

Cited By

View all
  • (2024)System and User Strategies to Repair Conversational Breakdowns of Spoken Dialogue Systems: A Scoping ReviewProceedings of the 6th ACM Conference on Conversational User Interfaces10.1145/3640794.3665558(1-13)Online publication date: 8-Jul-2024
  • (2024)Towards Detecting and Mitigating Cognitive Bias in Spoken Conversational SearchAdjunct Proceedings of the 26th International Conference on Mobile Human-Computer Interaction10.1145/3640471.3680245(1-10)Online publication date: 21-Sep-2024
  • (2022)A Systematic Review of Voice Assistant Usability: An ISO 9241–11 ApproachSN Computer Science10.1007/s42979-022-01172-33:4Online publication date: 3-May-2022
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
CHIIR '19: Proceedings of the 2019 Conference on Human Information Interaction and Retrieval
March 2019
463 pages
ISBN:9781450360258
DOI:10.1145/3295750
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 March 2019

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. clarification
  2. false memories
  3. query correction
  4. user study
  5. voice assistant
  6. voice query
  7. voice search
  8. voice-based search

Qualifiers

  • Short-paper

Conference

CHIIR '19
Sponsor:

Acceptance Rates

Overall Acceptance Rate 55 of 163 submissions, 34%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)16
  • Downloads (Last 6 weeks)3
Reflects downloads up to 16 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)System and User Strategies to Repair Conversational Breakdowns of Spoken Dialogue Systems: A Scoping ReviewProceedings of the 6th ACM Conference on Conversational User Interfaces10.1145/3640794.3665558(1-13)Online publication date: 8-Jul-2024
  • (2024)Towards Detecting and Mitigating Cognitive Bias in Spoken Conversational SearchAdjunct Proceedings of the 26th International Conference on Mobile Human-Computer Interaction10.1145/3640471.3680245(1-10)Online publication date: 21-Sep-2024
  • (2022)A Systematic Review of Voice Assistant Usability: An ISO 9241–11 ApproachSN Computer Science10.1007/s42979-022-01172-33:4Online publication date: 3-May-2022
  • (2022)Analyzing clarification in asynchronous information‐seeking conversationsJournal of the Association for Information Science and Technology10.1002/asi.2456273:3(449-471)Online publication date: 7-Feb-2022
  • (2021)Measuring Voice UX QuantitativelyExtended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411763.3451712(1-8)Online publication date: 8-May-2021
  • (2020)Understanding Voice Search Behavior: Review and Synthesis of ResearchHCI International 2020 - Late Breaking Papers: Multimodality and Intelligence10.1007/978-3-030-60117-1_23(305-320)Online publication date: 17-Oct-2020

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media