skip to main content
10.1145/3539618.3593069acmconferencesArticle/Chapter ViewAbstractPublication PagesirConference Proceedingsconference-collections
keynote

Tasks, Copilots, and the Future of Search

Published: 18 July 2023 Publication History

Abstract

Tasks are central to information retrieval (IR) and drive interactions with search systems [2, 4, 10]. Understanding and modeling tasks helps these systems better support user needs [8, 9, 11]. This keynote focuses on search tasks, the emergence of generative artificial intelligence (AI), and the implications of recent work at their intersection for the future of search. Recent estimates suggest that half of Web search queries go unanswered, many of them connected to complex search tasks that are ill-defined or multi-step and span several queries[6]. AI copilots, e.g., ChatGPT and Bing Chat, are emerging to address complex search tasks and many other challenges. These copilots are built on large foundation models such as GPT-4 and are being extended with skills and plugins. Copilots broaden the surface of tasks achievable via search, moving toward creation not just finding (e.g., interview preparation, email composition), and can make searchers more efficient and more successful.
Users currently engage with AI copilots via natural language queries and dialog and the copilots generate answers with source attribution [7]. However, in delegating responsibility for answer generation, searchers also lose some control over aspects of the search process, such as directly manipulating queries and examining lists of search results [1]. The efficiency gains from auto-generating a single, synthesized answer may also reduce opportunities for user learning and serendipity. A wholesale move to copilots for all search tasks is neither practical nor necessary: model inference is expensive, conversational interfaces are unfamiliar to many users in a search context, and traditional search already excels for many types of task. Instead, experiences that unite search and chat are becoming more common, enabling users to adjust the modality and other aspects (e.g., answer tone) based on the task.
The rise of AI copilots creates many opportunities for IR, including aligning generated answers with user intent, tasks, and applications via human feedback [3]; understanding copilot usage, including functional fixedness [5]; using context and data to tailor responses to people and situations (e.g., grounding, personalization); new search experiences (e.g., unifying search and chat); reliability and safety (e.g., accuracy, bias); understanding impacts on user learning and agency; and evaluation (e.g., model-based feedback, searcher simulations [12] repeatability). Research in these and related areas will enable search systems to more effectively utilize new copilot technologies together with traditional search to help searchers better tackle a wider variety of tasks.

References

[1]
Marcia J Bates. 1990. Where should the person stop and the information search interface start? Information Processing and Management, Vol. 26, 5 (1990), 575--591.
[2]
Nicholas J Belkin. 1980. Anomalous states of knowledge as a basis for information retrieval. Canadian Journal of Information Science, Vol. 5, 1 (1980), 133--143.
[3]
Paul F Christiano, Jan Leike, Tom Brown, Miljan Martic, Shane Legg, and Dario Amodei. 2017. Deep reinforcement learning from human preferences. Advances in Neural Information Processing Systems, Vol. 30 (2017), 4302--4310.
[4]
Brenda Dervin. 1998. Sense-making theory and practice: An overview of user interests in knowledge seeking and use. Journal of Knowledge Management, Vol. 2, 2 (1998), 36--46.
[5]
Karl Duncker and Lynne S Lees. 1945. On problem-solving. Psychological Monographs, Vol. 58, 5 (1945), i.
[6]
Ahmed Hassan Awadallah, Ryen W White, Patrick Pantel, Susan T Dumais, and Yi-Min Wang. 2014. Supporting complex search tasks. In Proceedings of the 23rd ACM CIKM International Conference on Information and Knowledge Management. 829--838.
[7]
Patrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni, Vladimir Karpukhin, Naman Goyal, Heinrich Küttler, Mike Lewis, Wen-tau Yih, Tim Rocktäschel, et al. 2020. Retrieval-augmented generation for knowledge-intensive NLP tasks. Advances in Neural Information Processing Systems, Vol. 33 (2020), 9459--9474.
[8]
Chirag Shah and Ryen W White. 2021. Task intelligence for search and recommendation. Synthesis Lectures on Information Concepts, Retrieval, and Services, Vol. 13, 3 (2021), 1--160.
[9]
Chirag Shah, Ryen W White, Paul Thomas, Bhaskar Mitra, Shawon Sarkar, and Nicholas Belkin. 2023. Taking search to task. In Proceedings of the 2023 ACM CHIIR Conference on Human Information Interaction and Retrieval. 1--13.
[10]
Ryen W White. 2016. Interactions with Search Systems. Cambridge University Press.
[11]
Ryen W White, Adam Fourney, Allen Herring, Paul N Bennett, Nirupama Chandrasekaran, Robert Sim, Elnaz Nouri, and Mark J Encarnación. 2019. Multi-device digital assistance. Commun. ACM, Vol. 62, 10 (2019), 28--31.
[12]
Ryen W White, Ian Ruthven, Joemon M Jose, and CJ Van Rijsbergen. 2005. Evaluating implicit feedback models using searcher simulations. ACM Transactions on Information Systems, Vol. 23, 3 (2005), 325--361.

Cited By

View all
  • (2024)Report on the Search Futures Workshop at ECIR 2024ACM SIGIR Forum10.1145/3687273.368728858:1(1-41)Online publication date: 7-Aug-2024
  • (2024)IntroductionInformation Access in the Era of Generative AI10.1007/978-3-031-73147-1_1(1-13)Online publication date: 25-Dec-2024
  • (2024)SMARTProceedings of the Association for Information Science and Technology10.1002/pra2.120461:1(1120-1122)Online publication date: 15-Oct-2024

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
SIGIR '23: Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval
July 2023
3567 pages
ISBN:9781450394086
DOI:10.1145/3539618
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 July 2023

Check for updates

Author Tags

  1. artificial intelligence
  2. complex tasks
  3. copilots
  4. search experience
  5. search systems
  6. task intelligence
  7. task models
  8. tasks
  9. web search

Qualifiers

  • Keynote

Conference

SIGIR '23
Sponsor:

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)82
  • Downloads (Last 6 weeks)4
Reflects downloads up to 05 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Report on the Search Futures Workshop at ECIR 2024ACM SIGIR Forum10.1145/3687273.368728858:1(1-41)Online publication date: 7-Aug-2024
  • (2024)IntroductionInformation Access in the Era of Generative AI10.1007/978-3-031-73147-1_1(1-13)Online publication date: 25-Dec-2024
  • (2024)SMARTProceedings of the Association for Information Science and Technology10.1002/pra2.120461:1(1120-1122)Online publication date: 15-Oct-2024

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media