Skip to main content
SpringerLink
Log in

Conversational Search for Multimedia Archives

  • Conference paper
  • First Online:
Advances in Information Retrieval (ECIR 2023)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 13982))

Included in the following conference series:

  • 1531 Accesses

Abstract

The growth of media archives (including text, speech, video and audio) has led to significant interest in developing search methods for multimedia content. An ongoing challenge of multimedia search is user interaction during the search process, including specification of search queries, presentation of retrieved content and user feedback. In parallel with this, recent years have seen increasing interest in conversational search methods enabling users to engage in a dialogue with an AI agent that supports their search activities. Conversational search seeks to enable users to find useful content more easily, quickly and reliably. To date, research in conversational search has focused on text archives. This project explores the integration of conversational search methods within multimedia search.

Supported by the SFI Centre for Research Training (CRT) in Digitally-Enhanced Reality (d-real).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Aliannejadi, M., Azzopardi, L., Zamani, H., Kanoulas, E., Thomas, P., Craswell, N.: Analysing mixed initiatives and search strategies during conversational search. In: Proceedings of the 30th ACM International Conference on Information & Knowledge Management, pp. 16–26 (2021)

    Google Scholar 

  2. Aliannejadi, M., Zamani, H., Crestani, F., Croft, W.B.: Asking clarifying questions in open-domain information-seeking conversations. In: Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 475–484 (2019)

    Google Scholar 

  3. Grycuk, R., Scherer, R.: Software framework for fast image retrieval. In: Proceedings of the 24th International Conference on Methods and Models in Automation and Robotics (MMAR 2019), pp. 588–593. IEEE (2019)

    Google Scholar 

  4. Hodosh, M., Young, P., Hockenmaier, J.: Framing image description as a ranking task: data, models and evaluation metrics. J. Artif. Intell. Res. 47, 853–899 (2013)

    Article  MathSciNet  MATH  Google Scholar 

  5. Kaushik, A., Jacob, B., Velavan, P.: An exploratory study on a reinforcement learning prototype for multimodal image retrieval using a conversational search interface. Knowledge 2(1), 116–138 (2022)

    Article  Google Scholar 

  6. Kim, H., Kim, D., Yoon, S., Dernoncourt, F., Bui, T., Bansal, M.: CAISE: conversational agent for image search and editing. In: Proceedings of the Thirty-Sixth AAAI Conference on Artificial Intelligence (AAAI-2022) (2022)

    Google Scholar 

  7. Lin, T., et al: Microsoft COCO: common objects in context. CoRR abs/1405.0312 (2014). http://arxiv.org/abs/1405.0312

  8. Moore, B.E., Corso, J.J.: Fiftyone (2020). https://github.com/voxel51/fiftyone

  9. Munjal, M.N., Bhatia, S.: A novel technique for effective image gallery search using content based image retrieval system. In: 2019 International Conference on Machine Learning, Big Data, Cloud and Parallel Computing (COMITCon), pp. 25–29. IEEE (2019)

    Google Scholar 

  10. Nie, L., Jiao, F., Wang, W., Wang, Y., Tian, Q.: Conversational image search. IEEE Trans. Image Process. 30, 7732–7743 (2021)

    Article  Google Scholar 

  11. Pawaskar, S.K., Chaudhari, S.: Web image search engine using semantic of images’s meaning for achieving accuracy. In: 2016 International Conference on Automatic Control and Dynamic Optimization Techniques (ICACDOT), pp. 99–103. IEEE (2016)

    Google Scholar 

  12. Radford, A., et al.: Learning transferable visual models from natural language supervision. CoRR abs/2103.00020 (2021). https://arxiv.org/abs/2103.00020

  13. Radlinski, F., Craswell, N.: A theoretical framework for conversational search. In: Proceedings of the 2017 Conference on Conference Human Information Interaction and Retrieval, pp. 117–126 (2017)

    Google Scholar 

  14. Xu, J., Mei, T., Yao, T., Rui, Y.: MSR-VTT: a large video description dataset for bridging video and language. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 5288–5296 (2016)

    Google Scholar 

  15. Zamani, H., Dumais, S., Craswell, N., Bennett, P., Lueck, G.: Generating clarifying questions for information retrieval. In: Proceedings of the Web Conference 2020, pp. 418–428 (2020)

    Google Scholar 

  16. Zamani, H., et al.: Analyzing and learning from user interactions for search clarification. In: Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 1181–1190 (2020)

    Google Scholar 

  17. Zamani, H., Trippas, J.R., Dalton, J., Radlinski, F.: Conversational information seeking. arXiv preprint arXiv:2201.08808 (2022)

Download references

Acknowledgement

This work was conducted with the financial support of the Science Foundation Ireland Centre for Research Training in Digitally-Enhanced Reality (d-real) under Grant No. 18/CRT/6224.

Author information

Authors and Affiliations

  1. ADAPT Centre, School of Computing, Dublin City University, Dublin 9, Ireland

    Anastasia Potyagalova

Authors
  1. Anastasia Potyagalova
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Anastasia Potyagalova .

Editor information

Editors and Affiliations

  1. University of Amsterdam, Amsterdam, The Netherlands

    Jaap Kamps

  2. Université Grenoble-Alpes, Saint-Martin-d’Hères, France

    Lorraine Goeuriot

  3. Università della Svizzera Italiana, Lugano, Switzerland

    Fabio Crestani

  4. University of Copenhagen, Copenhagen, Denmark

    Maria Maistro

  5. University of Tsukuba, Ibaraki, Japan

    Hideo Joho

  6. Dublin City University, Dublin, Ireland

    Brian Davis

  7. Dublin City University, Dublin, Ireland

    Cathal Gurrin

  8. Universität Regensburg, Regensburg, Germany

    Udo Kruschwitz

  9. Dublin City University, Dublin, Ireland

    Annalina Caputo

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Potyagalova, A. (2023). Conversational Search for Multimedia Archives. In: Kamps, J., et al. Advances in Information Retrieval. ECIR 2023. Lecture Notes in Computer Science, vol 13982. Springer, Cham. https://doi.org/10.1007/978-3-031-28241-6_53

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-28241-6_53

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-28240-9

  • Online ISBN: 978-3-031-28241-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation