Skip to main content

Combining Image and Structured Text Retrieval

  • Conference paper
Advances in XML Information Retrieval and Evaluation (INEX 2005)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 3977))

Abstract

Two common approaches in retrieving images from a collection are retrieval by text keywords and retrieval by visual content. However, it is widely recognised that it is impossible for keywords alone to fully describe visual content. This paper reports on the participation of the RMIT University group in the INEX 2005 multimedia track, where we investigated our approach of combining evidence from a content-oriented XML retrieval system and a content-based image retrieval system using a linear combination of evidence. Our approach yielded the best overall result for the INEX 2005 Multimedia track using the standard evaluation measures. We have extended our work by varying the parameter for the linear combination of evidence, and we have also examined the performance of runs submitted by participants by using the newly proposed HiXEval evaluation metric. We show that using CBIR in conjunction with text search leads to better retrieval performance.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Aslandogan, Y.A., Yu, C.T.: Evaluating Strategies and Systems for Content-Based Indexing of Person Images on the Web. In: MULTIMEDIA 2000: Proceedings of the Eighth ACM International Conference on Multimedia, pp. 313–321. ACM Press, New York (2000)

    Google Scholar 

  2. Haque, N.: Image Ranking for Multimedia Retrieval. Ph.D. thesis, School of Computer Science and Information Technology, Royal Melbourne Institute of Technology (2003)

    Google Scholar 

  3. Lee, J.H.: Analyses of Multiple Evidence Combination. In: SIGIR 1997: Proceedings of the 20th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 267–276. ACM Press, New York (1997)

    Google Scholar 

  4. Pehcevski, J., Thom, J.A., Vercoustre, A.-M.: Hybrid XML Retrieval: Combining Information Retrieval and a Native XML Database. Information Retrieval 8(4), 571–600 (2005)

    Article  Google Scholar 

  5. Pehcevski, J., Thom, J.A.: HiXEval: Highlighting XML Retrieval Evaluation. In: Fuhr, N., Lalmas, M., Malik, S., Kazai, G. (eds.) INEX 2005. LNCS, vol. 3977, pp. 11–24. Springer, Heidelberg (2006)

    Google Scholar 

  6. Pehcevski, J., Thom, J.A., Tahaghoghi, S.M.M.: RMIT University at INEX 2005. In: Fuhr, N., Lalmas, M., Malik, S., Kazai, G. (eds.) INEX 2005. LNCS, vol. 3977, pp. 217–233. Springer, Heidelberg (2006)

    Google Scholar 

  7. Squire, D.M., Müller, W., Müller, H., Pun, T.: Content-based Query of Image Databases: Inspirations from Text Retrieval. Pattern Recognition Letters 21(13-14), 1193–1198 (2000) (special edition for SCIA 1999)

    Article  MATH  Google Scholar 

  8. Tsikrika, T., Lalmas, M.: Merging Techniques for Performing Data Fusion on the Web. In: CIKM 2004: Proceedings of the Tenth International Conference on Information and Knowledge Management, pp. 127–134. ACM Press, New York (2001)

    Chapter  Google Scholar 

  9. Vogt, C.C., Cottrell, G.W.: Predicting the Performance of Linearly Combined IR Systems. In: SIGIR 1998: Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 190–196. ACM Press, New York (1998)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2006 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Iskandar, D.N.F.A., Pehcevski, J., Thom, J.A., Tahaghoghi, S.M.M. (2006). Combining Image and Structured Text Retrieval. In: Fuhr, N., Lalmas, M., Malik, S., Kazai, G. (eds) Advances in XML Information Retrieval and Evaluation. INEX 2005. Lecture Notes in Computer Science, vol 3977. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-34963-1_40

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-34963-1_40

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-34962-4

  • Online ISBN: 978-3-540-34963-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics