Skip to main content

An Integrated Approach for Medical Image Retrieval through Combining Textual and Visual Features

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 6242))

Abstract

In this paper, we present an empirical study for monolingual medical image retrieval. In particular, we present a series of experiments in ImageCLEFmed 2009 task. There are three main goals. First, we evaluate traditional well-known weighting models in the text retrieval domain, such as BM25, TFIDF and Language Model (LM), for context-based image retrieval. Second, we evaluate statistical-based feedback models and ontology-based feedback models. Third, we investigate how content-based image retrieval can be integrated with these two basic technologies in traditional text retrieval domain. The experimental results have shown that: 1) traditional weighting models work well in context-based medical image retrieval task especially when the parameters are tuned properly; 2) statistical-based feedback models can further improve the retrieval performance when a small number of documents are used for feedback; however, the medical image retrieval can not benefit from ontology-based query expansion method used in this paper; 3) the retrieval performance can be slightly boosted via an integrated retrieval approach.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Zhai, C.: Statistical Language Models for Information Retrieval: A Critical Review. Foundations and Trends in Information Retrieval 2(3), 137–213 (2008)

    Article  Google Scholar 

  2. Muller, H., Kalpathy-Cramer, J., Eggel, I., Bedrick, S., Radhouani, S., Bakke, B., Kahn Jr., C., Hersh, W.: Overview of the CLEF 2009 Medical Image Retrieval Track. In: Peters, C., et al. (eds.) CLEF 2009 Workshop, Part II. LNCS, vol. 6242, pp. 72–84. Springer, Heidelberg (2010)

    Google Scholar 

  3. Muller, H., Deselaers, T., Kim, E., Kalpathy-Cramer, J., Deserno, T., Clough, P., Hersh, W.: Overview of the ImageCLEFmed 2007 Medical Retrieval and Annotation Tasks. In: Peters, C., Jijkoun, V., Mandl, T., Müller, H., Oard, D.W., Peñas, A., Petras, V., Santos, D. (eds.) CLEF 2007. LNCS, vol. 5152, pp. 472–491. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  4. Hancock-Beaulieu, M., Gatford, M., Huang, X., Robertson, S.E., Walker, S., Williams, P.W.: Okapi at TREC-5. In: Text REtrieval Conference (TREC) TREC-5 Proceedings (1996)

    Google Scholar 

  5. Zhang, R., Yi, C., Zheng, Z., Metzler, D., Nie, J.: Search Result Re-ranking by Feedback Control Adjustment for Time-Sensitive Query. In: Proceedings of North American Chapter of the Association for Computational Linguistics - Human Language Technologies (NAACL HLT), pp. 165–168 (2009)

    Google Scholar 

  6. Singhal, A., Buckley, C., Mitra, M.: Pivoted Document Length Normalization. In: SIGIR 1996: Proceedings of the 19th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 21–29. ACM, New York (1996)

    Chapter  Google Scholar 

  7. Amati, G.: Probabilistic Models for Information Retrieval based on Divergence From Randomness. PhD thesis, Department of Computing Science, University of Glasgow (2003)

    Google Scholar 

  8. Gasteratos, A., Vincze, M., Tsotsos, J.: CEDD: Color and Edge Directivity Descriptor. A Compact Descriptor for Image Indexing and Retrieval. In: Gasteratos, A., Vincze, M., Tsotsos, J.K. (eds.) ICVS 2008. LNCS, vol. 5008, pp. 312–322. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  9. Tamura, Hideyuki Mori, S., Yamawaki, T.: Textural Features Corresponding to Visual Perception. IEEE Transactions on Systems, Man and Cybernetics 8, 460–473 (1978)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Ye, Z., Huang, X., Hu, Q., Lin, H. (2010). An Integrated Approach for Medical Image Retrieval through Combining Textual and Visual Features. In: Peters, C., et al. Multilingual Information Access Evaluation II. Multimedia Experiments. CLEF 2009. Lecture Notes in Computer Science, vol 6242. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-15751-6_23

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-15751-6_23

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-15750-9

  • Online ISBN: 978-3-642-15751-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics