Skip to main content
Springer Nature Link
Log in

Large-Scale Cross-Media Retrieval of WikipediaMM Images with Textual and Visual Query Expansion

  • Conference paper
Evaluating Systems for Multilingual and Multimodal Information Access (CLEF 2008)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 5706))

Included in the following conference series:

  • 448 Accesses

Abstract

In this paper, we present our approaches for the WikipediaMM task at ImageCLEF 2008. We first experimented with a text-based image retrieval approach with query expansion, where the extension terms were automatically selected from a knowledge base that was semi-automatically constructed from Wikipedia. Encouragingly, the experimental results rank in the first place among all submitted runs. We also implemented a content-based image retrieval approach with query-dependent visual concept detection. Then cross-media retrieval was successfully carried out by independently applying the two meta-search tools and then combining the results through a weighted summation of scores. Though not submitted, this approach outperforms our text-based and content-based approaches remarkably.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Tian, Y.H., Huang, T.J., Gao, W.: Exploiting multi-context analysis in semantic image classification. J. Zhejiang Univ. SCI. 6A(11), 1268–1283 (2005)

    Article  Google Scholar 

  2. Strube, M., Ponzetto, S.: WikiRelate! Computing semantic relatedness using Wikipedia. In: Proc. of National Conference on Artificial Intelligence (AAAI 2006), Boston, Mass, pp. 1419–1424 (2006)

    Google Scholar 

  3. Nakayama, K., Hara, T., Nishio, S.: A thesaurus construction method from large scale web dictionaries. In: Proc. of IEEE International Conference on Advanced Information Networking and Applications (AINA 2007), pp. 932–939 (2007)

    Google Scholar 

  4. Huang, C., Tian, Y.H., Zhou, Z., Ling, C.X., Huang, T.J.: Keyphrase extraction using Semantic Networks Structure Analysis. In: Proc. of the sixth IEEE Int’l. Conf. on Data Mining (ICDM 2006), pp. 275–284. IEEE press, Hong Kong (2006)

    Chapter  Google Scholar 

  5. Lowe, D.: Object recognition from local scale-invariant feature. In: Proc. Int’l Conf. Computer Vision (ICCV 1999), pp. 1150–1157 (1999)

    Google Scholar 

  6. Lazebnik, S., Schmid, C., Ponce, J.: Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories. In: Proceedings of the IEEE CVPR 2006, pp. 2169–2178 (2006)

    Google Scholar 

  7. Hofmann, T.: Unsupervised learning by probabilistic latent semantic analysis. Machine Learning 41, 177–196 (2001)

    Article  MATH  Google Scholar 

  8. Smeulders, A.W.M., Worring, M., Santini, S., Gupta, A., Jain, R.: Content-based image retrieval at the end of the early years. IEEE Trans. Pattern Anal. Mach Intell. 22(12), 1349–1380 (2000)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Key Laboratory of Intelligent Information Processing, Institute of Computing Technology, Chinese Academy of Sciences, Beijing, 100190, China

    Zhi Zhou & Yuanning Li

  2. Graduate University of Chinese Academy of Sciences, Beijing, 100049, China

    Zhi Zhou & Yuanning Li

  3. Institute of Digital Media, School of EE & CS, Peking University, Beijing, 100871, China

    Zhi Zhou, Yonghong Tian, Yuanning Li, Tiejun Huang & Wen Gao

Authors
  1. Zhi Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yonghong Tian
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yuanning Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Tiejun Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Wen Gao
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Istituto di Scienza e Tecnologie dell’Informazione, CNR, Pisa, Italy

    Carol Peters

  2. RWTH Aachen University, Aachen, Germany

    Thomas Deselaers

  3. University of Padua, Padua, Italy

    Nicola Ferro

  4. LSI-UNED, Madrid, Spain

    Julio Gonzalo  & Anselmo Peñas  & 

  5. Dublin City University, Dublin 9, Ireland

    Gareth J. F. Jones

  6. Helsinki University of Technology, Espoo, Finland

    Mikko Kurimo

  7. University of Hildesheim, Hildesheim, Germany

    Thomas Mandl

  8. Humboldt University Berlin, Germany

    Vivien Petras

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Zhou, Z., Tian, Y., Li, Y., Huang, T., Gao, W. (2009). Large-Scale Cross-Media Retrieval of WikipediaMM Images with Textual and Visual Query Expansion. In: Peters, C., et al. Evaluating Systems for Multilingual and Multimodal Information Access. CLEF 2008. Lecture Notes in Computer Science, vol 5706. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-04447-2_99

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-04447-2_99

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-04446-5

  • Online ISBN: 978-3-642-04447-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics