Skip to main content
Springer Nature Link
Log in

Learned Lexicon-Driven Interactive Video Retrieval

  • Conference paper
Image and Video Retrieval (CIVR 2006)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 4071))

Included in the following conference series:

  • 802 Accesses

Abstract

We combine in this paper automatic learning of a large lexicon of semantic concepts with traditional video retrieval methods into a novel approach to narrow the semantic gap. The core of the proposed solution is formed by the automatic detection of an unprecedented lexicon of 101 concepts. From there, we explore the combination of query-by-concept, query-by-example, query-by-keyword, and user interaction into the MediaMill semantic video search engine. We evaluate the search engine against the 2005 NIST TRECVID video retrieval benchmark, using an international broadcast news archive of 85 hours. Top ranking results show that the lexicon-driven search engine is highly effective for interactive video retrieval.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Flickner, M., et al.: Query by image and video content: The QBIC system. IEEE Computer 28(9), 23–32 (1995)

    Google Scholar 

  2. Chang, S.F., Chen, W., Men, H., Sundaram, H., Zhong, D.: A fully automated content-based video search engine supporting spatio-temporal queries. IEEE TCSVT 8(5), 602–615 (1998)

    Google Scholar 

  3. Rui, Y., Huang, T., Ortega, M., Mehrotra, S.: Relevance feedback: A power tool in interactive content-based image retrieval. IEEE TCSVT 8(5), 644–655 (1998)

    Google Scholar 

  4. Smeulders, A., Worring, M., Santini, S., Gupta, A., Jain, R.: Content based image retrieval at the end of the early years. IEEE TPAMI 22(12), 1349–1380 (2000)

    Google Scholar 

  5. Naphade, M., Huang, T.: A probabilistic framework for semantic video indexing, filtering, and retrieval. IEEE Trans. Multimedia 3(1), 141–151 (2001)

    Article  Google Scholar 

  6. Amir, A., et al.: IBM research TRECVID-2003 video retrieval system. In: Proc. TRECVID Workshop, Gaithersburg, USA (2003)

    Google Scholar 

  7. Snoek, C., Worring, M., Geusebroek, J., Koelma, D., Seinstra, F., Smeulders, A.: The semantic pathfinder: Using an authoring metaphor for generic multimedia indexing. IEEE TPAMI (in press, 2006)

    Google Scholar 

  8. Snoek, C., et al.: The MediaMill TRECVID 2005 semantic video search engine. In: Proc. TRECVID Workshop, Gaithersburg, USA (2005)

    Google Scholar 

  9. Rautiainen, M., Ojala, T., Seppänen, T.: Analysing the performance of visual, concept and text features in content-based video retrieval. In: ACM MIR, NY, USA, pp. 197–204 (2004)

    Google Scholar 

  10. Christel, M., Huang, C., Moraveji, N., Papernick, N.: Exploiting multiple modalities for interactive video retrieval. In: IEEE ICASSP, Montreal, CA, vol. 3, pp. 1032–1035 (2004)

    Google Scholar 

  11. Adcock, J., Cooper, M., Girgensohn, A., Wilcox, L.: Interactive video search using multilevel indexing. In: Leow, W.-K., Lew, M., Chua, T.-S., Ma, W.-Y., Chaisorn, L., Bakker, E.M. (eds.) CIVR 2005. LNCS, vol. 3568, pp. 205–214. Springer, Heidelberg (2005)

    Chapter  Google Scholar 

  12. Smeaton, A.: Large scale evaluations of multimedia information retrieval: The TRECVid experience. In: Leow, W.-K., Lew, M., Chua, T.-S., Ma, W.-Y., Chaisorn, L., Bakker, E.M. (eds.) CIVR 2005. LNCS, vol. 3568, pp. 11–17. Springer, Heidelberg (2005)

    Chapter  Google Scholar 

  13. Salton, G., McGill, M.: Introduction to Modern Information Retrieval. McGraw-Hill, New York (1983)

    MATH  Google Scholar 

  14. Deerwester, S., Dumais, S., Furnas, G., Landauer, T., Harshman, R.: Indexing by latent semantic analysis. J. American Soc. Inform. Sci. 41(6), 391–407 (1990)

    Article  Google Scholar 

  15. Lee, J.: Analysis of multiple evidence combination. In: ACM SIGIR, pp. 267–276 (1997)

    Google Scholar 

  16. Petersohn, C.: Fraunhofer HHI at TRECVID 2004: Shot boundary detection system. In: Proc. TRECVID Workshop, Gaithersburg, USA (2004)

    Google Scholar 

  17. Naphade, et al.: A light scale concept ontology for multimedia understanding for TRECVID 2005. Technical Report RC23612, IBM T.J. Watson Research Center (2005)

    Google Scholar 

  18. Fellbaum, C. (ed.): WordNet: an electronic lexical database. The MIT Press, Cambridge (1998)

    MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Intelligent Systems Lab Amsterdam, University of Amsterdam, Kruislaan 403, 1098 SJ, Amsterdam, The Netherlands

    Cees Snoek, Marcel Worring, Dennis Koelma & Arnold Smeulders

Authors
  1. Cees Snoek
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Marcel Worring
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Dennis Koelma
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Arnold Smeulders
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Arts, Media and Engineering Program, Arizona State University, 85281, Tempe, AZ,  

    Hari Sundaram

  2. Intelligent Information Management Department, IBM T.J. Watson Research Center, 19 Skyline Drive, 10532, Hawthorne, NY, USA

    Milind Naphade

  3. Intelligent Information Management Department, IBM T. J. Watson Research Center, 19 Skyline Drive, 10532, Hawthorne, NY, USA

    John R. Smith

  4. Microsoft Corporation, Microsoft China R&D Group, 49 Zhichun Road, 100080, Beijing, China

    Yong Rui

Rights and permissions

Reprints and permissions

Copyright information

© 2006 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Snoek, C., Worring, M., Koelma, D., Smeulders, A. (2006). Learned Lexicon-Driven Interactive Video Retrieval. In: Sundaram, H., Naphade, M., Smith, J.R., Rui, Y. (eds) Image and Video Retrieval. CIVR 2006. Lecture Notes in Computer Science, vol 4071. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11788034_2

Download citation

  • DOI: https://doi.org/10.1007/11788034_2

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-36018-6

  • Online ISBN: 978-3-540-36019-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics