skip to main content
10.1145/1027527.1027613acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
Article

The relative effectiveness of concept-based versus content-based video retrieval

Published: 10 October 2004 Publication History

Abstract

Three video search systems were compared in the interactive search task at the TRECVID 2003 workshop: a <i>text-only</i> system, which searched video shots through transcripts; a <i>features-only</i> system, which searched video shots through 16 video content features (e.g., airplanes and people); and a <i>combined</i> system, which searched through both transcripts and content features. 36 participants each completed 12 video search tasks. The hypothesis that the combined system would perform better than both the text-only and the features-only systems was not supported, and large topic effects were found. Further analysis showed that concept-based video retrieval worked best for <i>specific</i> topics, whereas the hybrid retrieval techniques which combine both concept- and content-based video retrieval showed some advantage when searching for <i>generic</i> topics. The results have implications for topic/task analysis for video retrieval research, and also for the implementation of hybrid video retrieval systems.

References

[1]
TRasmussen, E. M. Indexing images. Annual Review of Information Science and Technology, 32(1997), 167--196
[2]
Enser, P. Visual image retrieval: seeking the alliance of concept-based and content-based paradigms. Journal of Information Science 26,4(Aug. 2000). 199--210
[3]
Eakins, J. P., and Graham, M. E. Content-based image retrieval: a report to the JISC Technology Applications Programme. Institute for Image Data Research, University of Northumbria at Newcastle. 1999. Available at TUhttp://www.unn.ac.uk/iidr/report.htmlUT .
[4]
Lew, M., Sebe, N. and Eakins, J. Challenges of image and video retrieval. International Conference on Image and Video Retrieval, 2002 LNCS 2383, 1--6
[5]
Browne, P., Czirjek, C., Gurrin, C., Jarina, R., Lee, H., Marlow, S., Donald, K. M., Murphy, N., O'Connor, N. E., Smeaton, A. F. and Ye, J. Dublin City University Video Track Experiments for TREC 2002. Notebook of TREC video track, 2002. 217--226.
[6]
Browne, P., Czirjek, C., Gaughan, G., Gurrin, C., Jones, G.J.F., Lee, H., Marlow, S., McDonald, K., Murphy, N., O'Connor, N. E., O'Hare, N., Smeaton, A.F., Ye, J. Dublin City University Video Track Experiments for TREC 2003. Notebook of TREC video track, 2003, 51--62
[7]
Guidelines for the TRECVID 2003 evaluation. (2003, May 27). http://www.nlpir.nist.gov/projects/tv2003/tv2003.html.
[8]
Wildemuth, B. M., Yang, M., Hughes, A., Gruss, R., Geisler, G., and Marchionini, G. Access via Features versus Access via Transcripts: User Performance and Satisfaction. Proceedings of TRECVID 2003 workshop notebook. 2003, 189--198
[9]
Shatford, S. Analyzing the Subject of a Picture: A Theoretical Approach. TCataloguing & Classification Quarterly, 1986. 5(3)T. 39--61
[10]
Murdock, V. and Croft, W. B. Task-Orientation in Question Answering. TProceedings of the Twenty Fifth International ACM SIGIR Conference, Tampere, Finland, August 2002.355--356T
[11]
Hauptman, A., Baron, R. V., Chen, M., Christel, M., Duygulu, P., Huang, C., Jin, R., Lin, W., Ng, T., Moraveji, N., Papernick, N., Snoek, C., Tzanetakis, G., Yang, J., Yan, R., and Wactlar, H. Informedia at TRECVID 2003 : Analyzing and Searching Broadcast News Video. Proceedings of TRECVID 2003 workshop notebook. 2003, 21--34.

Cited By

View all
  • (2015)Design criteria for video digital librariesOnline Information Review10.1108/OIR-10-2014-025139:2(214-228)Online publication date: 13-Apr-2015
  • (2015)Visual information seekingJournal of the Association for Information Science and Technology10.1002/asi.2324466:6(1091-1105)Online publication date: 1-Jun-2015
  • (2014)Users' criteria of video digital libraries from a public affairs contextProceedings of the 5th Information Interaction in Context Symposium10.1145/2637002.2637031(235-238)Online publication date: 26-Aug-2014
  • Show More Cited By

Index Terms

  1. The relative effectiveness of concept-based versus content-based video retrieval

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      MULTIMEDIA '04: Proceedings of the 12th annual ACM international conference on Multimedia
      October 2004
      1028 pages
      ISBN:1581138938
      DOI:10.1145/1027527
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 10 October 2004

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. TRECVID
      2. hybrid video retrieval
      3. user study

      Qualifiers

      • Article

      Conference

      MM04

      Acceptance Rates

      Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)3
      • Downloads (Last 6 weeks)0
      Reflects downloads up to 18 Feb 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2015)Design criteria for video digital librariesOnline Information Review10.1108/OIR-10-2014-025139:2(214-228)Online publication date: 13-Apr-2015
      • (2015)Visual information seekingJournal of the Association for Information Science and Technology10.1002/asi.2324466:6(1091-1105)Online publication date: 1-Jun-2015
      • (2014)Users' criteria of video digital libraries from a public affairs contextProceedings of the 5th Information Interaction in Context Symposium10.1145/2637002.2637031(235-238)Online publication date: 26-Aug-2014
      • (2009)Aggregative query generationProceedings of the 2009 IEEE international conference on Multimedia and Expo10.5555/1698924.1699132(850-853)Online publication date: 28-Jun-2009
      • (2009)Automated Metadata in Multimedia Information Systems: Creation, Refinement, Use in Surrogates, and EvaluationSynthesis Lectures on Information Concepts, Retrieval, and Services10.2200/S00167ED1V01Y200812ICR0021:1(1-74)Online publication date: Jan-2009
      • (2009)Visual image retrievalAnnual Review of Information Science and Technology10.1002/aris.2008.144042010842:1(1-42)Online publication date: 5-Nov-2009
      • (2008)Assessing the Usability of Video Browsing and Summarization TechniquesMultimedia Content Analysis10.1007/978-0-387-76569-3_9(1-34)Online publication date: 22-Sep-2008
      • (2007)Establishing the utility of non-text search for news video retrieval with real world usersProceedings of the 15th ACM international conference on Multimedia10.1145/1291233.1291395(707-716)Online publication date: 29-Sep-2007
      • (2007)Semantic visual features in content‐based video retrievalProceedings of the American Society for Information Science and Technology10.1002/meet.145043015343:1(1-14)Online publication date: 10-Oct-2007
      • (2006)Mining novice user activity with TRECVID interactive retrieval tasksProceedings of the 5th international conference on Image and Video Retrieval10.1007/11788034_3(21-30)Online publication date: 13-Jul-2006
      • Show More Cited By

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media