Bouke Huurnink
Katja Hofmann
Maarten de Rijke
ABSTRACT
We explore the use of benchmarks to address the problem of assessing concept selection in video retrieval systems. Two benchmarks are presented, one created by human association of queries to concepts, the other generated from an extensively tagged collection. They are compared in terms of reliability, captured semantics, and retrieval performance. Recommendations are given for using the benchmarks to assess concept selection algorithms; the assessment is demonstrated on two existing algorithms. The benchmarks are released to the research community.
- M. G. Christel and A. G. Hauptmann. The use and utility of high-level semantic features in video retrieval. In CIVR '05, pages 134--144, 2005. Google Scholar
Digital Library
- T. M. Cover and J. A. Thomas. Elements of Information Theory. Wiley-Interscience, 1991. Google ScholarDigital Library
- A. G. Hauptmann, R. Yan, W.-H. Lin, M. Christel, and H. D. Wactlar. Can high-level concepts fill the semantic gap in video retrieval? a case study with broadcast news. IEEE Trans. Multimedia, 9(5):958--966, 2007. Google ScholarDigital Library
- B. L. Joseph L. Fleiss and M. C. Paik. The measurement of interrater agreement. In Statistical methods for rates and proportions, pages 598--626. John Wiley & Sons, 2004.Google Scholar
- G. Lakoff. Women, Fire, and Dangerous Things. University Of Chicago Press, 1990.Google Scholar
- W.-H. Lin and A. G. Hauptmann. Which thousand words are worth a picture? Experiments on video retrieval using a thousand concepts. In ICME, pages 41--44. IEEE, 2006.Google ScholarCross Ref
- G. A. Miller. Wordnet: A lexical database for english. Comm. ACM, 38:39--41, 1995. Google ScholarDigital Library
- M. Naphade, J. Smith, J. Tesic, S.-F. Chang, W. Hsu, L. Kennedy, A. Hauptmann, and J. Curtis. Large-scale concept ontology for multimedia. IEEE Multimedia, 13(3):86--91, 2006. Google ScholarDigital Library
- A. P. Natsev, A. Haubold, J. Tešić, L. Xie, and R. Yan. Semantic concept-based query expansion and re-ranking for multimedia retrieval. In ACM Multimedia '07, pages 991--1000, 2007. Google ScholarDigital Library
- S.-Y. Neo, J. Zhao, M.-Y. Kan, and T.-S. Chua. Video retrieval using high level features: Exploiting query matching and confidence-based weighting. In CIVR '06, pages 143--152, 2006. Google ScholarDigital Library
- P. Over, T. Ianeva, W. Kraaij, and A. Smeaton. TRECVID 2005 - an overview. In TRECVid. NIST, USA, 2005.Google Scholar
- P. Resnik. Using information content to evaluate semantic similarity in a taxonomy. In IJCAI, 1995. Google ScholarDigital Library
- S. E. Robertson, S. Walker, M. Hancock-Beaulieu, A. Gull, and M. Lau. Okapi at TREC. In TREC, pages 21--30, 1992.Google Scholar
- G. Salton, A. Wong, and C. S. Yang. A vector space model for automatic indexing. Comm. ACM, 18(11):613--620, 1975. Google ScholarDigital Library
- A. Schutz and T. Luckmann. The structures of the life-world. Heinemann, London, 1974.Google Scholar
- A. F. Smeaton. Techniques used and open challenges to the analysis, indexing and retrieval of digital video. Inf. Syst., 32(4):545--559, 2007. Google ScholarDigital Library
- A. F. Smeaton, P. Over, and W. Kraaij. Evaluation campaigns and TRECVid. In MIR'06, pages 321--330. ACM Press, 2006. Google ScholarDigital Library
- C. G. Snoek, M. Worring, J. C. van Gemert, J.-M. Geusebroek, and A. W. Smeulders. The challenge problem for automated detection of 101 semantic concepts in multimedia. In ACM Multimedia'06, pages 421--430. ACM, 2006. Google ScholarDigital Library
- C. G. M. Snoek, B. Huurnink, L. Hollink, M. de Rijke, G. Schreiber, and M. Worring. Adding semantics to detectors for video retrieval. IEEE Trans. Multimedia, 9(5): 975--986, 2007. Google ScholarDigital Library
- J. Tešić, A. P. Natsev, and J. R. Smith. Cluster-based data modeling for semantic video search. In CIVR '07, pages 595--602. ACM, 2007. Google ScholarDigital Library
- M. F. Triola. Essentials of Statistics. Addison-Wesley, Boston, 2002.Google Scholar
- T. Volkmer, J. R. Smith, and A. P. Natsev. A web-based system for collaborative annotation of large image and video collections: an evaluation and user study. In ACM Multimedia '05, pages 892--901. ACM, 2005. Google ScholarDigital Library
- D. Wang, X. Li, J. Li, and B. Zhang. The importance of query-concept-mapping for automatic video retrieval. In ACM Multimedia '07, pages 285--288. ACM, 2007. Google ScholarDigital Library
- X.-Y. Wei and C.-W. Ngo. Ontology-enriched semantic space for video search. In ACM Multimedia '07, pages 981--990. ACM, 2007. Google ScholarDigital Library
- M. Worring and G. Schreiber. Semantic image and video indexing in broad domains. IEEE Trans. Multimedia, 9(5), 2007. Google ScholarDigital Library
- R. Yan and A. G. Hauptmann. A review of text and image retrieval approaches for broadcast news video. Inf. Retr., 10 (4-5):445--484, 2007. Google ScholarDigital Library
Index Terms
- Assessing concept selection for video retrieval
Recommendations
A Learned Lexicon-Driven Paradigm for Interactive Video Retrieval
Effective video retrieval is the result of interplay between interactive query selection, advanced visualization of results, and a goal-oriented human user. Traditional interactive video retrieval approaches emphasize paradigms, such as query-by-keyword ...
The lIGVID system for video retrieval and concept annotation
MIR '10: Proceedings of the international conference on Multimedia information retrievalThe LIGVID system is designed for online interactive video shots retrieval and annotation. It uses a user-controlled combination of multiple criteria: keywords, phonetic string, similarity to example images, semantic categories, and relevance feedback ...
The uncertain representation ranking framework for concept-based video retrieval
Concept based video retrieval often relies on imperfect and uncertain concept detectors. We propose a general ranking framework to define effective and robust ranking functions, through explicitly addressing detector uncertainty. It can cope with ...
Comments