Abstract
We present an algorithm for video retrieval that fuses the decisions of multiple retrieval agents in both text and image modalities. While the normalization and combination of evidence is novel, this paper emphasizes the successful use of negative pseudo-relevance feedback to improve image retrieval performance. Although we have not solved all problems in video information retrieval, the results are encouraging, indicating that pseudo-relevance feedback shows great promise for multimedia retrieval with very varied and errorful data.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Hafner, J. Sawhney, H.S. Equitz, W. Flickner, M. and Niblack, W. “Efficient Color Histogram Indexing for Quadratic Form Distance,” IEEE Trans. Pattern Analysis and Machine Intelligence, 17(7), pp. 729–736, July, 1995
Robertson S.E., et al.. Okapi at TREC-4. In The Fourth Text Retrieval Conference (TREC-4). 1993
Sato, T., Kanade, T., Hughes, E., and Smith, M. Video OCR for Digital News Archive. In Proc. Workshop on Content-Based Access of Image and Video Databases. (Los Alamitos, CA, Jan 1998), 52–60
Singh, R., Seltzer, M.L., Raj, B., and Stern, R.M. “Speech in Noisy Environments: Robust Automatic Segmentation, Feature Extraction, and Hypothesis Combination,” IEEE Conference on Acoustics, Speech and Signal Processing, Salt Lake City, UT, May, 2001
A.W.M. Smeulders, M. Worring, S. Santini, A. Gupta and R. Jain, “Content-Based Image Retrieval at the End of the Early Years,” IEEE Trans. Pattern Analysis and Machine Intelligence, 22(12), pp. 1349–1380, December, 2000
Swain M.J. and Ballard, B.H. “Color Indexing,” Int’l J. Computer Vision, vol. 7, no. 1, pp. 11–32, 1991
Tague-Sutcliffe, J.M., “The Pragmatics of Information Retrieval Experimentation, revised,” Information Processing and Management, 28, 467–490, 1992
TREC 2002 National Institute of Standards and Technology, Text REtrieval Conference web page, http://www.trec.nist.gov/, 2002
TREC Video Retrieval Track, http://www-nlpir.nist.gov/projects/trecvid/
Wactlar, H.D., Christel, M.G., Gong, Y., and Hauptmann, A.G. “Lessons Learned from the Creation and Deployment of a Terabyte Digital Video Library”, IEEE Computer 32(2): 66–73
Informedia Digital Video Library Project Web Site. Carnegie Mellon University, Pittsburgh, PA, USA. URL http://www.informedia.cs.cmu.edu
Del Bimbo “Visual Information Retrieval”, Morgan Kaufmann Ed., San Francisco, USA, 1999
Mojsilovic, J. Kovacevic, J. Hu, R.J. Safranek, and S.K. Ganapathy, “Matching and Retrieval Based on the Vocabulary and Grammar of Color Patterns,” IEEE Trans. Image Processing, 9(1), pp. 38–54, 2000
Gong, Y. Intelligent Image Databases: Toward Advanced Image Retrieval. Kluwer Academic Publishers: Hingham, MA
Y. Rui, T. S. Huang, and S. Mehrotra, “Content-based image retrieval with relevance feed-back in Mars,” in Proc. IEEE Conf. Image Processing, 1997, pp. 815–818
T. Hastie and R. Tibshirani. Discriminant adaptive nearest neighbor classification and regression. In David S. Touretzky, Michael C. Mozer, and Michael E. Hasselmo, editors, Advances in Neural Information Processing Systems, volume 8, pages 409–415. The MIT Press, 1996
Carbonell, J., Y. Yang, R. Frederking and R.D. Brown, “Translingual Information Retrieval: A Comparative Evaluation,” Proceedings of IJCAI, 1997
Liu, B., Lee, W.S., Yu, P.S. and Li, X., Partially Supervised Classification of Text Documents, Proc. 19th Intl. Conf. on Machine Learning, Sydney, Australia, July 2002, 387–394
F. Denis. PAC learning from positive statistical queries. In ALT 98, 9th International Conference on Algorithmic Learning Theory, volume 1501 of Lecture Notes in Artificial Intelligence, pages 112–126. Springer-Verlag, 1998
Y. Wu, Q. Tian, and T. Huang. Discriminant-em algorithm with application to image retrieval. In Proceedings to the IEEE Conference on Computer Vision and Pattern Recognition, volume 1, pages 222–227, June 2000. 12
V.N. Vapnik (1995). The Nature of Statistical Learning Theory. Springer
Foster Provost, “Machine Learning from Imbalanced Data Sets 101/1”, AAAI Workshop on Learning from Imbalanced Data Sets, AAAI Press, Menlo Park, CA, 64–68
M.V. Joshi, R.C. Agarwal, V. Kumar, “Predicting Rare Classes: Can Boosting Make Any Weak Learner Strong?”, the Eighth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Edmonton, Canada, July 2003
R. Yan, Y. Liu, R. Jin, A. G Hauptmann, “On Predicting Rare Class with SVM Ensemble in Scene Classification”, To Appear in International Conference on Acoustics, Speech, and Signal Processing 2003, Hong Kong, China, April, 2003
X. S. Zhou, T. S. Huang, “Small Sample Learning during Multimedia Retrieval using BiasMap”, in Proc. IEEE Conf. Computer Vision and Pattern Recognition, Hawaii, Dec. 2001
O. Chapelle, P. Haffner and V. Vapnik, “SVMs for histogram-based image classification”, IEEE Transaction on Neural Networks, 9, 1999
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Yan, R., Hauptmann, A., Jin, R. (2003). Multimedia Search with Pseudo-relevance Feedback. In: Bakker, E.M., Lew, M.S., Huang, T.S., Sebe, N., Zhou, X.S. (eds) Image and Video Retrieval. CIVR 2003. Lecture Notes in Computer Science, vol 2728. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45113-7_24
Download citation
DOI: https://doi.org/10.1007/3-540-45113-7_24
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-40634-1
Online ISBN: 978-3-540-45113-6
eBook Packages: Springer Book Archive