ABSTRACT
The retrieval performance of content-based image retrieval (CBIR) systems is often disappointingly low, mainly due to the subjectivity of human perception. Relevance feedback (RF) has been widely considered as a powerful tool to enhance CBIR systems by incorporating human perception subjectivity into the retrieval procedure. However, usually, the obtained feedback logs are scarce and contain lots of outliers, undermining the RF adaptation effectiveness. In this paper, we tackle these shortcomings exploiting the inherent outlier downweighting capabilities mixtures of Student's t distributions offer. Each semantic class is modeled by a mixture of t distributions fitted to data provided by the system operators. Further, the semantic class models get personalized by application of a novel, efficient RF algorithm allowing for the robust adaptation of the semantic class models to the accumulated feedback of each user. The efficacy of our approach is validated through a series of experiments using objective performance criteria.
- MPEG-7 Visual Part of eXperimentation Model Version 2.0. ISO/MPEG MPEG-7 Output Document, 1999.Google Scholar
- Y. Avrithis, N. Doulamis, A. Doulamis, and S. Kollias. Optimization methods for key-frames and scenes extraction. Comput. Vis. Image Understanding, 75(1/2):3--24, Jul./Aug. 1999.Google ScholarDigital Library
- N. Babaguchi, K. Ohara, and T. Ogura. Effect of personalization on retrieval and summarization of sports video. In Joint Conference of the Fourth International Conference on Information, Communications and Signal Processing, and the Fourth Pacific Rim Conference on Multimedia, volume 2, pages 940--944, 2003.Google ScholarCross Ref
- Y. Chen, X. S. Zhou, and T. Huang. One-class SVM for learning in image retrieval. In Proc. IEEE Int'l Conf. Image Processing, 2001, volume 1, pages 34--37, 2001.Google Scholar
- I. Cox, M. L. Miller, S. M. Omohundro, and P. N. Yianilos. Pichunter: Bayesian relevance feedback for image retrieval. In Proc. Int. Conf. Pattern Recognition, 1996, volume 3, pages 362--369, 1996. Google ScholarDigital Library
- A. Doulamis and N. Doulamis. Generalized nonlinear relevance feedback for interactive content-based retrieval and organization. IEEE Trans. Circuits Syst. Video Technol., 14(5):656--671, 2004. Google ScholarDigital Library
- T. S. Huang and X. S. Zhou. Image retrieval by relevance feedback: from heuristic weight adjustment to optimal learning methods. In Proc. IEEE Int'l Conf. Image Processing, 2001, volume 3, pages 2--5, 2001.Google ScholarCross Ref
- Y. Ishikawa, R. Subramanya, and C. Faloutsos. Mindreader: Query databases through multiple examples. In Proc. 24th VLDB Conf, pages 218--227, 1998. Google ScholarDigital Library
- C. J. Leggetter and P. C. Woodland. Maximum likelihood linear regression for speaker adaptation of continuous density hidden markov models. Computer Speech & Language, 9(2):171--185, 1995.Google Scholar
- B. Manjunath, P. Wu, S. Newsam, and H. Shin. A texture descriptor for browsing and similarity retrieval. J. Signal Processing: Image Comm., 16:33--42, 2000.Google ScholarCross Ref
- P. Muneesawang and L. Guan. Image retrieval with embeded sub-class information using Gaussian mixture models. In Proc. Int. Conference Multimedia and Expo, 2003, volume 1, pages 769--772, 2003. Google ScholarDigital Library
- D. Peel and G. J. McLachlan. Robust mixture modeling using the t distribution. Statistics and Computing, 10(4):339--348, 2000. Google ScholarDigital Library
- Y. Rui, T. Huang, and S. Mehrotra. Content-based image retrieval with relevance feedback in MARS. In Proc. IEEE Int'l Conf. Image Processing, 1997, volume 2, pages 815--818, 1997.Google ScholarCross Ref
- Y. Rui, T. Huang, M. Ortega, and S. Mehrotra. Relevance feedback: A power tool for interactive content-based image retrieval. IEEE Trans. Circuits Syst. Video Technol., 8:644--655, 1998. Google ScholarDigital Library
- G. Salton and M. J. McGill. Introduction to Modern Information Retrieval. McGraw-Hill, New York, 1982. Google ScholarDigital Library
- S. Shoham. Robust clustering by deterministic agglomeration EM of mixtures of multivariate t distributions. Statistics and Computing, 35(55):1127--1142, 2002.Google Scholar
- A. W. M. Smeulders, M. Worring, S. Santini, A. Gupta, and R. Jain. Content-based image retrieval at the end of the early years. IEEE Trans. Pattern Analysis and Machine Intelligence, 22(12):1349--1380, 2000. Google ScholarDigital Library
- Z. Su, H. Zhang, S. Li, and S. Ma. Relevance feedback in content-based image retrieval: Bayesian framework, feature subspaces, and progressive learning. IEEE Trans. Image Processing, 12(8):924--937, 2003. Google ScholarDigital Library
- N. Vasconcelos and A. Lippman. Learning from user feedback in image retrieval systems. In Proceedings of Neural Information Processing Systems 12, volume 1, 1999.Google Scholar
- N. Vasconcelos and A. Lippman. Statistical models of video structure for content analysis and characterization. IEEE Trans. Image Processing, 9:3--19, 2000. Google ScholarDigital Library
- X. S. Zhou and T. Huang. Small sample learning during multimedia retrieval using biasmap. In Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2001, volume 1, pages 11--17, 2001.Google Scholar
Index Terms
A content-based image retrieval scheme allowing for robust automatic personalization
Recommendations
Localized Content-Based Image Retrieval
We define localized content-based image retrieval as a CBIR task where the user is only interested in a portion of the image, and the rest of the image is irrelevant. In this paper we present a localized CBIR system, Accio, that uses labeled images in ...
Content-Based Image Retrieval by Relevance Feedback
VISUAL '00: Proceedings of the 4th International Conference on Advances in Visual Information SystemsRelevance feedback is a powerful technique for content-based image retrieval. Many parameter estimation approaches have been proposed for relevance feedback. However, most of them have only utilized information of the relevant retrieved images, and have ...
Multi-class relevance feedback content-based image retrieval
Relevance feedback methods for content-based image retrieval have shown promise in a variety of image database applications. These techniques assume two-class relevance feedback: relevant and irrelevant classes. While simple computationally, two-class ...
Comments