Jingrui He
Mingjing Li
Hong-Jiang Zhang
ABSTRACT
In this paper, we propose a novel transductive learning framework named manifold-ranking based image retrieval (MRBIR). Given a query image, MRBIR first makes use of a manifold ranking algorithm to explore the relationship among all the data points in the feature space, and then measures relevance between the query and all the images in the database accordingly, which is different from traditional similarity metrics based on pair-wise distance. In relevance feedback, if only positive examples are available, they are added to the query set to improve the retrieval result; if examples of both labels can be obtained, MRBIR discriminately spreads the ranking scores of positive and negative examples, considering the asymmetry between these two types of images. Furthermore, three active learning methods are incorporated into MRBIR, which select images in each round of relevance feedback according to different principles, aiming to maximally improve the ranking result. Experimental results on a general-purpose image database show that MRBIR attains a significant improvement over existing systems from all aspects.
- Bengio, Y., Vincent, P., and Paiement, J. Learning Eigenfunctions of Similarity: Linking Spectral Clustering and Kernel PCA. Technical Report 1232, University of Montreal, 2003.Google Scholar
- Chen, Y., Zhou, X., and Huang, T. One-class SVM for learning in image retrieval. Proc. IEEE Int. Conf. on Image Processing, vol. 1, pp. 34--37, 2001.Google Scholar
- Huang, J., et al. Image indexing using color correlograms. Proc. IEEE Conf. on Computer Vision and Pattern Recognition, pp. 762--768, 1997. Google ScholarDigital Library
- Jing, F., et al. An effective region-based image retrieval framework. Proc. 10th ACM Int. Conf. on Multimedia, 2002. Google ScholarDigital Library
- Ishikawa, Y., Subramanya, R., and Faloutsos, C. MindReader: querying databases through multiple examples. Proc. 24th Int. Conf. on Very Large Data Bases, 1998. Google ScholarDigital Library
- Kokare, M., Chatterji, B.N., and Biswas, P.K. Comparison of similarity metrics for texture image retrieval. IEEE Conf. on Convergent Technologies for Asia-Pacific Region, vol. 2, pp. 571--575, 2003.Google ScholarCross Ref
- Li, B., Chang, E., and Li, C.S. Learning image query concepts via intelligent sampling. Proc. IEEE Int. Conf. on Multimedia & Expo, pp. 961--964, 2001.Google Scholar
- Li, B., Chang, E., and Wu, C.T. DPF-a perceptual distance function for image retrieval. Proc. IEEE Int. Conf. on Image Processing, vol. 2, pp. 597--600, 2002.Google Scholar
- Liu, F., and Picard, R.W. Periodicity, directionality, and randomness: Wold features for image modeling and retrieval. IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 8, 1996. Google ScholarDigital Library
- Manjunath, B.S., and Ma, W.Y. Texture features for browsing and retrieval of image data. IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 18, pp. 837--842, 1996. Google ScholarDigital Library
- Morik, K., Brockhausen, P., and Joachims, T. Combining statistical learning with a knowledge-based approach--a case study in intensive care monitoring. Proc. 16th Int. Conf. on Machine Learning, 1999. Google ScholarDigital Library
- Pass, G. Comparing images using color coherence vectors. Proc. 4th ACM Int. Conf. on Multimedia, pp. 65--73, 1997. Google ScholarDigital Library
- Porkaew, K., and Chakrabarti, K. Query refinement for multimedia similarity retrieval in MARS. Proc. 7th ACM Int. Conf. on Multimedia, pp. 235--238, 1999. Google ScholarDigital Library
- Porkaew, K., Ortega, M., and Mehrota, S. Query reformulation for content based multimedia retrieval in MARS. Proc. IEEE Int. Conf. on Multimedia Computing and Systems, vol. 2, pp. 747--751, 1999. Google ScholarDigital Library
- Rocchio, J.J. Relevance feedback in information retrieval. The SMART Retrieval System, pp. 313--323, Prentice-Hall, Englewood Cliffs, NJ, 1971.Google Scholar
- Rubner, Y., Tomasi, C., and Guibas, L. A metric for distributions with applications to image databases. Proc. IEEE Int. Conf. on Computer Vision, pp. 59--66, 1998. Google ScholarDigital Library
- Rui, Y., et al. Relevance feedback: a power tool for interactive content-based image retrieval. IEEE Trans. Circuits and Systems for Video Technology, 1998. Google ScholarDigital Library
- Rui, Y., Huang, T., and Mehrotra, S. Content-based image retrieval with relevance feedback in MARS. Proc. IEEE Int. Conf. on Image Processing, pp. 815--818, 1997.Google ScholarCross Ref
- Schmid, C. A structured probabilistic model for recognition. Proc. IEEE Conf. on Computer Vision and Pattern Recognition, vol. 2, pp. 490, 1999.Google ScholarCross Ref
- Schmid, C., and Mohr, R. Local grayvalue invariants for image retrieval. IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 19, pp. 530--535, 1997. Google ScholarDigital Library
- Shi, J., and Malik, J. Normalized cuts and image segmentation. IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 22, pp. 888--905, 2000. Google ScholarDigital Library
- Stricker, M., and Orengo, M. Similarity of color images. Storage and Retrieval for Image and Video Databases, Proc. SPIE 2420, pp 381--392, 1995.Google Scholar
- Swain, M., and Ballard, D. Color indexing. Int. Journal of Computer Vision, 7(1): 11--32, 1991. Google ScholarDigital Library
- Tieu, K., and Viola, P. Boosting image retrieval. Proc. IEEE Conf. on Computer Vision and Pattern Recognition, vol. 1, pp. 228--235, 2000.Google ScholarCross Ref
- Tong, S. and Chang, E. Support vector machine active learning for image retrieval. Proc. 9th ACM Int. Conf. on Multimedia, 2001. Google ScholarDigital Library
- Wang, J.Z., Wiederhold, G., Firschein, O., and Sha, X.W. Content-based image indexing and searching using Daubechies' wavelets. Int. Journal of Digital Libraries, vol. 1, no. 4, pp. 311--328, 1998.Google ScholarCross Ref
- Wu, Y., Tian, Q., and Huang, T. Discriminant-EM algorithm with application to image retrieval. Proc. IEEE Conf. on Computer Vision and Pattern Recognition, vol. 1, pp. 155--162, 2000.Google ScholarCross Ref
- Zhang, L., Lin, F., and Zhang, B. Support vector machine learning for image retrieval. Proc. IEEE Int. Conf. on Image Processing, vol. 2, pp. 721--724, 2001.Google ScholarCross Ref
- Zhou, D., et al. Learning with local and global consistency. NIPS, 2003.Google ScholarDigital Library
- Zhou, D., et al. Ranking on data manifolds. NIPS, 2003.Google Scholar
- Zhou, X.S., Rui, Y., and Huang, T. Water-Filling: a novel way for image structural feature extraction. Proc. IEEE Int. Conf. on Image Processing, vol. 2, pp. 570--574, 1999.Google Scholar
Index Terms
- Manifold-ranking based image retrieval
Recommendations
Generalized Manifold-Ranking-Based Image Retrieval
In this paper, we propose a general transductive learning framework named generalized manifold-ranking-based image retrieval (gMRBIR) for image retrieval. Comparing with an existing transductive learning method named MRBIR , our method could work well ...
Incorporating Manifold Ranking with Active Learning in Relevance Feedback for Image Retrieval
PDCAT '12: Proceedings of the 2012 13th International Conference on Parallel and Distributed Computing, Applications and TechnologiesCombining manifold ranking with active learning (MRAL for short) is one popular and successful technique for relevance feedback in content-based image retrieval (CBIR). Despite the success, conventional MRAL has two main drawbacks. First, the ...
Laplacian optimal design for image retrieval
SIGIR '07: Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrievalRelevance feedback is a powerful technique to enhance Content-Based Image Retrieval (CBIR) performance. It solicits the user's relevance judgments on the retrieved images returned by the CBIR systems. The user's labeling is then used to learn a ...
Comments