Abstract
In this paper, we propose a mapping from low level feature space to the semantic space drawn by the users through relevance feedback to enhance the performance of current content based image retrieval (CBIR) systems. The proposed approach makes a rule base for its inference and configures it using the feedbacks gathered from users during the life cycle of the system. Each rule makes a hypercube (HC) in the feature space corresponding to a semantic concept in the semantic space. Both short and long term strategies are taken to improve the accuracy of the system in response to each feedback of the user and gradually bridge the semantic gap. A scoring paradigm is designed to determine the effective rules and suppress the inefficient ones. For improving the response time, an HC merging approach and, for reducing the conflicts, an HC splitting method is designed. Our experiments on a set of 11 000 images from the Corel database show that the proposed approach can better describe the semantic content of images for image retrieval with respect to some existing approaches reported recently in the literature. Moreover, our approach can be better trained and is not saturated in long time, i.e., any feedback improves the precision and recall of the system. Another strength of our method is its ability to address the dynamic nature of the image database such that it can follow the changes occurred instantaneously and permanently by adding and dropping images.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Flickner M, Sawhney H et al. Query by image and video content: The QBIC system. Computer, 1995, 28(9): 23–32.
Pentland A, Picard R W, Sclaroff S. Photobook: Content-based manipulation of image databases. Int. J. Computer Vision, 1996, 18(3): 233–254.
Rui Y, Huang T S, Mehrotra S, Ortega M. Automatic matching tool selection using relevance feedback in MARS. In Proc. the 2nd Int. Conf. Visual Information Systems, Dec. 1997, pp.109–116.
Yoshitaka A, Ichikawa T. A Survey on content-based retrieval for multimedia databases. IEEE Transactions on Knowledge and Data Engineering, 1999, 11(1): 81–93.
Smeulders A, Worring M, Santini S, Gupta A, Jain R. Content-based image retrieval at the end of the early years. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2000, 22(12): 1349–1380.
Zhou X, Rui Y, Huang T S. Exploration of Visual Data. Kluwer Academic Publishers, 2003.
Rocchio J. Relevance feedback in information retrieval. In The SMART System-Experiments in Automatic Document Processing, Salton G (ed.), Prentice Hall, 1971, pp.313–323.
Ciocca G, Schettini R. A relevance feedback mechanism for content-based image retrieval. Information Processing and Management, 1999, 35(6): 605–632.
Rui Y, Huang T S, Ortega M, Mehrotra S. Relevance feed-back: A power tool for interactive content-based image retrieval. IEEE Transactions on Circuits and Systems for Video Technology, 1998, 8(5): 644–655.
Peng J, Bhanu B, Qing S. Probabilistic feature relevance learning for content-based image retrieval. Computer Vision and Image Understanding, 1999, 75(1-2): 150–164.
Meilhac C, Nastar C. Relevance feedback and category search in image database. In Proc. Int. Conf. Multimedia Computing and Systems, June 1999, pp.512–517.
Cox I, Miller M, Minka T, Papathomas T, Yianilos P. The Bayesian image retrieval system, PicHunter: Theory, implementation, and psychophysical experiments. IEEE Transactions on Image Processing, 2000, 9(1): 20–37.
Tong S, Chang E. Support vector machine active learning for image retrieval. In Proc. the 9th ACM Int. Conf. Multimedia (ACM Press), Ottawa, Canada, Sept. 30-Oct. 5, 2001, pp.107–118.
Tieu K, Viola P. Boosting image retrieval. In Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), June 2000, pp.228–235.
Vasconcelos N, Lippman A. Learning from user feedback in image retrieval systems. In Proc. Neural Information Processing System, 1999.
Lin Y Y, Liu T L, Chen H T. Semantic manifold learning for image retrieval. In Proc. the 13th ACM Int. Conf. Multimedia (ACM MM), Singapore, Nov. 2005, pp.249–258.
Yu J, Tian Q. Learning image manifolds by semantic subspace projection. In Proc. the 14th ACM Conference on Multimedia (ACM MM), Santa Barbara, USA, Oct. 2006, pp.297–306.
He X F, Cai D, Han J. Learning a maximum margin sub-space for image retrieval. IEEE Transactions on Knowledge and Data Engineering, Feb. 2008, 20(2): 189–201.
Lakdashti A, Moin M S. A new content-based image retrieval approach based on pattern orientation histogram. In Proc. the 3 rd Int. Conf. Computer Vision/Computer Graphics Collaboration Techniques, March 2007, pp.587–595.
Author information
Authors and Affiliations
Corresponding author
Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
About this article
Cite this article
Ajorloo, H., Lakdashti, A. HBIR: Hypercube-Based Image Retrieval. J. Comput. Sci. Technol. 27, 147–162 (2012). https://doi.org/10.1007/s11390-012-1213-4
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11390-012-1213-4