Skip to main content
Log in

HBIR: Hypercube-Based Image Retrieval

  • Regular Paper
  • Published:
Journal of Computer Science and Technology Aims and scope Submit manuscript

Abstract

In this paper, we propose a mapping from low level feature space to the semantic space drawn by the users through relevance feedback to enhance the performance of current content based image retrieval (CBIR) systems. The proposed approach makes a rule base for its inference and configures it using the feedbacks gathered from users during the life cycle of the system. Each rule makes a hypercube (HC) in the feature space corresponding to a semantic concept in the semantic space. Both short and long term strategies are taken to improve the accuracy of the system in response to each feedback of the user and gradually bridge the semantic gap. A scoring paradigm is designed to determine the effective rules and suppress the inefficient ones. For improving the response time, an HC merging approach and, for reducing the conflicts, an HC splitting method is designed. Our experiments on a set of 11 000 images from the Corel database show that the proposed approach can better describe the semantic content of images for image retrieval with respect to some existing approaches reported recently in the literature. Moreover, our approach can be better trained and is not saturated in long time, i.e., any feedback improves the precision and recall of the system. Another strength of our method is its ability to address the dynamic nature of the image database such that it can follow the changes occurred instantaneously and permanently by adding and dropping images.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Flickner M, Sawhney H et al. Query by image and video content: The QBIC system. Computer, 1995, 28(9): 23–32.

    Article  Google Scholar 

  2. Pentland A, Picard R W, Sclaroff S. Photobook: Content-based manipulation of image databases. Int. J. Computer Vision, 1996, 18(3): 233–254.

    Article  Google Scholar 

  3. Rui Y, Huang T S, Mehrotra S, Ortega M. Automatic matching tool selection using relevance feedback in MARS. In Proc. the 2nd Int. Conf. Visual Information Systems, Dec. 1997, pp.109–116.

  4. Yoshitaka A, Ichikawa T. A Survey on content-based retrieval for multimedia databases. IEEE Transactions on Knowledge and Data Engineering, 1999, 11(1): 81–93.

    Article  Google Scholar 

  5. Smeulders A, Worring M, Santini S, Gupta A, Jain R. Content-based image retrieval at the end of the early years. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2000, 22(12): 1349–1380.

    Article  Google Scholar 

  6. Zhou X, Rui Y, Huang T S. Exploration of Visual Data. Kluwer Academic Publishers, 2003.

    Google Scholar 

  7. Rocchio J. Relevance feedback in information retrieval. In The SMART System-Experiments in Automatic Document Processing, Salton G (ed.), Prentice Hall, 1971, pp.313–323.

  8. Ciocca G, Schettini R. A relevance feedback mechanism for content-based image retrieval. Information Processing and Management, 1999, 35(6): 605–632.

    Article  Google Scholar 

  9. Rui Y, Huang T S, Ortega M, Mehrotra S. Relevance feed-back: A power tool for interactive content-based image retrieval. IEEE Transactions on Circuits and Systems for Video Technology, 1998, 8(5): 644–655.

    Article  Google Scholar 

  10. Peng J, Bhanu B, Qing S. Probabilistic feature relevance learning for content-based image retrieval. Computer Vision and Image Understanding, 1999, 75(1-2): 150–164.

    Article  Google Scholar 

  11. Meilhac C, Nastar C. Relevance feedback and category search in image database. In Proc. Int. Conf. Multimedia Computing and Systems, June 1999, pp.512–517.

  12. Cox I, Miller M, Minka T, Papathomas T, Yianilos P. The Bayesian image retrieval system, PicHunter: Theory, implementation, and psychophysical experiments. IEEE Transactions on Image Processing, 2000, 9(1): 20–37.

    Article  Google Scholar 

  13. Tong S, Chang E. Support vector machine active learning for image retrieval. In Proc. the 9th ACM Int. Conf. Multimedia (ACM Press), Ottawa, Canada, Sept. 30-Oct. 5, 2001, pp.107–118.

  14. Tieu K, Viola P. Boosting image retrieval. In Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), June 2000, pp.228–235.

  15. Vasconcelos N, Lippman A. Learning from user feedback in image retrieval systems. In Proc. Neural Information Processing System, 1999.

  16. Lin Y Y, Liu T L, Chen H T. Semantic manifold learning for image retrieval. In Proc. the 13th ACM Int. Conf. Multimedia (ACM MM), Singapore, Nov. 2005, pp.249–258.

  17. Yu J, Tian Q. Learning image manifolds by semantic subspace projection. In Proc. the 14th ACM Conference on Multimedia (ACM MM), Santa Barbara, USA, Oct. 2006, pp.297–306.

  18. He X F, Cai D, Han J. Learning a maximum margin sub-space for image retrieval. IEEE Transactions on Knowledge and Data Engineering, Feb. 2008, 20(2): 189–201.

    Article  Google Scholar 

  19. Lakdashti A, Moin M S. A new content-based image retrieval approach based on pattern orientation histogram. In Proc. the 3 rd Int. Conf. Computer Vision/Computer Graphics Collaboration Techniques, March 2007, pp.587–595.

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Hossein Ajorloo.

Electronic supplementary material

Below is the link to the electronic supplementary material.

(PDF 93.9 kb)

Rights and permissions

Reprints and permissions

About this article

Cite this article

Ajorloo, H., Lakdashti, A. HBIR: Hypercube-Based Image Retrieval. J. Comput. Sci. Technol. 27, 147–162 (2012). https://doi.org/10.1007/s11390-012-1213-4

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11390-012-1213-4

Keywords

Navigation