Skip to main content
SpringerLink
Log in

Content-based image retrieval using fuzzy perceptual feedback

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In this paper, a new framework called fuzzy relevance feedback in interactive content-based image retrieval (CBIR) systems is introduced. Conventional binary labeling scheme in relevance feedback requires a crisp decision to be made on the relevance of the retrieved images. However, it is inflexible as user interpretation of visual content varies with respect to different information needs and perceptual subjectivity. In addition, users tend to learn from the retrieval results to further refine their information requests. It is, therefore, inadequate to describe the user’s fuzzy perception of image similarity with crisp logic. In view of this, we propose a fuzzy relevance feedback approach which enables the user to make a fuzzy judgement. It integrates the user’s fuzzy interpretation of visual content into the notion of relevance feedback. An efficient learning approach is proposed using a fuzzy radial basis function (FRBF) network. The network is constructed based on the user’s feedbacks. The underlying network parameters are optimized by adopting a gradient-descent training strategy due to its computational efficiency. Experimental results using a database of 10,000 images demonstrate the effectiveness of the proposed method.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Amarnath G, Ramesh J (1997) Visual information retrieval. Commun ACM 40(5):70–79 (May)

    Article  Google Scholar 

  2. Baeza-Yates R, Ribeiro-Neto B (1999) Modern information retrieval. ACM, New York

    Google Scholar 

  3. Corel Gallery Magic 65000 (1999) http://www.corel.com

  4. Cox IJ, Minka TP, Papathomas TV, Yianilos PN (2000) The Bayesian image retrieval system, PicHunter: theory, implementation, and psychophysical experiments. IEEE Trans Image Process—Special Issue on Digital Libraries

  5. Flickher M, Sawhney H, Niblack W, Ashley J, Huang Q, Dom B, Gorkani M, Hafner J, Lee D, Petkovic D, Steele D, Yanker P (1995) Query by image and video content: the QBIC system. IEEE Computer 28(9):23–32 (Sept)

    Google Scholar 

  6. Gevers T, Smeulders AWM (2000) PicToSeek: combining color and shape invariant features for image retrieval. IEEE Trans Image Process 9:102–119

    Article  Google Scholar 

  7. Haykin S (1999) Neural networks: a comprehensive foundation. Prentice-Hall, Upper Saddle River, NJ

    MATH  Google Scholar 

  8. Huang J, Kumar SR, Mitra M (1997) Combining supervised learning with color correlograms for content-based image retrieval. Proc ACM Multimedia, pp 325–334 (Nov)

  9. Huang J, Kumar S, Mitra M, Zhu WJ, Zabih R (1997) Image indexing using color correlogram. Proc IEEE Conf on Computer Vision and Pattern Recognition

  10. Huang TS, Zhou XS, Nakazato M, Wu Y, Cohen I (2002) Learning in content-based image retrieval. The 2nd Int Conf on Development and Learning

  11. Ishikawa Y, Subramanya R (1998) MindReader: query database through multiple examples. Proc Int Conf on Very Large Data Bases, New York, USA

  12. Laaksonen J, Koskela M, Oja E (2002) PicSom-self-organizing image retrieval with MPEG-7 content descriptions. IEEE Trans Neural Netw 13(4):841–853 (July)

    Article  Google Scholar 

  13. Manjunath BS, Ma WY (1996) Texture features for browsing and retrieval of image data. IEEE Trans Pattern Anal Mach Intell 18:837–842 (Aug)

    Article  Google Scholar 

  14. Moody J, Darken CJ (1989) Fast learning in networks of locally-tuned processing units. Neural Comput 1(2):281–294

    Google Scholar 

  15. Müller H, Müller W, Marchand-Maillet S, McG Squire D (2000) Strategies for positive and negative relevance feedback in image retrieval. Proc Int Conf on Pattern Recognition, Barcelona, Spain

  16. Muneesawnag P, Guan L (2001) Interactive CBIR using RBF-based relevance feedback for WT/VQ coded images. Proc IEEE Int Conf on Acoustics, Speech and Signal Processing, Utah, USA (May)

  17. Muneesawang P, Guan L (2002) Automatic machine interactions for content-based image retrieval using a self-organizing tree map architecture. IEEE Trans Neural Netw 13(4):821–834 (July)

    Article  Google Scholar 

  18. Pentland A, Picard R, Sclaroff S (1994) Photobook: tools for content-based manipulation of image databases. Proc SPIE 2185:34–47, San Jose (February 7–8)

    Article  Google Scholar 

  19. Rui Y, Huang TS (2000) Optimizing learning in image retrieval. Proc. IEEE Int Conf on Computer Vision and Pattern Recognition 1:236–243 (June)

    Google Scholar 

  20. Rui Y, Huang TS, Mehrotra S (1997) Content-based image retrieval with relevance feedback in MARS. Proc IEEE Int Conf Image Processing, Washington DC, USA, pp 815–818

  21. Rui Y, Huang TS, Ortega M, Mehrotra S (1998) Relevance feedback: a power tool for interactive content-based image retrieval. IEEE Trans Circuits Syst Video Technol 8(5):644–655

    Article  Google Scholar 

  22. Smith JR, Chang SF (1996) VisualSEEk: a fully automated content based image query system. Proc ACM Multimedia (November)

  23. Smith JR, Chang SF (1996) Automated binary texture feature sets for image retrieval. Proceedings of the IEEE, ICASSP ’96, Atlanta, GA

  24. Su Z, Zhang HJ, Ma S (2001) Relevant feedback using a Bayesian classifier in content-based image retrieval. SPIE Electronic Imaging, San Jose, CA (Jan)

  25. Swain M, Ballard D (1991) Color indexing. Int J Comput Vis 7(1):11–32

    Article  Google Scholar 

  26. Tong S, Chang E (2001) Support vector machine active leaning for image retrieval. Proc 9th ACM Conf on Multimedia, Ottawa Canada

  27. Vasconcelos N, Lippman A (1999) Learning from user feedback in image retrieval systems. Proc NIPS’99, Denver, Colorado

  28. Wu Y, Tian Q, Huang TS (2000) Discriminant EM algorithm with application to image retrieval. Proc IEEE Int Conf on Computer Vision and Pattern Recognition vol 1, South Carolina, pp 222–227

  29. Zhou XS, Huang TS (2001) Exploring the nature and variants of relevance feedback. IEEE Workshop on Content-Based Access of Image and Video Libraries (CBAIVL ’01), Hawaii, USA, pp 94–101

  30. Zhou XS, Huang TS (2001) Small sample learning during multimedia retrieval using BiasMap. Proc Int Conf on Computer Vision and Pattern Recognition, Hawaii (Dec)

Download references

Author information

Authors and Affiliations

  1. Media Technology Laboratory, School of Electrical and Electronic Engineering, Nanyang Technological University, Nanyang Avenue, 639798, Singapore, Singapore

    Kui Wu

  2. School of Electrical and Electronic Engineering, Nanyang Technological University, Block S2.2, Nanyang Avenue, 639798, Singapore, Singapore

    Kim-Hui Yap

Authors
  1. Kui Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Kim-Hui Yap
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Kim-Hui Yap.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Wu, K., Yap, KH. Content-based image retrieval using fuzzy perceptual feedback. Multimed Tools Appl 32, 235–251 (2007). https://doi.org/10.1007/s11042-006-0050-2

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-006-0050-2

Keywords

Search

Navigation