Skip to main content
SpringerLink
Log in

Effective image retrieval techniques based on novel salient region segmentation and relevance feedback

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

This paper proposes an effective region-based image retrieval technique based on novel salient region segmentation and relevance feedback. With a good and fast segmentation technique, our system achieves an on-the-fly segmentation capability, which enables users to select particular regions for matching and feedbacks without waiting for image segmentation. Therefore, we adopt a relatively simple feedback schemes to derive the intent of the user. The experimental results show that the system performance is greatly improved with this capability. Furthermore, a Quick-match algorithm is also presented in this paper. The mechanism of the Quick-match algorithm is to exclude from distance computation regions that are of low possibility to be the top-Mmatches. This algorithm excludes most of regions from distance computation and therefore greatly cuts down the turnaround time of the retrieval with slightly degradation of precision.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

References

  1. Brunelli R, Mich O (2000) Image retrieval by examples. IEEE Trans Multimedia 2:164–171

    Article  Google Scholar 

  2. Carson C, Thomas M, Belongie S, Hellerstein JM, Malik J (1999) Blobworld: a system for region-based image indexing and retrieval. In Third International Conference on Visual Information Systems

  3. Chiang C-C, Hung Y-P, Yang H, Lee GC (2009) Region-based image retrieval using color-size features of watershed regions. J Vis Commun Image Represent 20:167–177

    Article  Google Scholar 

  4. Cox IJ, Miller ML, Minka TP, Papathomas TV, Yianilos PN (2000) The Bayesian image retrieval system, PicHunter: theory, implementation, and psychophysical experiments. IEEE Trans Image Process 9:20–37

    Article  Google Scholar 

  5. Deng Y, Manjunath BS (2001) Unsupervised segmentation of color-texture regions in images and video. IEEE Trans Pattern Anal Mach Intell 23:800–810

    Article  Google Scholar 

  6. Dimai A (1999) Unsupervised extraction of salient region-descriptors for content based image retrieval. In Proceedings of the 10th International Conference on Image Analysis and Processing pp 686–691

  7. Hsu, C-T, Li C-Y (2005) Relevance feedback using generalized bayesian framework with region-based optimization learning. IEEE Transactions On Image Processing vol 14

  8. Jing F, Li M, Zhang H-J, Zhang B (2004) Relevance feedback in region-based image retrieval. IEEE Trans Circuits Syst Video Technol 14:672–681

    Article  Google Scholar 

  9. Jing F, Li M, Zhang H-J, Zhang B (2004) An efficient and effective region-based image retrieval framework. IEEE Trans Image Process 13:699–709

    Article  Google Scholar 

  10. Kim H-K, Kim J-D (2000) Region-based shape descriptor invariant to rotation, scale and translation. Signal Process Image Commun 16:87–93

    Article  Google Scholar 

  11. Ko B, Byun H (2005) FRIP: A region-based image retrieval tool using automatic image segmentation and stepwise boolean and matching. IEEE Trans Multimedia 7:105–113

    Article  Google Scholar 

  12. Kuan Y-H, Kuo C-M, Yang N-C (2008) Color-based image salient region segmentation using novel region merging strategy. IEEE Trans Multimed 10:832–845

    Article  Google Scholar 

  13. Kurita T, Kato T (1993) Learning of personal visual impression for image database systems. In Proceedings of the Second International Conference on Document Analysis and Recognition. Tsukuba Science City, Japan, pp 547–552

    Google Scholar 

  14. Li C-Y, Hsu C-T (2008) Image retrieval with relevance feedback based on graph-theoretic region correspondence estimation. IEEE Trans Multimedia 10:447–456

    Article  Google Scholar 

  15. Li F, Dai Q, Xu W, Er G (2008) Multilabel Neighborhood Propagation for Region-Based Image Retrieval. IEEE Trans Multimedia 10:1592–1604

    Article  Google Scholar 

  16. Liu Y, Zhang D, Lu G, Ma W-Y (2007) A survey of content-based image retrieval with high-level semantics. Pattern Recogn 40:262–282

    Article  MATH  Google Scholar 

  17. Ma W-Y, Manjunath BS (1999) Netra: a toolbox for navigating large image databases. Multimed Syst 7:184–198

    Article  Google Scholar 

  18. Niblack CW, Barber R, Equitz W, Flickner MD, Glasman EH, Petkovic D, Yanker P, Faloutsos C, Taubin G (1993) The QBIC project: Querying images by content using color, texture and shape. In Storage and Retrieval for Image and Video Databases, San Jose, CA, USA

  19. O'Callaghan RJ, Bull DR (2005) Combined morphological-spectral unsupervised image segmentation. IEEE Trans Image Process 14:49–62

    Article  Google Scholar 

  20. Ojala T, Pietikäinen M (1999) Unsupervised texture segmentation using feature distributions. Pattern Recognit 32:477–486

    Article  Google Scholar 

  21. Pauwels EJ, Frederix G (1999) Finding salient regions in images: nonparametric clustering for image segmentation and grouping. Comput Vis Image Underst 75:73–85

    Article  Google Scholar 

  22. Picard RW, Minka TP, Szummer M (1996) Modeling user subjectivity in image libraries. In Proc. IEEE Int. Conf. on Image Proc pp 777–780

  23. SHOEBOX: A DIGITAL PHOTO MANAGEMENT SYSTEM Timothy J. Mills, David Pye, David Sinclair, and Kenneth R. Wood. AT&T Laboratories Cambridge, 24a Trumpington Street, Cambridge CB2 1QA, England

  24. Rui Y, Huang TS, Ortega M, Mehrotra S (1998) Relevance feedback: a power tool for interactive content-based image retrieval. IEEE Trans Circuits Syst Video Technol 8:644–655

    Article  Google Scholar 

  25. Smith JR, Chang S-F (1996) VisualSEEk: a fully automated content-based image query system. In Proceedings of the fourth ACM international conference on Multimedia. ACM, Boston

    Google Scholar 

  26. Torres JM, Hutchison D, Reis LP (2007) Semantic image retrieval using region-based relevance feedback. Lecture Notes In Computer Science pp 192–206

  27. Wang JZ, Wiederhold G, Firschein O, Wei SX (1997) Wavelet-based image indexing techniques with partial sketch retrieval capability. Proceedings of the Fourth Forum on Research and Technology Advances in Digital Libraries pp 13–24

  28. Wani MA, Batchelor BG (1994) Edge-region-based segmentation of range images. IEEE Trans Pattern Anal Mach Intell 16:314–319

    Article  Google Scholar 

  29. Weng S-K, Kuo C-M, Kang W-C (2007) Color texture segmentation using color transform and feature distribution. IEICE Transactions on Information and Systems

  30. Yang N-C, Chang W-H, Kuo C-M, Li T-H (2008) A fast MPEG-7 dominant color extraction with new similarity measure for image retrieval. J Vis Commun Image Represent 19:92–105

    Article  Google Scholar 

Download references

Acknowledgement

The authors would like to express their sincere thanks to the anonymous reviewers for their invaluable comments and suggestions. This work was supported by the National Science Counsel of Republic of China Granted NSC. 97-2221-E-214-053-

Author information

Authors and Affiliations

  1. Department of Information Engineering, I-Shou University, Tahsu, 840, Kaohsiung, Taiwan, Republic of China

    Min-Yuan Fang, Yu-Hsin Kuan & Chung-Ming Kuo

  2. Dept. of Computer and Communication Engineering, Ming Chung University, Gui-Shan, 333, Taoyuan, Taiwan, Republic of China

    Chaur-Heh Hsieh

Authors
  1. Min-Yuan Fang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yu-Hsin Kuan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Chung-Ming Kuo
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Chaur-Heh Hsieh
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Chung-Ming Kuo.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Fang, MY., Kuan, YH., Kuo, CM. et al. Effective image retrieval techniques based on novel salient region segmentation and relevance feedback. Multimed Tools Appl 57, 501–525 (2012). https://doi.org/10.1007/s11042-010-0655-3

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-010-0655-3

Keywords

Search

Navigation