Skip to main content
SpringerLink
Log in

HIRBIR: A hierarchical approach to region-based image retrieval

  • Regular Paper
  • Published:
Multimedia Systems Aims and scope Submit manuscript

Abstract

This paper proposes a hierarchical approach to region-based image retrieval (HIRBIR) based on wavelet transform whose decomposition property is similar to human visual processing. First, automated image segmentation is performed fast in the low-low (LL) frequency subband of the wavelet domain that shows the desirable low image resolution. In the proposed system, boundaries between segmented regions are deleted to improve the robustness of region-based image retrieval against segmentation-related uncertainty. Second, a region feature vector is hierarchically represented by information in all wavelet subbands, and each feature component of a feature vector is a unified color–texture feature. Such a feature vector captures well the distinctive features (e.g., semantic texture) inside one region. Finally, employing a hierarchical feature vector, the weighted distance function for region matching is tuned meaningfully and easily, and a progressive stepwise indexing mechanism with relevance feedback is performed naturally and effectively in our system. Through experimental results and comparison with other methods, the proposed HIRBIR shows a good tradeoff between retrieval effectiveness and efficiency as well as easy implementation for region-based image retrieval.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Picard, R.W.: Content Access for Image/Video Coding: The Fourth Criterion. MIT Media Lab TR No. 295 (1994)

  2. Smeulders, A.W.M., Worring, M., Santini, S., Gupta, A., Jain, R.: Content-based image retrieval at the end of the early years. IEEE Trans. Pattern Anal. Mach. Intell. 22(12), 1349–1380 (2000)

    Article  Google Scholar 

  3. Swain, M., Ballard, D.: Color indexing. Int. J. Comput. Vis. 7(1), 11–32 (1991)

    Article  Google Scholar 

  4. Sethi, I.K., Coman, I., Day, B., Jiang, F., Li, D., Segovia-Juarez, J., Wei, G., You, B.: Color-WISE: a system for image similarity retrieval using color. In: Proceedings of the Conference on Storage and Retrieval for Image and Video Database VI (SPIE '98), 3312, 140–149 (1998)

  5. Jain, A.K., Vailaya, A.: Shape-based retrieval: a case study with trademark image database. Pattern Recog. 31, 1369–1390 (1998)

    Google Scholar 

  6. Wang, J.Z., Wiederhold, G., Firschein, O., Sha, X.W.: Content-based image indexing and searching using Daubechies' wavelets. Int. J. Dig. Libr. 1(4), 311–328 (1998)

    Google Scholar 

  7. Sun, Y.Q., Ozawa, S.: A novel image retrieval algorithm by using salient points in wavelet domain. In: Proceedings of the Asia Conference on Computer Vision (ACCV), pp. 890–895, 28–30 June 2004, Jeju Island, Korea (2004)

  8. Manjunath, B.S., Ma, W.Y.: Texture features for browsing and retrieval of image data. IEEE Trans. Pattern Anal. Mach. Intell. 18(8), 837–842 (1996)

    Article  Google Scholar 

  9. Gevers, T., Smeulders, A.W.M.: PicToSeek: a content-based image search engine for the World Wide Web. In: Proceedings of the Conference on Visual Information Systems, pp. 93–100, San Diego (1997)

  10. Flickner, M., Sawhney, H., Niblack, W., Ashley, J., Huang, Q., Dom, B., Gorkani, M., Hafner, J., Lee, D., Petkovic, D., Steele, D., Yanker, P.: Query by image and video content: the QBIC system. IEEE Trans. Comput. 28(9), 23–32 (1995)

    Google Scholar 

  11. Pentland, A., Picard, R., Sclaroff, S.: Photobook: tools for content-based manipulation of image databases. In: Proceedings of the Conference on Storage and Retrieval for Image and Video Databases II (SPIE '94), 2185, pp. 34–47 (1994)

  12. Gupta, A.: Visual information retrieval technology: a virage perspective. Technical Report, Virage Inc., http://www.virage.com (1995)

  13. Rui, Y., Huang, T.S., Ortega, M., Mehrotra, S.: Relevance feedback: a power tool in interactive content-based image retrieval. IEEE Trans. Circuits Syst. Video Technol. 8(5), 644–655 (1998)

    Google Scholar 

  14. Zhou, X.S., Huang, T.S.: Comparing discriminate transformations and SVM for learning during multimedia retrieval. In: Proceedings of ACM Multimedia, Canada (2001)

  15. Ma, W.Y., Manjunath, B.S.: NETRA: a toolbox for navigating large image databases. In: Proceedings of the IEEE International Conference on Image Processing, 1, 568–571 (1997)

  16. Natsev, A., Rastogi, R., Shim, K.: WALRUS: A similarity retrieval algorithm for image databases. In: Proceedings of the 1999 SIGMOD International Conference on Management of Data, vol. 28(2), pp. 395–406, Philadelphia (1999)

  17. Carson, C., Belongie, B., Greenspan, H., Malik, J.: Blobworld: image segmentation using expectation-maximization and its application to image querying. IEEE Trans. Pattern Anal. Mach. Intell. 24(8), 1026–1038 (2002)

    Article  Google Scholar 

  18. Zhu, L., Zhang, A., Rao, A., Srihari, R.: Keyblock: an approach for content-based image retrieval. In: Proceedings of ACM Multimedia, pp. 157–166, Los Angeles (2000)

  19. Wang, J.Z., Li, J., Wiederhold, G.: SIMPLIcity: semantic-sensitive integrated matching for picture libraries. IEEE Trans. Pattern Anal. Mach. Intell. 23(9), 947–963 (2001)

    Article  Google Scholar 

  20. Chen, Y., Wang, J.Z.: A region-based fuzzy feature matching approach to content-based image retrieval. IEEE Trans. Pattern Anal. Mach. Intell. 24(9), 1252–1267 (2002)

    Google Scholar 

  21. Smith, J.R., Chang, S.F.: VisualSEEK: A fully automated content-based image query system. In: Proceedings of ACM Multimedia, pp. 87–98, Boston (1996)

  22. Tian, Q., Wu, Y., Huang, T.S.: Combine user defined region-of-interest and spatial layout for image retrieval. In: Proceedings of the IEEE International Conference on Image Processing (ICIP'00), pp. 2061–2064, Vancouver, BC, Canada (2000)

  23. Sun, Y.Q., Ozawa, S.: Semantic-meaningful content-based image retrieval in wavelet domain. In: Proceedings of the 5th ACM SIGMM International Workshop on Multimedia Information Retrieval (MIR'03), in conjunction with the ACM Multimedia, pp. 122–129, Berkeley, CA (2003)

  24. Wang, W., Song, Y.Q., Zhang, A.: Semantics retrieval by content and context of image regions. In: Proceedings of the 15th International Conference on Vision Interface, pp. 17–22, Calgary, Canada (2002)

  25. Jing, F., Zhang, B., Lin, F., Ma, W.Y., Zhang, H.J.: A novel region-based image retrieval method using relevance feedback. In: Proceedings of the 3rd ACM International Workshop on Multimedia Information Retrieval (2001)

  26. Wilfried, O., Anthony, J.M.: Automatic identification of perceptually important regions in an image. In: Proceedings of the 14 IEEE International Conference on Pattern Recognition, pp. 16–20 (1998)

  27. Chui, C.K.: An Introduction to Wavelets. Academic, San Diego (1992)

    Google Scholar 

  28. Ingrid, D.: Orthonormal based of compactly supported wavelets. Commun. Pure Appl. Math. 41(7), 909–996 (1988)

    Google Scholar 

  29. Xie, X.L., Beni, G.: A validity measure for fuzzy clustering. IEEE Trans. Pattern Anal. Mach. Intell. 13(8), 841–847 (1991)

    Article  Google Scholar 

  30. Plataniotis, K.N., Venetsanopoulos, A.N.: Color Image Processing and Applications. Springer, Berlin Heidelberg New York (2000)

    Google Scholar 

  31. Stricker, M., Orengo, M.: Similarity of color images. In: Proceedings of the Conference on Storage Retrieval and Image Video Databases III (SPIE '95), 2420, 381–392 (1995)

  32. Unser, M.: Texture classification and segmentation using wavelet frames. IEEE Trans. Image Process. 4(11), 1549–1560 (1995)

    Article  MathSciNet  Google Scholar 

  33. Song, X.M., Fan, G.L.: Unsupervised Bayesian image segmentation using wavelet-domain hidden Markov models. In: Proceedings of the IEEE International Conference on Image Processing (2003)

  34. Choi, H., Baraniuk, R.: Multiscale image segmentation using wavelet-domain hidden Markov models. IEEE Trans. Image Process. 10(9), 1309–1321 (2001)

    Article  MathSciNet  Google Scholar 

  35. Shapiro, J.M.: Embedded image coding using zerotrees of wavelet coefficients. IEEE Trans. Signal Process. 41(12), 3445–3462 (1993)

    Article  MATH  Google Scholar 

  36. Said, A., Pearlman, W.A.: A new fast and efficient image codec based on set partitioning in hierarchical trees. IEEE Trans. Circuits Syst. Video Technol. 6(3), 243–250 (1996)

    Article  Google Scholar 

  37. Foley, J.D.: Fundamentals of Interactive Computer Graphics. Addison-Wesley, Reading, MA (1990)

    Google Scholar 

  38. Trtgve, R., John, H.H.: Filtering for texture classification: A comparative study. IEEE Trans. Pattern Anal. Mach. Intell. 21(4), 291–310 (1999)

    Google Scholar 

  39. Sundaram, H., Chang, S.F.: Efficient video sequence retrieval in large repositories. In: Proceedings of the Conference on Storage and Retrieval for Image and Video Databases VII (SPIE '99), San Jose, CA (1999)

  40. Hua, K.A., Vu, K., Oh, J.H.: SamMatch: A flexible and efficient sampling-based image retrieval technique for large image databases. In: Proceedings of the 7th ACM International Conference on Multimedia (Part 1), pp. 225–234, Orlando, FL (1999)

  41. White, D.W., Jain, R.: Similarity Indexing: Algorithms and Performance. In: Proceedings of the Conference on Storage and Retrieval for Image and Video Databases IV, pp. 62–75, San Jose, CA (1996)

  42. Byoung, C.K., Jing, P., Hyeran, B.: Region-based image retrieval using probabilistic feature relevance learning. Pattern Anal. Appl. 4(2–3), 174–184 (2001)

    Google Scholar 

  43. Forsyth, D.A., Ponce, J.: Computer Vision: A Modern Approach, 1st edn. Prentice Hall, Englewood Cliffs, NJ (2002)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Information and Computer Science, Keio University, 3-14-1, Hiyoshi, kouhoku-ku, yokohama-shi, Kanagawa, 223-8522, Japan

    Yongqing Sun & Shinji Ozawa

Authors
  1. Yongqing Sun
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Shinji Ozawa
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yongqing Sun.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Sun, Y., Ozawa, S. HIRBIR: A hierarchical approach to region-based image retrieval. Multimedia Systems 10, 559–569 (2005). https://doi.org/10.1007/s00530-005-0182-7

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00530-005-0182-7

Keywords

Search

Navigation