Abstract
This paper proposes a hierarchical approach to region-based image retrieval (HIRBIR) based on wavelet transform whose decomposition property is similar to human visual processing. First, automated image segmentation is performed fast in the low-low (LL) frequency subband of the wavelet domain that shows the desirable low image resolution. In the proposed system, boundaries between segmented regions are deleted to improve the robustness of region-based image retrieval against segmentation-related uncertainty. Second, a region feature vector is hierarchically represented by information in all wavelet subbands, and each feature component of a feature vector is a unified color–texture feature. Such a feature vector captures well the distinctive features (e.g., semantic texture) inside one region. Finally, employing a hierarchical feature vector, the weighted distance function for region matching is tuned meaningfully and easily, and a progressive stepwise indexing mechanism with relevance feedback is performed naturally and effectively in our system. Through experimental results and comparison with other methods, the proposed HIRBIR shows a good tradeoff between retrieval effectiveness and efficiency as well as easy implementation for region-based image retrieval.
Similar content being viewed by others
References
Picard, R.W.: Content Access for Image/Video Coding: The Fourth Criterion. MIT Media Lab TR No. 295 (1994)
Smeulders, A.W.M., Worring, M., Santini, S., Gupta, A., Jain, R.: Content-based image retrieval at the end of the early years. IEEE Trans. Pattern Anal. Mach. Intell. 22(12), 1349–1380 (2000)
Swain, M., Ballard, D.: Color indexing. Int. J. Comput. Vis. 7(1), 11–32 (1991)
Sethi, I.K., Coman, I., Day, B., Jiang, F., Li, D., Segovia-Juarez, J., Wei, G., You, B.: Color-WISE: a system for image similarity retrieval using color. In: Proceedings of the Conference on Storage and Retrieval for Image and Video Database VI (SPIE '98), 3312, 140–149 (1998)
Jain, A.K., Vailaya, A.: Shape-based retrieval: a case study with trademark image database. Pattern Recog. 31, 1369–1390 (1998)
Wang, J.Z., Wiederhold, G., Firschein, O., Sha, X.W.: Content-based image indexing and searching using Daubechies' wavelets. Int. J. Dig. Libr. 1(4), 311–328 (1998)
Sun, Y.Q., Ozawa, S.: A novel image retrieval algorithm by using salient points in wavelet domain. In: Proceedings of the Asia Conference on Computer Vision (ACCV), pp. 890–895, 28–30 June 2004, Jeju Island, Korea (2004)
Manjunath, B.S., Ma, W.Y.: Texture features for browsing and retrieval of image data. IEEE Trans. Pattern Anal. Mach. Intell. 18(8), 837–842 (1996)
Gevers, T., Smeulders, A.W.M.: PicToSeek: a content-based image search engine for the World Wide Web. In: Proceedings of the Conference on Visual Information Systems, pp. 93–100, San Diego (1997)
Flickner, M., Sawhney, H., Niblack, W., Ashley, J., Huang, Q., Dom, B., Gorkani, M., Hafner, J., Lee, D., Petkovic, D., Steele, D., Yanker, P.: Query by image and video content: the QBIC system. IEEE Trans. Comput. 28(9), 23–32 (1995)
Pentland, A., Picard, R., Sclaroff, S.: Photobook: tools for content-based manipulation of image databases. In: Proceedings of the Conference on Storage and Retrieval for Image and Video Databases II (SPIE '94), 2185, pp. 34–47 (1994)
Gupta, A.: Visual information retrieval technology: a virage perspective. Technical Report, Virage Inc., http://www.virage.com (1995)
Rui, Y., Huang, T.S., Ortega, M., Mehrotra, S.: Relevance feedback: a power tool in interactive content-based image retrieval. IEEE Trans. Circuits Syst. Video Technol. 8(5), 644–655 (1998)
Zhou, X.S., Huang, T.S.: Comparing discriminate transformations and SVM for learning during multimedia retrieval. In: Proceedings of ACM Multimedia, Canada (2001)
Ma, W.Y., Manjunath, B.S.: NETRA: a toolbox for navigating large image databases. In: Proceedings of the IEEE International Conference on Image Processing, 1, 568–571 (1997)
Natsev, A., Rastogi, R., Shim, K.: WALRUS: A similarity retrieval algorithm for image databases. In: Proceedings of the 1999 SIGMOD International Conference on Management of Data, vol. 28(2), pp. 395–406, Philadelphia (1999)
Carson, C., Belongie, B., Greenspan, H., Malik, J.: Blobworld: image segmentation using expectation-maximization and its application to image querying. IEEE Trans. Pattern Anal. Mach. Intell. 24(8), 1026–1038 (2002)
Zhu, L., Zhang, A., Rao, A., Srihari, R.: Keyblock: an approach for content-based image retrieval. In: Proceedings of ACM Multimedia, pp. 157–166, Los Angeles (2000)
Wang, J.Z., Li, J., Wiederhold, G.: SIMPLIcity: semantic-sensitive integrated matching for picture libraries. IEEE Trans. Pattern Anal. Mach. Intell. 23(9), 947–963 (2001)
Chen, Y., Wang, J.Z.: A region-based fuzzy feature matching approach to content-based image retrieval. IEEE Trans. Pattern Anal. Mach. Intell. 24(9), 1252–1267 (2002)
Smith, J.R., Chang, S.F.: VisualSEEK: A fully automated content-based image query system. In: Proceedings of ACM Multimedia, pp. 87–98, Boston (1996)
Tian, Q., Wu, Y., Huang, T.S.: Combine user defined region-of-interest and spatial layout for image retrieval. In: Proceedings of the IEEE International Conference on Image Processing (ICIP'00), pp. 2061–2064, Vancouver, BC, Canada (2000)
Sun, Y.Q., Ozawa, S.: Semantic-meaningful content-based image retrieval in wavelet domain. In: Proceedings of the 5th ACM SIGMM International Workshop on Multimedia Information Retrieval (MIR'03), in conjunction with the ACM Multimedia, pp. 122–129, Berkeley, CA (2003)
Wang, W., Song, Y.Q., Zhang, A.: Semantics retrieval by content and context of image regions. In: Proceedings of the 15th International Conference on Vision Interface, pp. 17–22, Calgary, Canada (2002)
Jing, F., Zhang, B., Lin, F., Ma, W.Y., Zhang, H.J.: A novel region-based image retrieval method using relevance feedback. In: Proceedings of the 3rd ACM International Workshop on Multimedia Information Retrieval (2001)
Wilfried, O., Anthony, J.M.: Automatic identification of perceptually important regions in an image. In: Proceedings of the 14 IEEE International Conference on Pattern Recognition, pp. 16–20 (1998)
Chui, C.K.: An Introduction to Wavelets. Academic, San Diego (1992)
Ingrid, D.: Orthonormal based of compactly supported wavelets. Commun. Pure Appl. Math. 41(7), 909–996 (1988)
Xie, X.L., Beni, G.: A validity measure for fuzzy clustering. IEEE Trans. Pattern Anal. Mach. Intell. 13(8), 841–847 (1991)
Plataniotis, K.N., Venetsanopoulos, A.N.: Color Image Processing and Applications. Springer, Berlin Heidelberg New York (2000)
Stricker, M., Orengo, M.: Similarity of color images. In: Proceedings of the Conference on Storage Retrieval and Image Video Databases III (SPIE '95), 2420, 381–392 (1995)
Unser, M.: Texture classification and segmentation using wavelet frames. IEEE Trans. Image Process. 4(11), 1549–1560 (1995)
Song, X.M., Fan, G.L.: Unsupervised Bayesian image segmentation using wavelet-domain hidden Markov models. In: Proceedings of the IEEE International Conference on Image Processing (2003)
Choi, H., Baraniuk, R.: Multiscale image segmentation using wavelet-domain hidden Markov models. IEEE Trans. Image Process. 10(9), 1309–1321 (2001)
Shapiro, J.M.: Embedded image coding using zerotrees of wavelet coefficients. IEEE Trans. Signal Process. 41(12), 3445–3462 (1993)
Said, A., Pearlman, W.A.: A new fast and efficient image codec based on set partitioning in hierarchical trees. IEEE Trans. Circuits Syst. Video Technol. 6(3), 243–250 (1996)
Foley, J.D.: Fundamentals of Interactive Computer Graphics. Addison-Wesley, Reading, MA (1990)
Trtgve, R., John, H.H.: Filtering for texture classification: A comparative study. IEEE Trans. Pattern Anal. Mach. Intell. 21(4), 291–310 (1999)
Sundaram, H., Chang, S.F.: Efficient video sequence retrieval in large repositories. In: Proceedings of the Conference on Storage and Retrieval for Image and Video Databases VII (SPIE '99), San Jose, CA (1999)
Hua, K.A., Vu, K., Oh, J.H.: SamMatch: A flexible and efficient sampling-based image retrieval technique for large image databases. In: Proceedings of the 7th ACM International Conference on Multimedia (Part 1), pp. 225–234, Orlando, FL (1999)
White, D.W., Jain, R.: Similarity Indexing: Algorithms and Performance. In: Proceedings of the Conference on Storage and Retrieval for Image and Video Databases IV, pp. 62–75, San Jose, CA (1996)
Byoung, C.K., Jing, P., Hyeran, B.: Region-based image retrieval using probabilistic feature relevance learning. Pattern Anal. Appl. 4(2–3), 174–184 (2001)
Forsyth, D.A., Ponce, J.: Computer Vision: A Modern Approach, 1st edn. Prentice Hall, Englewood Cliffs, NJ (2002)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Sun, Y., Ozawa, S. HIRBIR: A hierarchical approach to region-based image retrieval. Multimedia Systems 10, 559–569 (2005). https://doi.org/10.1007/s00530-005-0182-7
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00530-005-0182-7