Skip to main content
SpringerLink
Log in

Spatial Color Indexing and Applications

  • Published:
International Journal of Computer Vision Aims and scope Submit manuscript

Abstract

We define a new image feature called the color correlogram and use it for image indexing and comparison. This feature distills the spatial correlation of colors and when computed efficiently, turns out to be both effective and inexpensive for content-based image retrieval. The correlogram is robust in tolerating large changes in appearance and shape caused by changes in viewing position, camera zoom, etc. Experimental evidence shows that this new feature outperforms not only the traditional color histogram method but also the recently proposed histogram refinement methods for image indexing/retrieval. We also provide a technique to cut down the storage requirement of the correlogram so that it is the same as that of histograms, with only negligible performance penalty compared to the original correlogram.

We also suggest the use of color correlogram as a generic indexing tool to tackle various problems arising from image retrieval and video browsing. We adapt the correlogram to handle the problems of image subregion querying, object localization, object tracking, and cut detection. Experimental results again suggest that the color correlogram is more effective than the histogram for these applications, with insignificant additional storage or processing cost.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Boresczky, J.S. and Rowe, L.A. 1996. A comparison of video shot boundary detection techniques. In Storage & Retrieval for Image and Video Databases IV; Proc. SPIE 2670, pp. 170–179.

  • Brock-Gunn, S.A. and Ellis, T.J. 1992. Using color templates for target identification and tracking. In Proc. British Machine Vision Conference, pp. 207–216.

  • 1995. Content-based image retrieval systems, IEEE Computer.

  • Cox, I.J., Matt L. Miller, Stephen M. Omohundro, and Peter N. Yianilas, 1996. PicHunter: Bayesian relevance feedback for image retrieval. In Intl. Conf. on Pattern Recognition, Vienna, Austria.

  • Ennesser, F. and Medioni, G. 1995. Finding waldo, or focus of attention using local color information. IEEE Trans. onPattern Analysis and Machine Intelligence, 17(8).

  • Enser, P.G.B. 1993. Query analysis in a visual information retrieval context. J. Document and Text Management, 1:25–52.

    Google Scholar 

  • Fleck, M.M., Forsyth, D.A., and Bregler, C. 1996. Finding naked people. In European Conf. on Computer Vision, Vol. 2, pp. 590–602.

    Google Scholar 

  • Flickner, M. et al. 1995. Query by image and video content: The QBIC system. IEEE Computer, 28(9):23–32.

    Google Scholar 

  • Forsyth, D.A. et al. 1996. Finding pictures of objects in large collections of images. In Proc. Intl. Workshop on Object Recognition, Cambridge.

  • Funt, B. and Finlayson, G. 1995. Color constant color indexing. IEEE Trans. on Pattern Analysis and Machine Intelligence, 17:522–529.

    Google Scholar 

  • Gong, Y. et al. 1994. An image database system with content capturing and fast image indexing abilities. In Intl. Conf. on Multimedia Comp & Systems, pp. 121–130.

  • Gong, Y. 1998. Intelligent Image Databases: Towards Advanced Image Retrieval. Kluwer Academic Publishers.

  • Grimson, W.L. and Lozano-Pérez, T. 1987. Localising overlapping parts by searching the interpretation tree. IEEE Trans. on Pattern Analysis and Machine Intelligence, 9:469–482.

    Google Scholar 

  • Hafner, J., Sawhney, H., Equitz, W., Flickner, M., and Niblack, W. 1995. Efficient color histogram indexing for quadratic form distance functions. IEEE Trans. on Pattern Analysis and Machine Intelligence, 17(7):729–736.

    Google Scholar 

  • Hampapur, A., Jain, R., and Weymouth, T. 1994. Digital video indexing in multimedia systems. In Proc. AAAI-94 Workshop on Indexing and Reuse in Multimedia Systems.

  • Haralick, R.M. 1979. Statistical and structural approaches to texture. Proc. of IEEE, 67(5):786–804.

    Google Scholar 

  • Haussler, D. 1992. Decision theoretic generalization of the PAC model for neural net and other learning applications. Information and Computation, 100:78–150.

    Google Scholar 

  • Hsu, W., Chua, T.S., and Pung, H.K. 1995. An integrated colorspatial approach to content-based image retrieval. In Proc. 3rd ACM Multimedia Conf., pp. 305–313.

  • Huang, J., Kumar, S.R., and Mitra, M. 1997. Combining supervised learning with color correlograms for content-based image retrieval. In Proc. 5th ACM Multimedia Conf., pp. 325–334.

  • Huang, J., Kumar, S.R., Mitra, M., Zhu, W.J., and Zabih, R. 1997. Image indexing using color correlograms. In Proc. 16th IEEE Conf. on Computer Vision and Pattern Recognition, pp. 762–768.

  • Huang, J., Kumar, S.R., Mitra, M., and Zhu, W.J. 1998. Spatial color indexing and applications. In Proc. 8th Intl. Conf. on Computer Vision.

  • Huttenlocher, D.P. and Ullman, S. 1986. Object recognition using alignment. In Proc. Intl. Conf. on Computer Vision, pp. 102–111.

  • Huttenlocher, D.P., Klanderman, G.A., and Rucklidge, W.J. 1993. Comparing images using the Hausdorff distance. IEEE Trans. Pattern Analysis and Machine Intelligence, 15:850–863.

    Google Scholar 

  • Huttenlocher, D.P., Lilien, R.H., and Olson, C.F. 1996. Object recognition using subspace methods. In Proc. European Conf. on Computer Vision, pp. 536–545.

  • Jacobs, D.W., Weinshall, D., and Gdalyahu, Y. 1998. Condensing image databases when retrieval is based on non-metric distances. In Proc. Intl. Conf. on Computer Vision.

  • Marr, D. and Nishihara, H.K. 1978. Representation and recognition of the spatial organization of three-dimensional shapes. Proc. Royal Soc. Lond. B., 200:269–294.

    Google Scholar 

  • Margalit, A. and Rosenfeld, A. 1990. Using probabilistic domain knowledge to reduce the expected computational cost of template matching. Computer Vision; Graphics; and Image Processing, 51:219–234.

    Google Scholar 

  • Matas, J., Marik, R., and Kittler, J. 1995. On representation and matching of multi-colored objects. In Proc. IEEE 5th Intl. Conf. on Computer Vision, pp. 726–732.

  • Murase, H. and Nayar, S.K. 1995. Visual learning and recognition of 3-D objects from appearance. Intl. Journal of Computer Vision, 14:5–24.

    Google Scholar 

  • Ogle, V. and Stonebraker, M. 1995. Chabot: Retrieval from a relational database of images. IEEE Computer, 28(9):40–48.

    Google Scholar 

  • Pass, G. and Zabih, R. 1996. Histogram refinement for content-based image retrieval. In IEEE Workshop on Applications of Computer Vision, pp. 96–102.

  • Pass, G. and Zabih, R. 1999. Comparing images using joint histograms. In Journal of Multimedia Systems, 7(3):234–240.

    Google Scholar 

  • Pentland, A., Picard, R., and Sclaroff, S. 1996. Photobook: Contentbased manipulation of image databases. Intl. Journal of Computer Vision, 18(3):233–254.

    Google Scholar 

  • Rao, R.P. and Ballard, D. 1995. Object indexing using an iconic sparse distributed memory. In Proc. IEEE 5th Intl. Conf. on Computer Vision, pp. 24–31.

  • Rickman, R. and Stonham, J. 1996. Content-based image retrieval using color tuple histograms. SPIE Proc., 2670:2–7.

    Google Scholar 

  • Roberts, L.G. 1965. Machine perception of three-dimensional solids. In Optical and Electro-Optical Information Processing. MIT Press.

  • Rousseeuw, P.J. and Leroy, A.M. 1987. Robust Regression and Outlier Detection. John Wiley & Sons.

  • Slater, D. and Healey, G. 1995. Combining color and geometric information for the illumination invariant recognition of 3-D objects. In Proc. IEEE 5th Intl. Conf. on Computer Vision, pp. 563–568.

  • Smith, J. and Chang, S.-F. 1996. Tools and techniques for color image retrieval, SPIE Proc., 2670:1630–1639.

    Google Scholar 

  • Stricker, M. and Swain, M. 1994. The capacity of color histogram indexing. In Proc. IEEE Conf. on Computer Vision and Pattern Recognition, pp. 704–708.

  • Stricker, M. and Dimai, A. 1996. Color indexing with weak spatial constraints, SPIE Proc., 2670:29–40.

    Google Scholar 

  • Swain, M. and Ballard, D. 1991. Color indexing. In Intl. Journal of Computer Vision, 7(1):11–32.

    Google Scholar 

  • Syeda-Mahmood, T.F. 1997. Data and model-driven selection using color regions. In Intl. Journal of Computer Vision, 21(1/2): 9–36.

    Google Scholar 

  • Syeda-Mahmood, T.F. and Cheng, Y.-Q. 1996. Indexing colored surfaces in images. In Intl. Conf. on Pattern Recognition.

  • Upton, G.J. and Fingleton, B. 1985. Spatial Data Analysis by Example. Vol. 1. John Wiley & Sons.

  • Vinod, V.V., Murase, H., and Hashizume, C. 1996. Focused color intersection with efficient searching for object detection and image retrieval. IEEE Proc. Multimedia, pp. 229–233.

  • Wan, X. and Jay Kuo, C.-C. 1996. Color distribution analysis and quantization for image retrieval. SPIE Proc., 2670:8–16.

    Google Scholar 

  • Yeo, B.-L. and Liu, B. 1995. Rapid scene analysis on compressed videos. In IEEE Trans. Circuits Syst. Video Technology, 5, 6: 533–544.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Cornell University, Ithaca, NY, 14850

    Jing Huang, S. Ravi Kumar, Mandar Mitra, Wei-Jing Zhu & Ramin Zabih

Authors
  1. Jing Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. S. Ravi Kumar
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mandar Mitra
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Wei-Jing Zhu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Ramin Zabih
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Huang, J., Ravi Kumar, S., Mitra, M. et al. Spatial Color Indexing and Applications. International Journal of Computer Vision 35, 245–268 (1999). https://doi.org/10.1023/A:1008108327226

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1008108327226

Search

Navigation