Skip to main content
SpringerLink
Log in

Multiple representations, similarity matching, and results fusion for content-based image retrieval

  • Regular Paper
  • Published:
Multimedia Systems Aims and scope Submit manuscript

Abstract

In this paper, we show how the use of multiple content representations and their fusion can improve the performance of content-based image retrieval systems. We consider the case of texture and propose a new algorithm for texture retrieval based on multiple representations and their results fusion. Texture content is modeled using two different models: the well-known autoregressive model and a perceptual model based on perceptual features such as coarseness and directionality. In the case of the perceptual model, two viewpoints are considered: perceptual features are computed based on the original images viewpoint and on the autocovariance function viewpoint (corresponding to original images). So we consider a total of three content representations. The similarity measure used is based on Gower's index of similarity. Simple results of the fusion models are used to merge search results returned by different representations. Experimentations and benchmarking carried out on the well-known Brodatz database show a drastic improvement in search effectiveness with the fused model without necessarily altering their efficiency in an important way.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Abbadeni, N.: Perceptual meaning of the estimated parameters of the autoregressive model. To appear In: Proceedings of the 12th IEEE International Conference on Image Processing, Genova, Italy (2005)

    Google Scholar 

  2. Abbadeni, N.: Content representation and similarity matching for texture-based image retrieval. In: Proceedings of the 5th ACM International Workshop on Multimedia Information Retrieval (held in conjunction with ACM Multimedia), Berkeley, CA (2003)

  3. Abbadeni, N.: A new similarity matching measure: application to texture-based image retrieval. In: Proceedings of the 3rd International Workshop on Texture Analysis and Synthesis (held in conjunction with IEEE ICCV), Nice, France (2003)

  4. Abbadeni, N., Ziou, D., Wang, S.: Computational measures corresponding to perceptual textural features. In: Proceedings of the 7th IEEE International Conference on Image Processing, Vancouver, BC, Canada (2000)

  5. Abbadeni, N., Ziou, D., Wang, S.: Autocovariance-based perceptual textural features corresponding to human visual perception. In: Proceedings of the 15th IAPR/IEEE International Conference on Pattern Recognition, Barcelona, Spain (2000)

  6. Abbadeni, N.: Recherche d'images basée sur le contenu. Représentation de la texture par le modèle autorégressif. Research report (in French), No. 216, p. 50. University of Sherbrooke (1998)

  7. Amadasun, M., King, R.: Textural features corresponding to textural properties. IEEE Trans. Syst. Man Cybern. 19(5), 1264–1274 (1989)

    Article  Google Scholar 

  8. Aslam, J.A., Montague, M.: Models for metasearch. In: Proceedings of the International ACM SIGIR Conference, pp. 276–284. New Orleans, LA (2001)

  9. Belkin, N.J., Cool, C., Croft, W.B., Callan, J.P.: The effect of multiple query representation on information retrieval. performance. In: Proceedings of the 16th International ACM SIGIR Conference, pp. 339–346 (1993)

  10. Berretti, S., Del Bimbo, A., Pala, P.: Merging results for distributed content-based image retrieval. Multimedia Tools Appl. 24, 215–232 (2004)

    Article  Google Scholar 

  11. Del Bimbo, A.: Visual Information Retrieval. San Francisco: Morgan Kaufmann (1999)

    Google Scholar 

  12. Brodatz, P.: Textures: A Photographic Album for Artists and Designers. New York: Dover (1966)

    Google Scholar 

  13. Dunlop, M.D.: Time, relevance and interaction modeling for information retrieval. In: Proceedings of the International ACM SIGIR Conference, pp. 206–213. Philadelphia, USA (1997)

  14. Frankot, R.T., Chellappa, R.: Lognormal random-field models and their applications to radar image synthesis. IEEE Trans. Geosci. Remote Sens. 25(2), 195–206 (1987)

    Google Scholar 

  15. French, J.C., Chapin, A.C., Martin, W.N.: An application of multiple viewpoints to content-based image retrieval. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries, pp. 128–130 (2003)

  16. Gower, J.C.: A general coefficient of similarity and some of its properties. Biometr. J. 27, 857–874 (1971)

    Google Scholar 

  17. Guildford, J.P.: Psychometric Methods. New York: McGraw-Hill (1954)

    Google Scholar 

  18. Kashyap, R.L., Chellappa, R.: Estimation and choice of neighbors in spatial interaction models of images. IEEE Trans. Inf. Theory 29(1), 60–72 (1983)

    Article  Google Scholar 

  19. Lee, J.H.: Analysis of multiple evidence combination, In: Proceedings of the ACM SIGIR Conference, pp. 267–276. Philadelphia (1997)

  20. Liu, F., Picard, R.W.: Periodicity, directionality and randomness: Wold features for image modeling and retrieval. IEEE Trans. Pattern Anal. Mach. Intell. 18(7), 722–733 (1996)

    Article  Google Scholar 

  21. Lu, Y., Hu, C., Zhu, X., Zhang, H., Yang, Q.: A unified framework for semantics and feature based relevance feedback in image retrieval systems. In: Proceedings of the 8th ACM International Conference on Multimedia, pp. 31–37. Marina Del Rey, CA (2000)

  22. Manjunath, B.S., Ma, W.Y.: Texture features for browsing and retrieval of image data. IEEE Trans. Pattern Anal. Mach. Intell. 18(8), 837–842 (1996)

    Article  Google Scholar 

  23. Muller, H., Marchand-Maillet, S., Pun, T.: The truth about COREL - Evaluation in Image Retrieval. In: International Conference on Image and Video Retrieval (CIVR), pp. 38–49. London (2002)

  24. Muneesawang, P., Guan, L.: An interactive approach for CBIR using a network of radial basis functions. IEEE Trans. Multimedia 6(5), 703–716 (2004)

    Article  Google Scholar 

  25. Payne, J.S., Hepplewhite, L., Stonham, T.J.: Texture, human perception, and information retrieval measures. In: Proceedings of the ACM SIGIR MF/IR Workshop (2000)

  26. Press, W.H., Teukolsky, S.A., Vitterling, W.T., Flannery, B.P.: Numerical Recipes in C, 2nd edn. Cambridge: Cambridge University Press (1992)

    Google Scholar 

  27. Rui, Y., Huang, T.S., Mehrota, S.: A relevance feedback architecture for multimedia information retrieval systems. In: IEEE Workshop on Content-based Access of Image and Video Libraries, pp. 82–89 (1997)

  28. Sun, Y., Ozawa, S.: Semantic-meaningful content-based image retrieval in wavelet domain. In: Proceedings of the 5th ACM International Workshop on Multimedia Information Retrieval (held in conjunction with ACM Multimedia), pp. 122–129. Berkeley, CA (2003)

  29. Tamura, H., Mori, S., Yamawaki, T.: Textural features corresponding to visual perception. IEEE Trans. Syst. Man Cybern. 8(6), 460–472 (1978)

    Google Scholar 

  30. Tuceryan, M., Jain, A.K.: Texture analysis, In: Chen, C.H., Pau, L.F., Wang, P.S.P. (eds.): Handbook of Pattern Recognition and Computer Vision. Singapore: World Scientific (1993)

  31. Vogt, C.C., Cottrell, G.W.: Fusion via a linear combination of scores. Informat. Retriev. J. 1, 151–173 (1999)

    Article  Google Scholar 

  32. Wu, Y., Zhang, A.: Interactive pattern recognition for relevance feedback in multimedia information retrieval. ACM Multimedia Syst. J. 10, 41–55 (2004)

    Article  Google Scholar 

  33. Zhou, X.S., Huang, T.S.: Relevance feedback for image retrieval: a comprehensive review. ACM Multimedia Syst. J. 8(6), 536–544 (2003)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Faculté des sciences, Département d'informatique, Université de Sherbrooke, Sherbrooke, QC, J1K 2R1, Canada

    Noureddine Abbadeni

Authors
  1. Noureddine Abbadeni
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Noureddine Abbadeni.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Abbadeni, N. Multiple representations, similarity matching, and results fusion for content-based image retrieval. Multimedia Systems 10, 444–456 (2005). https://doi.org/10.1007/s00530-005-0173-8

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00530-005-0173-8

Keywords

Search

Navigation