skip to main content
10.1145/1282280.1282281acmconferencesArticle/Chapter ViewAbstractPublication PagescivrConference Proceedingsconference-collections
Article

A content-based image retrieval scheme allowing for robust automatic personalization

Published:09 July 2007Publication History

ABSTRACT

The retrieval performance of content-based image retrieval (CBIR) systems is often disappointingly low, mainly due to the subjectivity of human perception. Relevance feedback (RF) has been widely considered as a powerful tool to enhance CBIR systems by incorporating human perception subjectivity into the retrieval procedure. However, usually, the obtained feedback logs are scarce and contain lots of outliers, undermining the RF adaptation effectiveness. In this paper, we tackle these shortcomings exploiting the inherent outlier downweighting capabilities mixtures of Student's t distributions offer. Each semantic class is modeled by a mixture of t distributions fitted to data provided by the system operators. Further, the semantic class models get personalized by application of a novel, efficient RF algorithm allowing for the robust adaptation of the semantic class models to the accumulated feedback of each user. The efficacy of our approach is validated through a series of experiments using objective performance criteria.

References

  1. MPEG-7 Visual Part of eXperimentation Model Version 2.0. ISO/MPEG MPEG-7 Output Document, 1999.Google ScholarGoogle Scholar
  2. Y. Avrithis, N. Doulamis, A. Doulamis, and S. Kollias. Optimization methods for key-frames and scenes extraction. Comput. Vis. Image Understanding, 75(1/2):3--24, Jul./Aug. 1999.Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. N. Babaguchi, K. Ohara, and T. Ogura. Effect of personalization on retrieval and summarization of sports video. In Joint Conference of the Fourth International Conference on Information, Communications and Signal Processing, and the Fourth Pacific Rim Conference on Multimedia, volume 2, pages 940--944, 2003.Google ScholarGoogle ScholarCross RefCross Ref
  4. Y. Chen, X. S. Zhou, and T. Huang. One-class SVM for learning in image retrieval. In Proc. IEEE Int'l Conf. Image Processing, 2001, volume 1, pages 34--37, 2001.Google ScholarGoogle Scholar
  5. I. Cox, M. L. Miller, S. M. Omohundro, and P. N. Yianilos. Pichunter: Bayesian relevance feedback for image retrieval. In Proc. Int. Conf. Pattern Recognition, 1996, volume 3, pages 362--369, 1996. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. A. Doulamis and N. Doulamis. Generalized nonlinear relevance feedback for interactive content-based retrieval and organization. IEEE Trans. Circuits Syst. Video Technol., 14(5):656--671, 2004. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. T. S. Huang and X. S. Zhou. Image retrieval by relevance feedback: from heuristic weight adjustment to optimal learning methods. In Proc. IEEE Int'l Conf. Image Processing, 2001, volume 3, pages 2--5, 2001.Google ScholarGoogle ScholarCross RefCross Ref
  8. Y. Ishikawa, R. Subramanya, and C. Faloutsos. Mindreader: Query databases through multiple examples. In Proc. 24th VLDB Conf, pages 218--227, 1998. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. C. J. Leggetter and P. C. Woodland. Maximum likelihood linear regression for speaker adaptation of continuous density hidden markov models. Computer Speech & Language, 9(2):171--185, 1995.Google ScholarGoogle Scholar
  10. B. Manjunath, P. Wu, S. Newsam, and H. Shin. A texture descriptor for browsing and similarity retrieval. J. Signal Processing: Image Comm., 16:33--42, 2000.Google ScholarGoogle ScholarCross RefCross Ref
  11. P. Muneesawang and L. Guan. Image retrieval with embeded sub-class information using Gaussian mixture models. In Proc. Int. Conference Multimedia and Expo, 2003, volume 1, pages 769--772, 2003. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. D. Peel and G. J. McLachlan. Robust mixture modeling using the t distribution. Statistics and Computing, 10(4):339--348, 2000. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Y. Rui, T. Huang, and S. Mehrotra. Content-based image retrieval with relevance feedback in MARS. In Proc. IEEE Int'l Conf. Image Processing, 1997, volume 2, pages 815--818, 1997.Google ScholarGoogle ScholarCross RefCross Ref
  14. Y. Rui, T. Huang, M. Ortega, and S. Mehrotra. Relevance feedback: A power tool for interactive content-based image retrieval. IEEE Trans. Circuits Syst. Video Technol., 8:644--655, 1998. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. G. Salton and M. J. McGill. Introduction to Modern Information Retrieval. McGraw-Hill, New York, 1982. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. S. Shoham. Robust clustering by deterministic agglomeration EM of mixtures of multivariate t distributions. Statistics and Computing, 35(55):1127--1142, 2002.Google ScholarGoogle Scholar
  17. A. W. M. Smeulders, M. Worring, S. Santini, A. Gupta, and R. Jain. Content-based image retrieval at the end of the early years. IEEE Trans. Pattern Analysis and Machine Intelligence, 22(12):1349--1380, 2000. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Z. Su, H. Zhang, S. Li, and S. Ma. Relevance feedback in content-based image retrieval: Bayesian framework, feature subspaces, and progressive learning. IEEE Trans. Image Processing, 12(8):924--937, 2003. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. N. Vasconcelos and A. Lippman. Learning from user feedback in image retrieval systems. In Proceedings of Neural Information Processing Systems 12, volume 1, 1999.Google ScholarGoogle Scholar
  20. N. Vasconcelos and A. Lippman. Statistical models of video structure for content analysis and characterization. IEEE Trans. Image Processing, 9:3--19, 2000. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. X. S. Zhou and T. Huang. Small sample learning during multimedia retrieval using biasmap. In Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2001, volume 1, pages 11--17, 2001.Google ScholarGoogle Scholar

Index Terms

  1. A content-based image retrieval scheme allowing for robust automatic personalization

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      CIVR '07: Proceedings of the 6th ACM international conference on Image and video retrieval
      July 2007
      655 pages
      ISBN:9781595937339
      DOI:10.1145/1282280

      Copyright © 2007 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 9 July 2007

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • Article

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader