ABSTRACT
In typical image retrieval systems, to search for an object, users must specify a region bounding the object in an input image. There are situations that the queried region does not have any match with regions in images of the retrieved database. Finding a region in the input image to form a good query, which certainly returns relevant results, is a tedious task because users need to try all possible query regions without prior knowledge about what objects are really existed in the database. This paper presents a novel recommendation system, named Recommend-Me, which automatically recommends good query regions to users.
To realize good query regions, their matches in the database must be found. A greedy solution based on evaluating all possible region pairs, given a pair is formed by one candidate region in the input image and one region in an image of the database, is infeasible. To avoid that, we propose a two-stage approach to significantly reduce the search space and the number of similarity evaluations. Specifically, we first use inverted index technique to quickly filter out a large number of images having insufficient similarities with the input image. We then propose and apply a novel branch-and-bound based algorithm to efficiently identify region pairs with highest scores. We demonstrate the scalability and performance of our system on two public datasets of over 100K and 1 million images.
- M. P. O. Chum, A. Mikulik, and J. Matas. Total recal ii: Query expansion revisited. CVPR, 2011. Google ScholarDigital Library
- H. Jegou, M. Douze, and C. Schmid. Hamming embedding and weak geometric consistency for large scale image search. ECCV, 2008. Google ScholarDigital Library
- H. Jegou, H. Harzallah, and C. Schmid. A contextual disimilarity measure for accurate and efficient image search. CVPR, 2007.Google ScholarCross Ref
- C. H. Lampert. Detecting objects in large image collections and videos by efficient subimage retrieval. ICCV, 2009.Google ScholarCross Ref
- C. H. Lampert, M. B. Blaschko, and T. Hofmann. Efficient subwindow search: A branch and bound framework for object localization. PAMI, 2009. Google ScholarDigital Library
- E. L. Lawler and D. E. Wood. Branch-and-bound methods: A survey. Operation Research, 1978.Google Scholar
- M. Perdoch, O. Chum, and J. Matas. Efficient representation of local geometry for large scale object retrieval. CVPR, 2009.Google ScholarCross Ref
- F. Perronnin, Y. Liu, J. Sanchez, and H. Poirier. Large-scale image retrieval with compressed fisher vector. CVPR, 2010.Google ScholarCross Ref
- J. Philbin, O. Chum, M. Isard, J. Sivic, and A. Zisserman. Object retrieval with large vocabularies and fast spatial matching. CVPR, 2007.Google ScholarCross Ref
- K. E. A. V. D. Sande, J. R. R. Uijlings, T. Gevers, and A. W. M. Smeulders. Segmentation as selective search for object recognition. ICCV, 2011. Google ScholarDigital Library
- J. Sivic and A. Zisserman. Video google: A text retrieval approach to object matching in videos. ICCV, 2003. Google ScholarDigital Library
- J. Yuan and Y. Wu. Spatial random partition for common visual pattern discovery. ICCV, 2007.Google ScholarCross Ref
- Z. J. Zha, L. Yang, T. Mei, M. wang, Z. Wang, T. S. Chua, and X. S. Hua. Visual query suggestion: Towards capturing user intent in internet image search. TOMCCAP, 2010. Google ScholarDigital Library
- G. Zhao and J. Yuan. Mining and cropping common objects from images. ACM Multimedia, 2010. Google ScholarDigital Library
Index Terms
- Recommend-Me: recommending query regions for image search
Recommendations
Image retrieval based on multi-texton histogram
This paper presents a novel image feature representation method, called multi-texton histogram (MTH), for image retrieval. MTH integrates the advantages of co-occurrence matrix and histogram by representing the attribute of co-occurrence matrix using ...
A new ROI based image retrieval system using an auxiliary Gaussian weighting scheme
In state-of-the-art region of interest (ROI) based image retrieval systems, the user defined ROI query is considered more effectively reflecting the user's intention than an ROI query automatically selected by the system. Compared with existing image ...
An efficient computation method for the texture browsing descriptor of MPEG-7
In this paper, an efficient computation method for computing the texture browsing descriptor of MPEG-7 is provided. Texture browsing descriptor is used to characterize a texture's regularity, directionality and coarseness. To compute the regularity of ...
Comments