Abstract
One of the strongest cues for retrieval of content information from images is shape. However, due to the wide range of transformations that an object might undergo, this is also the most difficult one to handle. It seems that shape retrieval is one of the major barriers nowadays on the way of image databases to become commonly used. Common approaches use global attributes (Faloutsos et al. [1]), feature points (Pentland et al. [2]), histograms (Jain and Vailaya [3]), or physical models of deformations (Del Bimbo and Pala [4]). We present an approach for shape retrieval from pictorial databases which is based on invariant features of the image. In particular we use a combination of semi-local multi-valued invariant signatures and global features. Spatial relations and global properties are used to eliminate non-relevant images before similarity is computed. Common approaches usually don't handle viewpoint transformations more complex than similarity and require the full shape in order to compute image features. The advantages of the proposed approach are its ability to handle images distorted by different viewpoint transformations, its ability to retrieve images even in situations in which part of the shape is missing (i.e., in case of occlusion or sketch-based queries), and its ability to support efficient indexing.
We have implemented our approach in a heterogeneous database having a SQL-like user interface augmented with sketch-based queries. The system is built on top of a commercial database system, and can be activated from the Web. We present experimental results demonstrating the effectiveness of the proposed approach.
Chapter PDF
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
C. Faloutsos, R. Barber, M. Flickner, J. Hafner, W. Niblack, D. Petkovich, and W. Equitz, Efficient and effective querying by image content, Journal of Intelligent Information Systems 3, 1994, 231–262.
A. Pentland, R. Picard, and S. Sclaroff, Photobook: Tools for content-base manipulation of image databases, in Proceedings, SPIE Conf. on Storage and Retrieval of Image Databases II, 1994, pp. 37–50.
A. Jain and A. Vailaya, Image retrieval using color and shape, Pattern Recognition 29, 1996, 1233–1244.
A. D. Bimbo and P. Pala, Visual image retrieval by elastic matching of user sketches, IEEE Trans. Patt. Anal. Mach. Intell. 19, 1997, 121–132.
S.-F. Chang, J. Smith, and H. Wang, Automatic feature extraction and indexing for content-based visual query, Tech. Rep. 408-95-14, Columbia University Center for Telecommunications Research, New York, NY, 1995.
S.-F. Chang and J. Smith, Extracting multi-dimensional signal features for contentbased visual query, in SPIE Int. Symp. on Visual Communications and Image Processing, 1995.
R. Mehrotra and J. Gary, Similar-shape retrieval in shape data management, IEEE Computer 28, 1995, 57–62.
K. Shields, J. Eakins, and J. Boardman, Automatic image retrieval using shape features, New Review of Document and Text Management 1, 1995, 183–198.
S. Lee and F.J.Hsu, Spatial reasoning and similarity retrieval of images using 2D-C string knowledge representation, Pattern Recognition 25, 1992, 305–318.
T. Moons, E. Pauwels, L. V. Gool, and A. Oosterlinck, Foundations of semidifferential invariants, Int. Journal Of Comput. Vision 14, 1995, 25–47.
A. Bruckstein, J. Holt, A. Netravali, and T. Richardson, Invariant signatures for planar shape recognition under partial occlusion, CVGIP:Image Understanding 58, 1993, 49–65.
A. Bruckstein, E. Rivlin, and I. Weiss, Recognizing objects using scale space local invariants, in Int. Conf. on Pattern Recognition, Vienna, 1996, p. A9M.6.
T. Moons, E. Pauwels, L. V. Gool, and A. Oosterlinck, Recognition of planar shapes under affine distortion, Int. Journal Of Comput. Vision 14, 1995, 49–65.
J. Köbler, U. Schöning, and J. Torán, The graph isomorphism problem. Birkhäuser, Boston, 1993.
Kbs beer bottle collection, URL: http://tuoppi.oulu.fi/kbs/beer/kbsbeer.htm
A. Zisserman, D. Forsyth, J. Mundy, C. Rothwell, J. Liu, and N. Pillow, 3d object recognition using invariance, Artificial Intelligence 78, 1995, 239–288.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1998 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kliot, M., Rivlin, E. (1998). Invariant-based shape retrieval in pictorial databases. In: Burkhardt, H., Neumann, B. (eds) Computer Vision — ECCV'98. ECCV 1998. Lecture Notes in Computer Science, vol 1406. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0055686
Download citation
DOI: https://doi.org/10.1007/BFb0055686
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-64569-6
Online ISBN: 978-3-540-69354-3
eBook Packages: Springer Book Archive