Abstract
Techniques for efficient and effective content-based image matching are becoming increasingly important with the widespread increase in digital image capturing systems. Shape of an object, represented by its contour, is one of the most important visual feature that is thought to be used by humans to determine the similarity of objects. The selected feature and its distance measure must be robust to different distortions such as noise, articulation, scale and rotation. Existing approaches provides invariance to these distortions at the cost of either the accuracy due to poor discrimination ability or the efficiency. In this paper, we present an effective representation of shape, using its boundary information, that is robust to arbitrary distortions and affine transformation. The contour representation of shape is converted into time series and is modeled using orthogonal basis function representations. Shape matching is then carried out in the chosen coefficient feature space resulting in efficient matching. The efficiency of shape matching is further improved by indexing the shape descriptors using hierarchical indexing structure. A novel distributed beam search based technique is proposed that operates on the indexing structure and ensures no false dismissal for a given k-NN query. Experimental evaluation demonstrates that the proposed shape representation and matching mechanism is robust, efficient and scalable to very large shape datasets.
Similar content being viewed by others
Notes
Silhouette dataset is available at: http://www.lems.brown.edu/vision/researchAreas/SIID/silhouette-database.tar.gz.
MixedBag dataset is available at: http://www.cs.ucr.edu/~eamonn/shape/shape.htm.
Diatom dataset is available at: http://rbg-web2.rbge.org.uk/ADIAC/.
References
Osada, R., Funkhouser, T., Chazelle, B., Dobkin, D.: Shape Distributions. ACM Trans. Gr. 21(4), 807–832 (2002)
Keogh, E., Wei, L., Xi, X., Lee, S.-H., Vlachos, M.: LB-Keogh supports exact indexing of shapes under rotation Invariance with arbitrary representations and distance measures, VLDB (2006)
Adamek, T., O’Connor, N.E.: A multiscale representation method for nonrigid shapes with a single closed contour. IEEE Trans. Circuits Syst. Video Technol. 14(5), 742–753 (2004)
Adamek, T., O’Connor, N.: Efficient contour-based shape representation and matching. In: Proceedings of the 5th ACM SIGMM international workshop on Multimedia information retrieval, Berkeley (2003). doi:10.1145/973264.973287. http://doi.acm.org/10.1145/973264.973287
Attalla, E., Siy, P.: Robust shape similarity retrieval based on contour segmentation polygonal multiresolution and elastic matching. Pattern Recognit. 38(12), 2229–2241 (2005)
Faloutsos, C., Ranganathan, M., Manolopoulos, Y.: Fast sub-sequence matching in time-series databases. In: Proceedings of the 1994 ACM SIGMOD International Conference on Management of Data, pp. 419–429 (1994)
Agarwal, R., Faloutsos, C., Swami, A.: Efficient similarity search in sequence databases. 4th international conference of foundations of data organization and algorithms, pp. 69–84, Evanston, IL, October 1993
Chan, K., Fu, A.: Efficient time series matching by wavelets. In: Proceedings of International Conference on Data Engineering, pp. 126–133, Sydney (1999)
Keogh, E., Chakrabarti, K., Pazzani, M., Mehrota, S.: Locally adaptive dimensionality reduction for indexing large time series databases. In: Proceedings of ACM SIGMOD conference, pp. 151–162 (2001)
Cai, Y., Ng, R.: Indexing spatio-temporal trajectories with Chebyshev polynomials, ACM SIGMOD/PODS conference, pp. 599–610, France, 13–18 June (2004)
Mori, G., Belongie, S., Malik, J.: Efficient shape matching using shape contexts. IEEE Trans. Pattern Anal. Mach. Intell. 27(11), 1832–1837 (2005)
Belongie, S., Malik, J., Puzicha, J.: Shape matching and object recognition using shape contexts. IEEE Trans. Pattern Anal. Mach. Intell. 24(24), 509–522 (2002)
Belongie, S., Malik, J., Puzicha, J.: Matching shapes. In: Proceedings of Eighth IEEE International Conference on Computer Vision, vol. I, Vancouver, Canada, pp. 454–461, July (2001)
Davies, E.R.: Machine vision: theory, algorithms, practicalities, pp. 171–191. Academic Press, New York (1997)
Manay, S., Cremers, D., Hong, B.-W., Yezi, A.J., Soatto, S.: Integral invariants for shape matching. IEEE Trans. Pattern Anal. Mach. Intell. 28(10), 1602–1618 (2006)
Bruckstein, A.M., Holt, R.J., Netravali, A.N., Richardson, T.J.: Invariant signatures for planar shape recognition under partial occlusion. J. Comput. Vis. Gr. Image Process. 58(1), 49–65 (1993)
Boutin, M.: Numerically Invariant Signature Curves. J. Comput. Vis. 40(3), 235–248 (2000)
Fu, A.W., Keogh, E., Lau, L.Y.H., Ratanamahatana, C.A.: Scaling and time warping in time series querying. VLDB 14(5), 742–753 (2005)
Chetverikov, D., Khenokh, Y.: Matching for shape defect detection. In: Davies, E.R. (ed.) Machine vision: theory, algorithms, lecture notes in computer science, vol. 1689, pp. 367–374. Springer, Berlin (1999)
Berretti, S., Bimbo, A.D., Pala, P.: Retrieval by shape similarity with perceptual distance and ejective indexing. IEEE Trans. Multimed. 2(4), 225–239 (2000)
Dudek, G., Tsotsos, J.K.: Shape representation and recognition from multiscale curvature. J. Comput. Vis. Image Underst. 68(2), 170–189 (1997)
Li, D., Simske, S.: Shape retrieval based on distance ratio distribution, HP Tech Report HPL-2002-251, (2002)
Cardone, A., Gupta, S.K., Karnik, M.: A survey of shape similarity assessment algorithms for product design and manufacturing applications. ASME J. Comput. Inform. Sci. Eng. 3(2), 109–118 (2003)
Wang, Z., Chi, Z., Feng, D., Wang, Q.: Leaf image retrieval with shape features. In: Proceedings of the 4th International Conference on Advances in Visual Information Systems, pp. 477–487 (2000)
Bhanu, B., Zhou, X.: Face recognition from face profile using dynamic time warping. In: Proceedings of International Conference on Pattern Recognition, pp. 499–502 (2004)
Wang, X., Ye, L., Keogh, E., Shelton, C.: Annotating historical archives of images.In: 8th ACM/IEEE-CS Joint Conference on Digital libraries, pp. 341–350 (2008)
Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)
Tan, K.L., Ooi, B.C., Thiang, L.F.: Indexing shapes in image databases using the centroid-radii model. Data Knowl. Eng. 32, 271–289 (2000)
Petrakis, E.G.M., Milios, E.: Efficient retrieval by shape content. Proc. ICMCS 2, 616–621 (1999)
Grauman, K., Darrell, T.: The pyramid match kernel: discriminative classification with sets of image features. In: Proceedings of ICCV (2005)
Philbin, J., Chum, O., Isard, M., Sivic, J., Zisserman, A.: Object retrieval with large vocabularies and fast spatial matching. In: CVPR (2007)
Sivic, J., Zisserman, A.: Video google: a text retrieval approach to object matching in videos. In: ICCV (2003)
Keogh, E.J., Pazzani, M.J.: A simple dimensionality reduction technique for fast similarity search in large time series databases. Pacific-Asia conference on knowledge discovery and data mining, pp. 122–133 (2000)
Vlachos, M., Vagena, Z., Yu, P.S., Athitsos, V.: Rotation invariant indexing of shapes and line drawings. In: Proceedings of ACM Conference on Information and Knowledge Management (CIKM), pp. 131–138 (2005)
Author information
Authors and Affiliations
Corresponding author
Additional information
Communicated by Thomas Plagemann.
Rights and permissions
About this article
Cite this article
Khalid, S. Incremental indexing and retrieval mechanism for scalable and robust shape matching. Multimedia Systems 18, 319–336 (2012). https://doi.org/10.1007/s00530-011-0252-y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00530-011-0252-y