Skip to main content
Log in

Incremental indexing and retrieval mechanism for scalable and robust shape matching

  • Regular Paper
  • Published:
Multimedia Systems Aims and scope Submit manuscript

Abstract

Techniques for efficient and effective content-based image matching are becoming increasingly important with the widespread increase in digital image capturing systems. Shape of an object, represented by its contour, is one of the most important visual feature that is thought to be used by humans to determine the similarity of objects. The selected feature and its distance measure must be robust to different distortions such as noise, articulation, scale and rotation. Existing approaches provides invariance to these distortions at the cost of either the accuracy due to poor discrimination ability or the efficiency. In this paper, we present an effective representation of shape, using its boundary information, that is robust to arbitrary distortions and affine transformation. The contour representation of shape is converted into time series and is modeled using orthogonal basis function representations. Shape matching is then carried out in the chosen coefficient feature space resulting in efficient matching. The efficiency of shape matching is further improved by indexing the shape descriptors using hierarchical indexing structure. A novel distributed beam search based technique is proposed that operates on the indexing structure and ensures no false dismissal for a given k-NN query. Experimental evaluation demonstrates that the proposed shape representation and matching mechanism is robust, efficient and scalable to very large shape datasets.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16

Similar content being viewed by others

Notes

  1. Silhouette dataset is available at: http://www.lems.brown.edu/vision/researchAreas/SIID/silhouette-database.tar.gz.

  2. MixedBag dataset is available at: http://www.cs.ucr.edu/~eamonn/shape/shape.htm.

  3. Diatom dataset is available at: http://rbg-web2.rbge.org.uk/ADIAC/.

References

  1. Osada, R., Funkhouser, T., Chazelle, B., Dobkin, D.: Shape Distributions. ACM Trans. Gr. 21(4), 807–832 (2002)

    Article  Google Scholar 

  2. Keogh, E., Wei, L., Xi, X., Lee, S.-H., Vlachos, M.: LB-Keogh supports exact indexing of shapes under rotation Invariance with arbitrary representations and distance measures, VLDB (2006)

  3. Adamek, T., O’Connor, N.E.: A multiscale representation method for nonrigid shapes with a single closed contour. IEEE Trans. Circuits Syst. Video Technol. 14(5), 742–753 (2004)

    Google Scholar 

  4. Adamek, T., O’Connor, N.: Efficient contour-based shape representation and matching. In: Proceedings of the 5th ACM SIGMM international workshop on Multimedia information retrieval, Berkeley (2003). doi:10.1145/973264.973287. http://doi.acm.org/10.1145/973264.973287

  5. Attalla, E., Siy, P.: Robust shape similarity retrieval based on contour segmentation polygonal multiresolution and elastic matching. Pattern Recognit. 38(12), 2229–2241 (2005)

    Google Scholar 

  6. Faloutsos, C., Ranganathan, M., Manolopoulos, Y.: Fast sub-sequence matching in time-series databases. In: Proceedings of the 1994 ACM SIGMOD International Conference on Management of Data, pp. 419–429 (1994)

  7. Agarwal, R., Faloutsos, C., Swami, A.: Efficient similarity search in sequence databases. 4th international conference of foundations of data organization and algorithms, pp. 69–84, Evanston, IL, October 1993

  8. Chan, K., Fu, A.: Efficient time series matching by wavelets. In: Proceedings of International Conference on Data Engineering, pp. 126–133, Sydney (1999)

  9. Keogh, E., Chakrabarti, K., Pazzani, M., Mehrota, S.: Locally adaptive dimensionality reduction for indexing large time series databases. In: Proceedings of ACM SIGMOD conference, pp. 151–162 (2001)

  10. Cai, Y., Ng, R.: Indexing spatio-temporal trajectories with Chebyshev polynomials, ACM SIGMOD/PODS conference, pp. 599–610, France, 13–18 June (2004)

  11. Mori, G., Belongie, S., Malik, J.: Efficient shape matching using shape contexts. IEEE Trans. Pattern Anal. Mach. Intell. 27(11), 1832–1837 (2005)

    Article  Google Scholar 

  12. Belongie, S., Malik, J., Puzicha, J.: Shape matching and object recognition using shape contexts. IEEE Trans. Pattern Anal. Mach. Intell. 24(24), 509–522 (2002)

    Article  Google Scholar 

  13. Belongie, S., Malik, J., Puzicha, J.: Matching shapes. In: Proceedings of Eighth IEEE International Conference on Computer Vision, vol. I, Vancouver, Canada, pp. 454–461, July (2001)

  14. Davies, E.R.: Machine vision: theory, algorithms, practicalities, pp. 171–191. Academic Press, New York (1997)

    Google Scholar 

  15. Manay, S., Cremers, D., Hong, B.-W., Yezi, A.J., Soatto, S.: Integral invariants for shape matching. IEEE Trans. Pattern Anal. Mach. Intell. 28(10), 1602–1618 (2006)

    Article  Google Scholar 

  16. Bruckstein, A.M., Holt, R.J., Netravali, A.N., Richardson, T.J.: Invariant signatures for planar shape recognition under partial occlusion. J. Comput. Vis. Gr. Image Process. 58(1), 49–65 (1993)

    Google Scholar 

  17. Boutin, M.: Numerically Invariant Signature Curves. J. Comput. Vis. 40(3), 235–248 (2000)

    Article  MATH  Google Scholar 

  18. Fu, A.W., Keogh, E., Lau, L.Y.H., Ratanamahatana, C.A.: Scaling and time warping in time series querying. VLDB 14(5), 742–753 (2005)

    Google Scholar 

  19. Chetverikov, D., Khenokh, Y.: Matching for shape defect detection. In: Davies, E.R. (ed.) Machine vision: theory, algorithms, lecture notes in computer science, vol. 1689, pp. 367–374. Springer, Berlin (1999)

  20. Berretti, S., Bimbo, A.D., Pala, P.: Retrieval by shape similarity with perceptual distance and ejective indexing. IEEE Trans. Multimed. 2(4), 225–239 (2000)

    Article  Google Scholar 

  21. Dudek, G., Tsotsos, J.K.: Shape representation and recognition from multiscale curvature. J. Comput. Vis. Image Underst. 68(2), 170–189 (1997)

    Article  Google Scholar 

  22. Li, D., Simske, S.: Shape retrieval based on distance ratio distribution, HP Tech Report HPL-2002-251, (2002)

  23. Cardone, A., Gupta, S.K., Karnik, M.: A survey of shape similarity assessment algorithms for product design and manufacturing applications. ASME J. Comput. Inform. Sci. Eng. 3(2), 109–118 (2003)

    Article  Google Scholar 

  24. Wang, Z., Chi, Z., Feng, D., Wang, Q.: Leaf image retrieval with shape features. In: Proceedings of the 4th International Conference on Advances in Visual Information Systems, pp. 477–487 (2000)

  25. Bhanu, B., Zhou, X.: Face recognition from face profile using dynamic time warping. In: Proceedings of International Conference on Pattern Recognition, pp. 499–502 (2004)

  26. Wang, X., Ye, L., Keogh, E., Shelton, C.: Annotating historical archives of images.In: 8th ACM/IEEE-CS Joint Conference on Digital libraries, pp. 341–350 (2008)

  27. Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)

    Article  Google Scholar 

  28. Tan, K.L., Ooi, B.C., Thiang, L.F.: Indexing shapes in image databases using the centroid-radii model. Data Knowl. Eng. 32, 271–289 (2000)

    Article  MATH  Google Scholar 

  29. Petrakis, E.G.M., Milios, E.: Efficient retrieval by shape content. Proc. ICMCS 2, 616–621 (1999)

    Google Scholar 

  30. Grauman, K., Darrell, T.: The pyramid match kernel: discriminative classification with sets of image features. In: Proceedings of ICCV (2005)

  31. Philbin, J., Chum, O., Isard, M., Sivic, J., Zisserman, A.: Object retrieval with large vocabularies and fast spatial matching. In: CVPR (2007)

  32. Sivic, J., Zisserman, A.: Video google: a text retrieval approach to object matching in videos. In: ICCV (2003)

  33. Keogh, E.J., Pazzani, M.J.: A simple dimensionality reduction technique for fast similarity search in large time series databases. Pacific-Asia conference on knowledge discovery and data mining, pp. 122–133 (2000)

  34. Vlachos, M., Vagena, Z., Yu, P.S., Athitsos, V.: Rotation invariant indexing of shapes and line drawings. In: Proceedings of ACM Conference on Information and Knowledge Management (CIKM), pp. 131–138 (2005)

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Shehzad Khalid.

Additional information

Communicated by Thomas Plagemann.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Khalid, S. Incremental indexing and retrieval mechanism for scalable and robust shape matching. Multimedia Systems 18, 319–336 (2012). https://doi.org/10.1007/s00530-011-0252-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00530-011-0252-y

Keywords

Navigation