Skip to main content

Feature-Based Methods in 3D Shape Analysis

  • Chapter
3D Imaging, Analysis and Applications

Abstract

The computer vision and pattern recognition communities have recently witnessed a surge in feature-based methods for numerous applications including object recognition and image retrieval. Similar concepts and analogous approaches are penetrating the world of 3D shape analysis in a variety of areas including non-rigid shape retrieval and matching. In this chapter, we present both mature concepts and the state-of-the-art of feature-based approaches in 3D shape analysis. In particular, approaches to the detection of interest points and the generation of local shape descriptors are discussed. A wide range of methods is covered including those based on curvature, those based on difference-of-Gaussian scale space, and those that employ recent advances in heat kernel methods.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 69.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 89.95
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    In some literature, this is also known as interest point detection or keypoint detection.

References

  1. Agarwal, P.K., Edelsbrunner, H., Harer, J., Wang, Y.: Extreme elevation on a 2-manifold. In: SCG’04: Proceedings of the twentieth annual symposium on Computational Geometry, pp. 357–365 (2004)

    Chapter  Google Scholar 

  2. Andreetto, M., Brusco, N., Cortelazzo, G.M.: Automatic 3D modeling of textured cultural heritage objects. IEEE Trans. Image Process. 13(3), 335–369 (2004)

    Article  Google Scholar 

  3. Assfalg, J., Bertini, M., Pala, P., Del Bimbo, A.: Content-based retrieval of 3d objects using spin image signatures. IEEE Trans. Multimed. 9(3), 589–599 (2007)

    Article  Google Scholar 

  4. Bay, H., Tuytelaars, T., Van Gool, L.: SURF: speeded up robust features. In: Proc. ECCV, pp. 404–417 (2006)

    Google Scholar 

  5. Belongie, S., Malik, J., Puzicha, J.: Shape matching and object recognition using shape contexts. Trans. PAMI, 509–522 (2002)

    Google Scholar 

  6. Ben-Chen, M., Weber, O., Gotsman, C.: Characterizing shape using conformal factors. In: Proc. 3DOR (2008)

    Google Scholar 

  7. Berger, M.: A Panoramic View of Riemannian Geometry. Springer, Berlin (2003)

    Book  MATH  Google Scholar 

  8. Besl, P.J.: Surfaces in Range Image Understanding. Springer, Berlin (1988)

    Book  MATH  Google Scholar 

  9. Besl, P.J., Jain, R.C.: Invariant surface characteristics for 3d object recognition in range images. Comput. Vis. Graph. Image Process. 33(1), 33–80 (1986)

    Article  MATH  Google Scholar 

  10. Bronstein, A., Bronstein, M., Bruckstein, A., Kimmel, R.: Partial similarity of objects, or how to compare a centaur to a horse. Int. J. Comput. Vis. 84(2), 163–183 (2009)

    Article  Google Scholar 

  11. Bronstein, A., Bronstein, M., Guibas, L., Ovsjanikov, M.: Shape Google: geometric words and expressions for invariant shape retrieval. ACM Trans. Graph. 30(1) (2011)

    Google Scholar 

  12. Bronstein, A.M., Bronstein, M.M., Bustos, B., Castellani, U., Crisani, M., Falcidieno, B., Guibas, L.J., Isipiran, I., Kokkinos, I., Murino, V., Ovsjanikov, M., Patané, G., Spagnuolo, M., Sun, J.: Shrec 2010: robust feature detection and description benchmark. In: Proc. 3DOR (2010)

    Google Scholar 

  13. Bronstein, A.M., Bronstein, M.M., Castellani, U., Falcidieno, B., Fusiello, A., Godil, A., Guibas, L.J., Kokkinos, I., Lian, Z., Ovsjanikov, M., Patané, G., Spagnuolo, M., Toldo, R.: Shrec 2010: robust large-scale shape retrieval benchmark. In: Proc. 3DOR (2010)

    Google Scholar 

  14. Bronstein, A.M., Bronstein, M.M., Castellani, U., Guibas, A.D.L.J., Horaud, R.P., Kimmel, R., Knossow, D., von Lavante, E., Mateus, D., Ovsjanikov, M., Sharma, A.: Shrec 2010: robust correspondence benchmark. In: Proc. 3DOR (2010)

    Google Scholar 

  15. Bronstein, A.M., Bronstein, M.M., Kimmel, R.: Three-dimensional face recognition. Int. J. Comput. Vis. 64(1), 5–30 (2005)

    Article  Google Scholar 

  16. Bronstein, A.M., Bronstein, M.M., Kimmel, R.: Numerical Geometry of Non-rigid Shapes. Springer, New York (2008)

    MATH  Google Scholar 

  17. Bronstein, A.M., Bronstein, M.M., Kimmel, R., Mahmoudi, M., Sapiro, G.: A Gromov-Hausdorff framework with diffusion geometry for topologically-robust non-rigid shape matching. In: IJCV (2010)

    Google Scholar 

  18. Bronstein, A.M., Bronstein, M.M., Mitra, N.J.: Intrinsic regularity detection in 3D geometry. In: Proc. ECCV (2010)

    Google Scholar 

  19. Bronstein, A.M., Bronstein, M.M., Ovsjanikov, M., Guibas, L.J.: Shape Google: a computer vision approach to invariant shape retrieval. In: Proc. NORDIA (2009)

    Google Scholar 

  20. Bronstein, M.M., Kokkinos, I.: Scale-invariant heat kernel signatures for non-rigid shape recognition. In: Proc. CVPR (2010)

    Google Scholar 

  21. Castellani, U., Cristani, M., Fantoni, S., Murino, V.: Sparse points matching by combining 3D mesh saliency with statistical descriptors. Comput. Graph. Forum 27, 643–652 (2008)

    Article  Google Scholar 

  22. Chazal, F., Guibas, L., Oudot, S., Skraba, P.: Persistence-based clustering in Riemannian manifolds. In: Proceedings of the 27th annual ACM symposium on Computational Geometry (2009)

    Google Scholar 

  23. Chum, O., Philbin, J., Sivic, J., Isard, M., Zisserman, A.: Total recall: automatic query expansion with a generative feature model for object retrieval. In: Proc. ICCV (2007)

    Google Scholar 

  24. Clarenz, U., Rumpf, M., Telea, A.: Robust feature detection and local classification for surfaces based on moment analysis. IEEE Trans. Vis. Comput. Graph. 10(5), 516–524 (2004)

    Article  Google Scholar 

  25. Coifman, R., Lafon, S.: Diffusion maps. Appl. Comput. Harmon. Anal. 21(1), 5–30 (2006)

    Article  MathSciNet  MATH  Google Scholar 

  26. Dey, T.K., Li, K., Luo, C., Ranjan, P., Safa, I., Wang, Y.: Persistent heat signature for Pose-oblivious matching of incomplete models. In: Proc. SGP, pp. 1545–1554 (2010)

    Google Scholar 

  27. Digne, J., Morel, J., Audfray, N., Mehdi-Souzani, C.: The level set tree on meshes. In: Fifth International Symposium on 3D Data Processing, Visualization and Transmission (3DPVT’10) (2010)

    Google Scholar 

  28. Do Carmo, M.: Differential Geometry of Curves and Surfaces, vol. 2. Prentice-Hall, Englewood Cliffs (1976)

    MATH  Google Scholar 

  29. Edelsbrunner, H., Harer, J.: Computational Topology. An Introduction. Am. Math. Soc., Providence (2010)

    MATH  Google Scholar 

  30. Edelsbrunner, H., Letscher, D., Zomorodian, A.: Topological persistence and simplification. Discrete Comput. Geom. 28(4), 511–533 (2002)

    Article  MathSciNet  MATH  Google Scholar 

  31. Elad, A., Kimmel, R.: On bending invariant signatures for surfaces. IEEE Trans. Pattern Anal. Mach. Intell. 25(10), 1285–1295 (2003)

    Article  Google Scholar 

  32. Floater, M.S., Hormann, K.: Surface parameterization: a tutorial and survey. Adv. Multiresol. Geom. Model. 1 (2005)

    Google Scholar 

  33. Gebal, K., Bærentzen, J.A., Aanæs, H., Larsen, R.: Shape analysis using the auto diffusion function. Comput. Graph. Forum 28(5), 1405–1413 (2009)

    Article  Google Scholar 

  34. Gelfand, N., Mitra, N.J., Guibas, L.J., Pottmann, H.: Robust global registration. In: Proc. SGP (2005)

    Google Scholar 

  35. Glomb, P.: Detection of interest points on 3D data: extending the Harris operator. In: Computer Recognition Systems 3. Advances in Soft Computing, vol. 57, pp. 103–111. Springer, Berlin (2009)

    Chapter  Google Scholar 

  36. Harris, C., Stephens, M.: A combined corner and edge detection. In: Proc. Fourth Alvey Vision Conference, pp. 147–151 (1988)

    Google Scholar 

  37. Itti, L., Koch, C., Niebur, E.: A model of saliency-based visual attention for rapid scene analysis. Trans. PAMI 20(11) (1998)

    Google Scholar 

  38. Johnson, A., Spin-images: a representation for 3-d surface matching. Ph.D. thesis, Carnegie Mellon University (1997)

    Google Scholar 

  39. Johnson, A.E., Hebert, M.: Using spin images for efficient object recognition in cluttered 3D scenes. IEEE Trans. Pattern Anal. Mach. Intell. 21(5), 433–449 (1999)

    Article  Google Scholar 

  40. Kazhdan, M., Funkhouser, T., Rusinkiewicz, S.: Symmetry descriptors and 3D shape matching. In: Proc. SGP, pp. 115–123 (2004)

    Chapter  Google Scholar 

  41. Kim, V.G., Lipman, Y., Funkhouser, T.: Blended intrinsic maps. In: Proc. SIGGRAPH (2011)

    Google Scholar 

  42. Koehl, P.: Protein structure similarities. Curr. Opin. Struct. Biol. 11(3), 348–353 (2001)

    Article  Google Scholar 

  43. Koenderink, J.J., van Doorn, A.J.: Surface shape and curvature scales. Image Vis. Comput. 10(8), 557–564 (1992)

    Article  Google Scholar 

  44. Kokkinos, I., Yuille, A.: Scale invariance without scale selection. In: Proc. CVPR (2008)

    Google Scholar 

  45. Kolomenkin, M., Shimshoni, I., Tal, A.: On edge detection on surfaces. In: Proc. CVPR (2009)

    Google Scholar 

  46. Körtgen, M., Park, G., Novotni, M., Klein, R.: 3d shape matching with 3d shape contexts. In: Central European Seminar on Computer Graphics (2003)

    Google Scholar 

  47. Kovnatsky, A., Bronstein, M.M., Bronstein, A.M., Kimmel, R.: Photometric heat kernel signatures. In: Proc. Conf. on Scale Space and Variational Methods in Computer Vision (SSVM) (2011)

    Google Scholar 

  48. Lévy, B.: Laplace-Beltrami eigenfunctions towards an algorithm that “understands” geometry. In: Int. Conf. Shape Modeling and Applications (2006)

    Google Scholar 

  49. Litman, R., Bronstein, A.M., Bronstein, M.M.: Diffusion-geometric maximally stable component detection in deformable shapes. In: Computers and Graphics (2011)

    Google Scholar 

  50. Lo, T., Siebert, J.: Local feature extraction and matching on range images: 2.5 D SIFT. Comput. Vis. Image Underst. 113(12), 1235–1250 (2009)

    Article  Google Scholar 

  51. Lowe, D.: Distinctive image features from scale-invariant keypoint. In: IJCV (2004)

    Google Scholar 

  52. Magid, E., Soldea, O., Rivlin, E.: A comparison of Gaussian and mean curvature estimation methods on triangular meshes of range image data. Comput. Vis. Image Underst. 107(3), 139–159 (2007)

    Article  Google Scholar 

  53. Mahmoudi, M., Sapiro, G.: Three-dimensional point cloud recognition via distributions of geometric distances. Graph. Models 71(1), 22–31 (2009)

    Article  Google Scholar 

  54. Manay, S., Hong, B., Yezzi, A., Soatto, S.: Integral invariant signatures. In: Computer Vision-ECCV 2004, pp. 87–99 (2004)

    Chapter  Google Scholar 

  55. Matas, J., Chum, O., Urban, M., Pajdla, T.: Robust wide-baseline stereo from maximally stable extremal regions. Image Vis. Comput. 22(10), 761–767 (2004)

    Article  Google Scholar 

  56. Mateus, D., Horaud, R.P., Knossow, D., Cuzzolin, F., Boyer, E.: Articulated shape matching using Laplacian eigenfunctions and unsupervised point registration. In: Proc. CVPR (2008)

    Google Scholar 

  57. Meyer, M., Desbrun, M., Schroder, P., Barr, A.H.: Discrete differential-geometry operators for triangulated 2-manifolds. In: Visualization and Mathematics III, pp. 35–57 (2003)

    Google Scholar 

  58. Mitra, N.J., Guibas, L.J., Giesen, J., Pauly, M.: Probabilistic fingerprints for shapes. In: Proc. SGP (2006)

    Google Scholar 

  59. Mitra, N.J., Guibas, L.J., Pauly, M.: Partial and approximate symmetry detection for 3D geometry. ACM Trans. Graph. 25(3), 560–568 (2006)

    Article  Google Scholar 

  60. Najman, L., Couprie, M.: Building the component tree in quasi-linear time. IEEE Trans. Image Process. 15(11), 3531–3539 (2006)

    Article  Google Scholar 

  61. Natarajan, V., Koehl, P., Wang, Y., Hamann, B.: Visual analysis of biomolecular surfaces. In: Visualization in Medicine and Life Sciences, Mathematics and Visualization, pp. 237–255 (2008)

    Chapter  Google Scholar 

  62. Ovsjanikov, M., Sun, J., Guibas, L.J.: Global intrinsic symmetries of shapes. Comput. Graph. Forum 27(5), 1341–1348 (2008)

    Article  Google Scholar 

  63. Pauly, M., Keiser, R., Gross, M.: Multi-scale feature extraction on point-sampled surfaces. Comput. Graph. Forum 22(3), 281–289 (2003)

    Article  Google Scholar 

  64. Pauly, M., Mitra, N.J., Wallner, J., Pottmann, H., Guibas, L.J.: Discovering structural regularity in 3D geometry. In: Proc. SIGGRAPH (2008)

    Google Scholar 

  65. Pinkall, U., Polthier, K.: Computing discrete minimal surfaces and their conjugates. Exp. Math. 2(1), 15–36 (1993)

    Article  MathSciNet  MATH  Google Scholar 

  66. Raviv, D., Bronstein, A.M., Bronstein, M.M., Kimmel, R.: Symmetries of non-rigid shapes. In: Proc. NRTL (2007)

    Google Scholar 

  67. Raviv, D., Bronstein, A.M., Bronstein, M.M., Kimmel, R., Sapiro, G.: Diffusion symmetries of non-rigid shapes. In: Proc. 3DPVT (2010)

    Google Scholar 

  68. Raviv, D., Bronstein, M.M., Bronstein, A.M., Kimmel, R.: Volumetric heat kernel signatures. In: Proc. ACM Multimedia Workshop on 3D Object Retrieval (2010)

    Google Scholar 

  69. Reuter, M.: Hierarchical shape segmentation and registration via topological features of Laplace-Beltrami eigenfunctions. Int. J. Comput. Vis. 89(2), 287–308 (2010)

    Article  Google Scholar 

  70. Reuter, M., Wolter, F.E., Peinecke, N.: Laplace-spectra as fingerprints for shape matching. In: Proc. ACM Symp. Solid and Physical Modeling, pp. 101–106 (2005)

    Chapter  Google Scholar 

  71. Rustamov, R.M.: Laplace-Beltrami eigenfunctions for deformation invariant shape representation. In: Proc. SGP, pp. 225–233 (2007)

    Google Scholar 

  72. Scherzer, O.: Handbook of Mathematical Methods in Imaging. Springer, Berlin (2010)

    Google Scholar 

  73. Shilane, P., Funkhauser, T.: Selecting distinctive 3D shape descriptors for similarity retrieval. In: Proc. Shape Modelling and Applications (2006)

    Google Scholar 

  74. Sipiran, I., Bustos, B.: A robust 3D interest points detector based on Harris operator. In: Proc. 3DOR, pp. 7–14. Eurographics (2010)

    Google Scholar 

  75. Sivic, J., Zisserman, A.: Video Google: A text retrieval approach to object matching in videos. In: Proc. CVPR (2003)

    Google Scholar 

  76. Skraba, P., Ovsjanikov, M., Chazal, F., Guibas, L.: Persistence-based segmentation of deformable shapes. In: Proc. NORDIA, pp. 45–52 (2010)

    Google Scholar 

  77. Sochen, N., Kimmel, R., Malladi, R.: A general framework for low level vision. IEEE Trans. Image Process. 7(3), 310–318 (1998)

    Article  MathSciNet  MATH  Google Scholar 

  78. Starck, J., Hilton, A.: Correspondence labelling for widetimeframe free-form surface matching. In: Proc. ICCV (2007)

    Google Scholar 

  79. Strecha, C., Bronstein, A.M., Bronstein, M.M., Fua, P.: LDAHash: improved matching with smaller descriptors. Technical Report, EPFL (2010)

    Google Scholar 

  80. Sumner, R.W., Popović, J.: Deformation transfer for triangle meshes. In: Proc. Conf. Computer Graphics and Interactive Techniques, pp. 399–405 (2004)

    Google Scholar 

  81. Sun, J., Ovsjanikov, M., Guibas, L.: A concise and provably informative multi-scale signature based on heat diffusion. Comput. Graph. Forum 28(5), 1383–1392 (2009)

    Article  Google Scholar 

  82. Thorstensen, N., Keriven, R.: Non-rigid shape matching using geometry and photometry. In: Proc. CVPR (2009)

    Google Scholar 

  83. Toldo, R., Castellani, U., Fusiello, A.: Visual vocabulary signature for 3D object retrieval and partial matching. In: Proc. 3DOR (2009)

    Google Scholar 

  84. Torresani, L., Kolmogorov, V., Rother, C.: Feature correspondence via graph matching: models and global optimization. In: Proc. ECCV, pp. 596–609 (2008)

    Google Scholar 

  85. Wang, C., Bronstein, M.M., Bronstein, A.M., Paragios, N.: Discrete minimum distortion correspondence problems for non-rigid shape matching. In: Proc. Conf. on Scale Space and Variational Methods in Computer Vision (SSVM) (2011)

    Google Scholar 

  86. Wardetzky, M., Mathur, S., Kälberer, F., Grinspun, E.: Discrete Laplace operators: no free lunch. In: Conf. Computer Graphics and Interactive Techniques (2008)

    Google Scholar 

  87. Zaharescu, A., Boyer, E., Varanasi, K., Horaud, R.: Surface feature detection and description with applications to mesh matching. In: Proc. CVPR (2009)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Alexander M. Bronstein .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer-Verlag London

About this chapter

Cite this chapter

Bronstein, A.M., Bronstein, M.M., Ovsjanikov, M. (2012). Feature-Based Methods in 3D Shape Analysis. In: Pears, N., Liu, Y., Bunting, P. (eds) 3D Imaging, Analysis and Applications. Springer, London. https://doi.org/10.1007/978-1-4471-4063-4_5

Download citation

  • DOI: https://doi.org/10.1007/978-1-4471-4063-4_5

  • Publisher Name: Springer, London

  • Print ISBN: 978-1-4471-4062-7

  • Online ISBN: 978-1-4471-4063-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics