Abstract
The computer vision and pattern recognition communities have recently witnessed a surge in feature-based methods for numerous applications including object recognition and image retrieval. Similar concepts and analogous approaches are penetrating the world of 3D shape analysis in a variety of areas including non-rigid shape retrieval and matching. In this chapter, we present both mature concepts and the state-of-the-art of feature-based approaches in 3D shape analysis. In particular, approaches to the detection of interest points and the generation of local shape descriptors are discussed. A wide range of methods is covered including those based on curvature, those based on difference-of-Gaussian scale space, and those that employ recent advances in heat kernel methods.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
In some literature, this is also known as interest point detection or keypoint detection.
References
Agarwal, P.K., Edelsbrunner, H., Harer, J., Wang, Y.: Extreme elevation on a 2-manifold. In: SCG’04: Proceedings of the twentieth annual symposium on Computational Geometry, pp. 357–365 (2004)
Andreetto, M., Brusco, N., Cortelazzo, G.M.: Automatic 3D modeling of textured cultural heritage objects. IEEE Trans. Image Process. 13(3), 335–369 (2004)
Assfalg, J., Bertini, M., Pala, P., Del Bimbo, A.: Content-based retrieval of 3d objects using spin image signatures. IEEE Trans. Multimed. 9(3), 589–599 (2007)
Bay, H., Tuytelaars, T., Van Gool, L.: SURF: speeded up robust features. In: Proc. ECCV, pp. 404–417 (2006)
Belongie, S., Malik, J., Puzicha, J.: Shape matching and object recognition using shape contexts. Trans. PAMI, 509–522 (2002)
Ben-Chen, M., Weber, O., Gotsman, C.: Characterizing shape using conformal factors. In: Proc. 3DOR (2008)
Berger, M.: A Panoramic View of Riemannian Geometry. Springer, Berlin (2003)
Besl, P.J.: Surfaces in Range Image Understanding. Springer, Berlin (1988)
Besl, P.J., Jain, R.C.: Invariant surface characteristics for 3d object recognition in range images. Comput. Vis. Graph. Image Process. 33(1), 33–80 (1986)
Bronstein, A., Bronstein, M., Bruckstein, A., Kimmel, R.: Partial similarity of objects, or how to compare a centaur to a horse. Int. J. Comput. Vis. 84(2), 163–183 (2009)
Bronstein, A., Bronstein, M., Guibas, L., Ovsjanikov, M.: Shape Google: geometric words and expressions for invariant shape retrieval. ACM Trans. Graph. 30(1) (2011)
Bronstein, A.M., Bronstein, M.M., Bustos, B., Castellani, U., Crisani, M., Falcidieno, B., Guibas, L.J., Isipiran, I., Kokkinos, I., Murino, V., Ovsjanikov, M., Patané, G., Spagnuolo, M., Sun, J.: Shrec 2010: robust feature detection and description benchmark. In: Proc. 3DOR (2010)
Bronstein, A.M., Bronstein, M.M., Castellani, U., Falcidieno, B., Fusiello, A., Godil, A., Guibas, L.J., Kokkinos, I., Lian, Z., Ovsjanikov, M., Patané, G., Spagnuolo, M., Toldo, R.: Shrec 2010: robust large-scale shape retrieval benchmark. In: Proc. 3DOR (2010)
Bronstein, A.M., Bronstein, M.M., Castellani, U., Guibas, A.D.L.J., Horaud, R.P., Kimmel, R., Knossow, D., von Lavante, E., Mateus, D., Ovsjanikov, M., Sharma, A.: Shrec 2010: robust correspondence benchmark. In: Proc. 3DOR (2010)
Bronstein, A.M., Bronstein, M.M., Kimmel, R.: Three-dimensional face recognition. Int. J. Comput. Vis. 64(1), 5–30 (2005)
Bronstein, A.M., Bronstein, M.M., Kimmel, R.: Numerical Geometry of Non-rigid Shapes. Springer, New York (2008)
Bronstein, A.M., Bronstein, M.M., Kimmel, R., Mahmoudi, M., Sapiro, G.: A Gromov-Hausdorff framework with diffusion geometry for topologically-robust non-rigid shape matching. In: IJCV (2010)
Bronstein, A.M., Bronstein, M.M., Mitra, N.J.: Intrinsic regularity detection in 3D geometry. In: Proc. ECCV (2010)
Bronstein, A.M., Bronstein, M.M., Ovsjanikov, M., Guibas, L.J.: Shape Google: a computer vision approach to invariant shape retrieval. In: Proc. NORDIA (2009)
Bronstein, M.M., Kokkinos, I.: Scale-invariant heat kernel signatures for non-rigid shape recognition. In: Proc. CVPR (2010)
Castellani, U., Cristani, M., Fantoni, S., Murino, V.: Sparse points matching by combining 3D mesh saliency with statistical descriptors. Comput. Graph. Forum 27, 643–652 (2008)
Chazal, F., Guibas, L., Oudot, S., Skraba, P.: Persistence-based clustering in Riemannian manifolds. In: Proceedings of the 27th annual ACM symposium on Computational Geometry (2009)
Chum, O., Philbin, J., Sivic, J., Isard, M., Zisserman, A.: Total recall: automatic query expansion with a generative feature model for object retrieval. In: Proc. ICCV (2007)
Clarenz, U., Rumpf, M., Telea, A.: Robust feature detection and local classification for surfaces based on moment analysis. IEEE Trans. Vis. Comput. Graph. 10(5), 516–524 (2004)
Coifman, R., Lafon, S.: Diffusion maps. Appl. Comput. Harmon. Anal. 21(1), 5–30 (2006)
Dey, T.K., Li, K., Luo, C., Ranjan, P., Safa, I., Wang, Y.: Persistent heat signature for Pose-oblivious matching of incomplete models. In: Proc. SGP, pp. 1545–1554 (2010)
Digne, J., Morel, J., Audfray, N., Mehdi-Souzani, C.: The level set tree on meshes. In: Fifth International Symposium on 3D Data Processing, Visualization and Transmission (3DPVT’10) (2010)
Do Carmo, M.: Differential Geometry of Curves and Surfaces, vol. 2. Prentice-Hall, Englewood Cliffs (1976)
Edelsbrunner, H., Harer, J.: Computational Topology. An Introduction. Am. Math. Soc., Providence (2010)
Edelsbrunner, H., Letscher, D., Zomorodian, A.: Topological persistence and simplification. Discrete Comput. Geom. 28(4), 511–533 (2002)
Elad, A., Kimmel, R.: On bending invariant signatures for surfaces. IEEE Trans. Pattern Anal. Mach. Intell. 25(10), 1285–1295 (2003)
Floater, M.S., Hormann, K.: Surface parameterization: a tutorial and survey. Adv. Multiresol. Geom. Model. 1 (2005)
Gebal, K., Bærentzen, J.A., Aanæs, H., Larsen, R.: Shape analysis using the auto diffusion function. Comput. Graph. Forum 28(5), 1405–1413 (2009)
Gelfand, N., Mitra, N.J., Guibas, L.J., Pottmann, H.: Robust global registration. In: Proc. SGP (2005)
Glomb, P.: Detection of interest points on 3D data: extending the Harris operator. In: Computer Recognition Systems 3. Advances in Soft Computing, vol. 57, pp. 103–111. Springer, Berlin (2009)
Harris, C., Stephens, M.: A combined corner and edge detection. In: Proc. Fourth Alvey Vision Conference, pp. 147–151 (1988)
Itti, L., Koch, C., Niebur, E.: A model of saliency-based visual attention for rapid scene analysis. Trans. PAMI 20(11) (1998)
Johnson, A., Spin-images: a representation for 3-d surface matching. Ph.D. thesis, Carnegie Mellon University (1997)
Johnson, A.E., Hebert, M.: Using spin images for efficient object recognition in cluttered 3D scenes. IEEE Trans. Pattern Anal. Mach. Intell. 21(5), 433–449 (1999)
Kazhdan, M., Funkhouser, T., Rusinkiewicz, S.: Symmetry descriptors and 3D shape matching. In: Proc. SGP, pp. 115–123 (2004)
Kim, V.G., Lipman, Y., Funkhouser, T.: Blended intrinsic maps. In: Proc. SIGGRAPH (2011)
Koehl, P.: Protein structure similarities. Curr. Opin. Struct. Biol. 11(3), 348–353 (2001)
Koenderink, J.J., van Doorn, A.J.: Surface shape and curvature scales. Image Vis. Comput. 10(8), 557–564 (1992)
Kokkinos, I., Yuille, A.: Scale invariance without scale selection. In: Proc. CVPR (2008)
Kolomenkin, M., Shimshoni, I., Tal, A.: On edge detection on surfaces. In: Proc. CVPR (2009)
Körtgen, M., Park, G., Novotni, M., Klein, R.: 3d shape matching with 3d shape contexts. In: Central European Seminar on Computer Graphics (2003)
Kovnatsky, A., Bronstein, M.M., Bronstein, A.M., Kimmel, R.: Photometric heat kernel signatures. In: Proc. Conf. on Scale Space and Variational Methods in Computer Vision (SSVM) (2011)
Lévy, B.: Laplace-Beltrami eigenfunctions towards an algorithm that “understands” geometry. In: Int. Conf. Shape Modeling and Applications (2006)
Litman, R., Bronstein, A.M., Bronstein, M.M.: Diffusion-geometric maximally stable component detection in deformable shapes. In: Computers and Graphics (2011)
Lo, T., Siebert, J.: Local feature extraction and matching on range images: 2.5 D SIFT. Comput. Vis. Image Underst. 113(12), 1235–1250 (2009)
Lowe, D.: Distinctive image features from scale-invariant keypoint. In: IJCV (2004)
Magid, E., Soldea, O., Rivlin, E.: A comparison of Gaussian and mean curvature estimation methods on triangular meshes of range image data. Comput. Vis. Image Underst. 107(3), 139–159 (2007)
Mahmoudi, M., Sapiro, G.: Three-dimensional point cloud recognition via distributions of geometric distances. Graph. Models 71(1), 22–31 (2009)
Manay, S., Hong, B., Yezzi, A., Soatto, S.: Integral invariant signatures. In: Computer Vision-ECCV 2004, pp. 87–99 (2004)
Matas, J., Chum, O., Urban, M., Pajdla, T.: Robust wide-baseline stereo from maximally stable extremal regions. Image Vis. Comput. 22(10), 761–767 (2004)
Mateus, D., Horaud, R.P., Knossow, D., Cuzzolin, F., Boyer, E.: Articulated shape matching using Laplacian eigenfunctions and unsupervised point registration. In: Proc. CVPR (2008)
Meyer, M., Desbrun, M., Schroder, P., Barr, A.H.: Discrete differential-geometry operators for triangulated 2-manifolds. In: Visualization and Mathematics III, pp. 35–57 (2003)
Mitra, N.J., Guibas, L.J., Giesen, J., Pauly, M.: Probabilistic fingerprints for shapes. In: Proc. SGP (2006)
Mitra, N.J., Guibas, L.J., Pauly, M.: Partial and approximate symmetry detection for 3D geometry. ACM Trans. Graph. 25(3), 560–568 (2006)
Najman, L., Couprie, M.: Building the component tree in quasi-linear time. IEEE Trans. Image Process. 15(11), 3531–3539 (2006)
Natarajan, V., Koehl, P., Wang, Y., Hamann, B.: Visual analysis of biomolecular surfaces. In: Visualization in Medicine and Life Sciences, Mathematics and Visualization, pp. 237–255 (2008)
Ovsjanikov, M., Sun, J., Guibas, L.J.: Global intrinsic symmetries of shapes. Comput. Graph. Forum 27(5), 1341–1348 (2008)
Pauly, M., Keiser, R., Gross, M.: Multi-scale feature extraction on point-sampled surfaces. Comput. Graph. Forum 22(3), 281–289 (2003)
Pauly, M., Mitra, N.J., Wallner, J., Pottmann, H., Guibas, L.J.: Discovering structural regularity in 3D geometry. In: Proc. SIGGRAPH (2008)
Pinkall, U., Polthier, K.: Computing discrete minimal surfaces and their conjugates. Exp. Math. 2(1), 15–36 (1993)
Raviv, D., Bronstein, A.M., Bronstein, M.M., Kimmel, R.: Symmetries of non-rigid shapes. In: Proc. NRTL (2007)
Raviv, D., Bronstein, A.M., Bronstein, M.M., Kimmel, R., Sapiro, G.: Diffusion symmetries of non-rigid shapes. In: Proc. 3DPVT (2010)
Raviv, D., Bronstein, M.M., Bronstein, A.M., Kimmel, R.: Volumetric heat kernel signatures. In: Proc. ACM Multimedia Workshop on 3D Object Retrieval (2010)
Reuter, M.: Hierarchical shape segmentation and registration via topological features of Laplace-Beltrami eigenfunctions. Int. J. Comput. Vis. 89(2), 287–308 (2010)
Reuter, M., Wolter, F.E., Peinecke, N.: Laplace-spectra as fingerprints for shape matching. In: Proc. ACM Symp. Solid and Physical Modeling, pp. 101–106 (2005)
Rustamov, R.M.: Laplace-Beltrami eigenfunctions for deformation invariant shape representation. In: Proc. SGP, pp. 225–233 (2007)
Scherzer, O.: Handbook of Mathematical Methods in Imaging. Springer, Berlin (2010)
Shilane, P., Funkhauser, T.: Selecting distinctive 3D shape descriptors for similarity retrieval. In: Proc. Shape Modelling and Applications (2006)
Sipiran, I., Bustos, B.: A robust 3D interest points detector based on Harris operator. In: Proc. 3DOR, pp. 7–14. Eurographics (2010)
Sivic, J., Zisserman, A.: Video Google: A text retrieval approach to object matching in videos. In: Proc. CVPR (2003)
Skraba, P., Ovsjanikov, M., Chazal, F., Guibas, L.: Persistence-based segmentation of deformable shapes. In: Proc. NORDIA, pp. 45–52 (2010)
Sochen, N., Kimmel, R., Malladi, R.: A general framework for low level vision. IEEE Trans. Image Process. 7(3), 310–318 (1998)
Starck, J., Hilton, A.: Correspondence labelling for widetimeframe free-form surface matching. In: Proc. ICCV (2007)
Strecha, C., Bronstein, A.M., Bronstein, M.M., Fua, P.: LDAHash: improved matching with smaller descriptors. Technical Report, EPFL (2010)
Sumner, R.W., Popović, J.: Deformation transfer for triangle meshes. In: Proc. Conf. Computer Graphics and Interactive Techniques, pp. 399–405 (2004)
Sun, J., Ovsjanikov, M., Guibas, L.: A concise and provably informative multi-scale signature based on heat diffusion. Comput. Graph. Forum 28(5), 1383–1392 (2009)
Thorstensen, N., Keriven, R.: Non-rigid shape matching using geometry and photometry. In: Proc. CVPR (2009)
Toldo, R., Castellani, U., Fusiello, A.: Visual vocabulary signature for 3D object retrieval and partial matching. In: Proc. 3DOR (2009)
Torresani, L., Kolmogorov, V., Rother, C.: Feature correspondence via graph matching: models and global optimization. In: Proc. ECCV, pp. 596–609 (2008)
Wang, C., Bronstein, M.M., Bronstein, A.M., Paragios, N.: Discrete minimum distortion correspondence problems for non-rigid shape matching. In: Proc. Conf. on Scale Space and Variational Methods in Computer Vision (SSVM) (2011)
Wardetzky, M., Mathur, S., Kälberer, F., Grinspun, E.: Discrete Laplace operators: no free lunch. In: Conf. Computer Graphics and Interactive Techniques (2008)
Zaharescu, A., Boyer, E., Varanasi, K., Horaud, R.: Surface feature detection and description with applications to mesh matching. In: Proc. CVPR (2009)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag London
About this chapter
Cite this chapter
Bronstein, A.M., Bronstein, M.M., Ovsjanikov, M. (2012). Feature-Based Methods in 3D Shape Analysis. In: Pears, N., Liu, Y., Bunting, P. (eds) 3D Imaging, Analysis and Applications. Springer, London. https://doi.org/10.1007/978-1-4471-4063-4_5
Download citation
DOI: https://doi.org/10.1007/978-1-4471-4063-4_5
Publisher Name: Springer, London
Print ISBN: 978-1-4471-4062-7
Online ISBN: 978-1-4471-4063-4
eBook Packages: Computer ScienceComputer Science (R0)