Abstract
In recent years we have seen a tremendous growth in the amount of freely available 3D content, in part due to breakthroughs for 3D model design and acquisition. For example, advances in range sensor technology and design software have dramatically reduced the manual labor required to construct 3D models. As collections of 3D content continue to grow rapidly, the ability to perform fast and accurate retrieval from a database of models has become a necessity.
At the core of this retrieval task is the fundamental challenge of defining and evaluating similarity between 3D shapes. Some effective methods dealing with this challenge consider similarity measures based on the visual appearance of models. While collections of rendered images are discriminative for retrieval tasks, such representations come with a few inherent limitations such as restrictions in the image viewpoint sampling and high computational costs. In this paper we present a novel algorithm for model similarity that addresses these issues. Our proposed method exploits techniques from spherical signal processing to efficiently evaluate a visual similarity measure between models. Extensive evaluations on multiple datasets are provided.
Similar content being viewed by others
References
AIM@SHAPE (2006). http://give-lab.cs.uu.nl/shrec/shrec2006/.
Ankerst, M., Kastenmüller, G., Kriegel, H. P., & Seidl, T. (1999). Nearest neighbor classification in 3D protein databases. In Proceedings of the seventh international conference on intelligent systems for molecular biology (pp. 34–43). Menlo Park: AAAI Press.
Arfken, G., & Weber, H. (1966). Mathematical methods for physicists. San Diego: Academic Press.
Belongie, S., Malik, J., & Puzicha, J. (2002). Shape matching and object recognition using shape contexts. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(4), 509–522.
Burel, G., & Henoco, H. (1995). Determination of the orientation of 3D objects using spherical harmonics. Graphical Models and Image Processing, 57(5), 400–408.
Chen, D.-Y., Tian, X.-P., & Ouhyoung, Y. T. S. M. (2003). On visual similarity based 3D model retrieval. In Eurographics.
Driscoll, J., & Healy, D. (1994). Computing Fourier transforms and convolutions on the 2-sphere. Advances in Applied Mathematics, 15, 202–250.
Frome, A., Huber, D., Kolluri, R., Bulow, T., & Malik, J. (2004). Recognizing objects in range data using regional point descriptors. In Proceedings of the European conference on computer vision (ECCV).
Funkhouser, T., Min, P., Kazhdan, M., Chen, J., Halderman, A., Dobkin, D., & Jacobs, D. (2003). A search engine for 3D models. ACM Transactions on Graphics, 22(1), 83–105.
Horn, B. K. P. (1984). Extended gaussian images. IEEE, 72, 1671–1686.
Johnson, A. (1997). Spin-images: A representation for 3-D surface matching. Ph.D. thesis, Robotics Institute, Carnegie Mellon University, Pittsburgh.
Johnson, A. E., & Hebert, M. (1999). Using spin images for efficient object recognition in cluttered 3D scenes. IEEE Transactions on Pattern Analysis and Machine Intelligence, 21(5), 433–449.
Kang, S. B., & Ikeuchi, K. (1991). Determining 3-D object pose using the complex extended gaussian image. In Proceedings of the 1991 IEEE computer society conference on computer vision and pattern recognition (CVPR ’91).
Kazhdan, M. (2007). An approximate and efficient method for optimal rotation alignment of 3D models. IEEE Transactions on Pattern Analysis and Machine Intelligence, 29(7), 1221–1229.
Kazhdan, M., Funkhouser, T., & Rusinkiewicz, S. (2003). Rotation invariant spherical harmonic representation of 3D shape descriptors. In Symposium on geometry processing.
Kortgen, M., Park, G. J., Novotni, M., & Klein, R. (2003). 3D shape matching with 3D shape contexts. In The 7th Central European seminar on computer graphics.
Kostelec, P. J., & Rockmore, D. N. (2003). FFTs on the rotation group. In Working paper series, Santa Fe Institute.
Kovacs, J. A., & Wriggers, W. (2002). Fast rotational matching. Biological Crystallography, 58, 1282–1286.
Lowe, D. G. (1999). Object recognition from local scale-invariant features. In ICCV ’99: proceedings of the international conference on computer vision (Vol. 2, p. 1150). Washington: IEEE Computer Society.
Makadia, A., & Daniilidis, K. (2003). Direct 3D-rotation estimation from spherical images via a generalized shift theorem. In IEEE conference on computer vision and pattern recognition. Wisconsin, June 16–22.
Makadia, A., & Daniilidis, K. (2006). Rotation recovery from spherical images without correspondences. IEEE Transactions on Pattern Analysis and Machine Intelligence, 28(7), 1170–1175.
Makadia, A., Sorgi, L., & Daniilidis, K. (2004). Rotation estimation from spherical images. In ICPR ’04: proceedings of the pattern recognition, 17th international conference on (ICPR’04) (Vol. 3, pp. 590–593). Washington: IEEE Computer Society.
Makadia, A., Visontai, M., & Daniilidis, K. (2007). Harmonic silhouette matching for 3D models. In 3DTV. Kos.
Novotni, M., & Klein, R. (2003). 3D Zernike descriptors for content based shape retrieval. In SM ’03: Proceedings of the eighth ACM symposium on solid modeling and applications (pp. 216–225). New York: ACM.
Ohbuchi, R., Minamitani, T., & Takei, T. (2003). Shape-similarity search of 3D models by using enhanced shape functions. In TPCG ’03: Proceedings of the theory and practice of computer graphics (p. 97). Washington: IEEE Computer Society.
Ohbuchi, R., Osada, K., Furuya, T., & Banno, T. (2008). Salient local visual features for shape-based 3D model retrieval. In IEEE international conference on shape modeling & applications.
Osada, R., Funkhouser, T., Chazelle, B., & Dobkin, D. (2001). Matching 3D models with shape distributions. In SMI ’01: proceedings of the international conference on shape modeling & applications (pp. 154–166). Washington: IEEE Computer Society.
Saupe, D., & Vranic, D. V. (2001). 3D model retrieval with spherical harmonics and moments. In Proceedings of the 23rd DAGM-symposium on pattern recognition (pp. 392–397). London: Springer.
Shilane, P., Min, P., Kazhdan, M., & Funkhouser, T. (2004). The Princeton shape benchmark. In Shape modeling international. Genova, Italy.
Tangelder, J. W., & Veltkamp, R. C. (2008). A survey of content based 3d shape retrieval methods. Multimedia Tools Application, 39(3), 441–471.
Thurston, W. P. (1997). Three-dimensional geometry and topology. Princeton: Princeton University Press.
Typke, R., Veltkamp, R. C., & Wiering, F. (2006). Evaluating retrieval techniques based on partially ordered ground truth lists. In Proceedings international conference on multimedia & expo.
Veltkamp, R. C., Ruijsenaars, R., Spagnuolo, M., van Zwol, R., & ter Haar, F. (2006). Shrec2006 3d shape retrieval contest. Technical report, Utrecht University.
Vranic, D. V. (2003). An improvement of rotation invariant 3D shape descriptor based on functions on concentric spheres. In Proceedings of international conference on image processing (pp. 757–760).
Zhang, D. S., & Lu, G. (2002). An integrated approach to shape based image retrieval. In Proc. of 5th Asian conference on computer vision (ACCV) (pp. 652–657). Melbourne.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Makadia, A., Daniilidis, K. Spherical Correlation of Visual Representations for 3D Model Retrieval. Int J Comput Vis 89, 193–210 (2010). https://doi.org/10.1007/s11263-009-0280-7
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11263-009-0280-7