Skip to main content
Log in

Spherical Correlation of Visual Representations for 3D Model Retrieval

  • Published:
International Journal of Computer Vision Aims and scope Submit manuscript

Abstract

In recent years we have seen a tremendous growth in the amount of freely available 3D content, in part due to breakthroughs for 3D model design and acquisition. For example, advances in range sensor technology and design software have dramatically reduced the manual labor required to construct 3D models. As collections of 3D content continue to grow rapidly, the ability to perform fast and accurate retrieval from a database of models has become a necessity.

At the core of this retrieval task is the fundamental challenge of defining and evaluating similarity between 3D shapes. Some effective methods dealing with this challenge consider similarity measures based on the visual appearance of models. While collections of rendered images are discriminative for retrieval tasks, such representations come with a few inherent limitations such as restrictions in the image viewpoint sampling and high computational costs. In this paper we present a novel algorithm for model similarity that addresses these issues. Our proposed method exploits techniques from spherical signal processing to efficiently evaluate a visual similarity measure between models. Extensive evaluations on multiple datasets are provided.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • AIM@SHAPE (2006). http://give-lab.cs.uu.nl/shrec/shrec2006/.

  • Ankerst, M., Kastenmüller, G., Kriegel, H. P., & Seidl, T. (1999). Nearest neighbor classification in 3D protein databases. In Proceedings of the seventh international conference on intelligent systems for molecular biology (pp. 34–43). Menlo Park: AAAI Press.

    Google Scholar 

  • Arfken, G., & Weber, H. (1966). Mathematical methods for physicists. San Diego: Academic Press.

    MATH  Google Scholar 

  • Belongie, S., Malik, J., & Puzicha, J. (2002). Shape matching and object recognition using shape contexts. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(4), 509–522.

    Article  Google Scholar 

  • Burel, G., & Henoco, H. (1995). Determination of the orientation of 3D objects using spherical harmonics. Graphical Models and Image Processing, 57(5), 400–408.

    Article  Google Scholar 

  • Chen, D.-Y., Tian, X.-P., & Ouhyoung, Y. T. S. M. (2003). On visual similarity based 3D model retrieval. In Eurographics.

  • Driscoll, J., & Healy, D. (1994). Computing Fourier transforms and convolutions on the 2-sphere. Advances in Applied Mathematics, 15, 202–250.

    Article  MATH  MathSciNet  Google Scholar 

  • Frome, A., Huber, D., Kolluri, R., Bulow, T., & Malik, J. (2004). Recognizing objects in range data using regional point descriptors. In Proceedings of the European conference on computer vision (ECCV).

  • Funkhouser, T., Min, P., Kazhdan, M., Chen, J., Halderman, A., Dobkin, D., & Jacobs, D. (2003). A search engine for 3D models. ACM Transactions on Graphics, 22(1), 83–105.

    Article  Google Scholar 

  • Horn, B. K. P. (1984). Extended gaussian images. IEEE, 72, 1671–1686.

    Article  Google Scholar 

  • Johnson, A. (1997). Spin-images: A representation for 3-D surface matching. Ph.D. thesis, Robotics Institute, Carnegie Mellon University, Pittsburgh.

  • Johnson, A. E., & Hebert, M. (1999). Using spin images for efficient object recognition in cluttered 3D scenes. IEEE Transactions on Pattern Analysis and Machine Intelligence, 21(5), 433–449.

    Article  Google Scholar 

  • Kang, S. B., & Ikeuchi, K. (1991). Determining 3-D object pose using the complex extended gaussian image. In Proceedings of the 1991 IEEE computer society conference on computer vision and pattern recognition (CVPR ’91).

  • Kazhdan, M. (2007). An approximate and efficient method for optimal rotation alignment of 3D models. IEEE Transactions on Pattern Analysis and Machine Intelligence, 29(7), 1221–1229.

    Article  Google Scholar 

  • Kazhdan, M., Funkhouser, T., & Rusinkiewicz, S. (2003). Rotation invariant spherical harmonic representation of 3D shape descriptors. In Symposium on geometry processing.

  • Kortgen, M., Park, G. J., Novotni, M., & Klein, R. (2003). 3D shape matching with 3D shape contexts. In The 7th Central European seminar on computer graphics.

  • Kostelec, P. J., & Rockmore, D. N. (2003). FFTs on the rotation group. In Working paper series, Santa Fe Institute.

  • Kovacs, J. A., & Wriggers, W. (2002). Fast rotational matching. Biological Crystallography, 58, 1282–1286.

    Article  Google Scholar 

  • Lowe, D. G. (1999). Object recognition from local scale-invariant features. In ICCV ’99: proceedings of the international conference on computer vision (Vol. 2, p. 1150). Washington: IEEE Computer Society.

    Google Scholar 

  • Makadia, A., & Daniilidis, K. (2003). Direct 3D-rotation estimation from spherical images via a generalized shift theorem. In IEEE conference on computer vision and pattern recognition. Wisconsin, June 16–22.

  • Makadia, A., & Daniilidis, K. (2006). Rotation recovery from spherical images without correspondences. IEEE Transactions on Pattern Analysis and Machine Intelligence, 28(7), 1170–1175.

    Article  Google Scholar 

  • Makadia, A., Sorgi, L., & Daniilidis, K. (2004). Rotation estimation from spherical images. In ICPR ’04: proceedings of the pattern recognition, 17th international conference on (ICPR’04) (Vol. 3, pp. 590–593). Washington: IEEE Computer Society.

    Chapter  Google Scholar 

  • Makadia, A., Visontai, M., & Daniilidis, K. (2007). Harmonic silhouette matching for 3D models. In 3DTV. Kos.

  • Novotni, M., & Klein, R. (2003). 3D Zernike descriptors for content based shape retrieval. In SM ’03: Proceedings of the eighth ACM symposium on solid modeling and applications (pp. 216–225). New York: ACM.

    Chapter  Google Scholar 

  • Ohbuchi, R., Minamitani, T., & Takei, T. (2003). Shape-similarity search of 3D models by using enhanced shape functions. In TPCG ’03: Proceedings of the theory and practice of computer graphics (p. 97). Washington: IEEE Computer Society.

    Chapter  Google Scholar 

  • Ohbuchi, R., Osada, K., Furuya, T., & Banno, T. (2008). Salient local visual features for shape-based 3D model retrieval. In IEEE international conference on shape modeling & applications.

  • Osada, R., Funkhouser, T., Chazelle, B., & Dobkin, D. (2001). Matching 3D models with shape distributions. In SMI ’01: proceedings of the international conference on shape modeling & applications (pp. 154–166). Washington: IEEE Computer Society.

    Chapter  Google Scholar 

  • Saupe, D., & Vranic, D. V. (2001). 3D model retrieval with spherical harmonics and moments. In Proceedings of the 23rd DAGM-symposium on pattern recognition (pp. 392–397). London: Springer.

    Google Scholar 

  • Shilane, P., Min, P., Kazhdan, M., & Funkhouser, T. (2004). The Princeton shape benchmark. In Shape modeling international. Genova, Italy.

  • Tangelder, J. W., & Veltkamp, R. C. (2008). A survey of content based 3d shape retrieval methods. Multimedia Tools Application, 39(3), 441–471.

    Article  Google Scholar 

  • Thurston, W. P. (1997). Three-dimensional geometry and topology. Princeton: Princeton University Press.

    MATH  Google Scholar 

  • Typke, R., Veltkamp, R. C., & Wiering, F. (2006). Evaluating retrieval techniques based on partially ordered ground truth lists. In Proceedings international conference on multimedia & expo.

  • Veltkamp, R. C., Ruijsenaars, R., Spagnuolo, M., van Zwol, R., & ter Haar, F. (2006). Shrec2006 3d shape retrieval contest. Technical report, Utrecht University.

  • Vranic, D. V. (2003). An improvement of rotation invariant 3D shape descriptor based on functions on concentric spheres. In Proceedings of international conference on image processing (pp. 757–760).

  • Zhang, D. S., & Lu, G. (2002). An integrated approach to shape based image retrieval. In Proc. of 5th Asian conference on computer vision (ACCV) (pp. 652–657). Melbourne.

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ameesh Makadia.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Makadia, A., Daniilidis, K. Spherical Correlation of Visual Representations for 3D Model Retrieval. Int J Comput Vis 89, 193–210 (2010). https://doi.org/10.1007/s11263-009-0280-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11263-009-0280-7

Keywords

Navigation