Skip to main content
SpringerLink
Log in

Content-based retrieval of 3D models through curvature maps: a CBR approach exploiting media conversion

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Multimedia digital libraries are gaining an increasing relevance, and are growing in both number and size. Moreover, advancements in acquisition and authoring technologies have also caused new media types to be added to these libraries. For instance, animations and 3D models have recently come alongside more traditional media such as text, images, audio and video. In particular, even if 3D objects were initially included in multimedia digital libraries in the form of images (i.e., views of the objects), they are now also available in the form of 3D models. These allow to overcome the inherent limitations of an image-based representation of a three-dimensional reality. In this paper we present a novel method for description and retrieval of 3D models that relies on curvature maps: after an initial pre-processing of the model, differential properties of points on the surface of the 3D object are evaluated; the model surface is then deformed into an ellipsoid, and is mapped onto a 2D image retaining curvature information of the original model. Through this media conversion from 3D model to image map, we enable application of analysis, description, and matching techniques which have been originally conceived for the image medium. In particular, the two approaches described in this paper rely on histograms for a coarse but efficient description of tiles of the curvature map, and on weighted walkthroughs for a more precise description of homogeneous regions of the map, taking into account their spatial arrangement and areas. Experimental results reveal that both techniques can be successfully applied to curvature maps. The two approaches have been compared against other solutions presented in literature, and have shown a good retrieval performance (particularly in the case of region-based description).

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

Notes

  1. e.g., The Macromolecular Structure Database, http://research.bmn.com/msd and http://msd.ebi.ac.uk

  2. For a detailed analysis the interested reader can also refer to http://thierry.hatt.gps.free.fr/projections/projections-cartes.htm http://math.rice.edu/~polking/cartography/cart.pdf http://www.mentorsoftwareinc.com/cc/gistips/TIPSarch.HTM

References

  1. Ankerst M, Kastenmuller G, Kriegel HP, Seidl T (1999, July) 3D space histograms for similarity search and classification in spatial databases. In Proc. 6th Int. Symposium on Spatial Databases (SSD'99). Hong Kong, China

  2. Assfalg J, Bertini M, Colombo C, Del Bimbo A (2002) Semantic annotation of sports videos. IEEE Multimed 9(2):52–60

    Article  Google Scholar 

  3. Balakrishnan R, Fitzmaurice GW, Kurtenbach G (2001, March) User interfaces for volumetric displays. IEEE Comput 34(3):37–45

    Google Scholar 

  4. Belyaev AG, Bogaevski IA, Ohtake Y (2000, April 10–12) Polyhedral surface smoothing with simultaneous mesh regularization. In: Proceedings of Geometric Modeling and Processing 2000. Theory and applications. Hong Kong, China, pp 229–237

  5. Berchtold S, Kriegel HP (1997) S3: Similarity search in CAD database systems. Proceedings of the ACM SIGMOD International Conference on Management of Data, May, Tucson, Arizona, pp 564–567

  6. Berretti S, Del Bimbo A, Vicario E (2001, October) Efficient matching and indexing of graph models in content-based retrieval. IEEE Trans. on Pattern Analysis and Machine Intelligence 23(10):1089–1105

    Article  Google Scholar 

  7. Brunelli, Mich (2001) Histogram analysis for image retrieval. Pattern Recognit 34(8):1625–1637

    Article  MATH  Google Scholar 

  8. Chalmers A, Rushmeier H (eds) (2002, September/October) Special issue on Computer graphics in art history and archaeology. IEEE Comput Graph Appl 22(5)

  9. Colombo C, Del Bimbo A, Pernici F (2002, June) Uncalibrated 3D metric reconstruction and flattened texture acquisition from a single view of a surface of revolution. In: Proceedings of 1st international symposium on 3D data processing visualization and transmission 3DPVT 2002, Padova, Italy, pp 277–284, IEEE

  10. Courtney JD (1997) Automatic video indexing via object motion analysis. Pattern Recognit 30(4):607–625

    Article  Google Scholar 

  11. Dagtals S, Al-Khatib W, Ghafoor A, Kashyap RL (2000) Models for motion-based video indexing and retrieval. IEEE Trans Image Processing 9(1):88–101

    Article  Google Scholar 

  12. Del Bimbo A (1999) Visual information retrieval. Academic, New York

  13. Del Bimbo A, Vicario E (1998, June) Using weighted spatial relationships in retrieval by visual contents. In: Proceedings of the IEEE workshop on content-based access of image and video libraries (CBAIVL'98, Santa Barbara, California, pp 35–39

  14. Elad M, Tal A, Ar S (2001, September) Content based retrieval of VRML objects—An iterative and interactive approach. EG Multimed 97–108

  15. Elvins TT, Jain R (1995, December) Web-based volumetric data retrieval. In: Proceedings of VRML 95, the first annual conference on the virtual reality modeling language

  16. Eshera MA, Fu K-S (1984, May/June) A graph measure for image analysis. IEEE Trans Systems, Man and Cybernetics 14(3):398–407

    MATH  Google Scholar 

  17. Flickner M, Sawhney H, Niblack W, Ashley J, Huang Q, Dom B, Gorkani M, Hafner J, Lee D, Petkovic D, Steele D, Janker P (1995, September) Query by image and video content: the QBIC System. IEEE Comput 28(9):310–315

    Google Scholar 

  18. Garey MR, Johnson D (1979) Computer and intractability: a guide to the theory of NP-completeness. Freeman, San Francisco

    Google Scholar 

  19. Garland M (1999, September) Multiresolution modeling: survey & future opportunities. In: Proceedings of Eurographics'99

  20. Huang J, Ravi Kumar S, Mitra M, Zhu W-J, Zabih R (1997, June 17–19) Image indexing using color correlograms. In: Proceedings International Conference on Computer Vision and Pattern Recognition (CVPR'97), Puerto Rico

  21. Jain AK, Vailaya A (1996, August) Image retrieval using color and shape. Pattern Recognit 29(8):1233–1244

    Article  Google Scholar 

  22. Kriegel HP, Seidl T (1998) Approximation-based similarity search for 3D surface segments. GeoInformatica Journal 2(2):113–147, Kluwer, Norwell, Massachusetts

    Google Scholar 

  23. Kolonias I, Tzovaras D, Malassiotis S, Strintzis MG (2001, September 19–21) Content-based similarity search of VRML models using shape descriptors. In: Proceedings of International Workshop on Content-Based Multimedia Indexing, Brescia (I)

  24. Lamdan Y, Wolfson HJ (1988) Geometric hashing: A general and efficient model-based recognition scheme. Proceedings IEEE International Conference on Computer Vision, Tampa, Florida, pp 238–249

  25. Levoy M, Pulli K, Curless B, Rusinkiewicz S, Koller D, Pereira L, Ginzton M, Anderson S, Davis J, Ginsberg J, Shade J, Fulk D (2000, July) The digital Michelangelo project. In: Proceedings of the Conference on Computer Graphics (SIGGRAPH 2000)

  26. Mokhtarian F, Khalili N, Yeun P (2001) Multi-scale free-form 3D object recognition using 3D models. Image Vis Comput 19(5):271–281

    Article  Google Scholar 

  27. Page DL, Koschan A, Sun Y, Paik J, Abidi MA (2001, December 11–13) Robust crease detection and curvature estimation of piecewise smooth surfaces from triangle mesh approximations using normal voting. In Proceedings of the IEEE Int. Conf. on Computer Vision and Pattern Recognition (CVPR'01), Kauai, Hawaii 1:162–167

  28. Paquet E, Rioux M (1999) Nefertiti: a query by content system for three-dimensional model and image database management. Image Vis Comput 17(2):157–166

    Article  Google Scholar 

  29. Osada R, Funkhouser T, Chazelle B, Dobkin D (1999) Matching 3D models with shape distribution. In: Proceedings of shape modeling international, Genova (I)

  30. Roth V (1999) Content-based retrieval from digital video. Image Vis Comput 17(7):531–540

    Article  Google Scholar 

  31. Rubner Y, Tomasi C, Guibas LJ (1998) A metric for distributions with applications to image databases. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV'98), Bombay, India

  32. Santini S, Jain R (1999) Similarity measures. IEEE Transactions on Pattern Analysis and Machine Intelligence 21(9):871–883

    Article  Google Scholar 

  33. Smeulders AWM, Worring M, Santini S, Gupta A, Jain R (2000, December) Content-based image retrieval at the end of the early years. IEEE Trans Pattern Analysis and Machine Intelligence 22(12):1349–1380

    Article  Google Scholar 

  34. Smith, JR, Chang SF (1996, November) VisualSEEk: a fully automated content-based image query system. In: Proceedings of ACM Multimedia '96. Boston, Massachusetts

  35. Snyder JP, Bugayevski LM (1995) Map projections—a reference manual. Taylor & Francis

  36. Swain MJ, Ballard DH (1991) Color indexing. Int J Comput Vis 7(1):11–32

    Article  Google Scholar 

  37. Taubin G, Cooper DB (1991) Recognition and positioning of rigid objects using algebraic moment invariants. Geometric Methods in Computer Vision 1570:175–186, SPIE

    Google Scholar 

  38. Taubin G (1995) A signal processing approach to fair surface design. Comput Graph (Annual Conference Series) 29:351–358

    Google Scholar 

  39. Taubin G (1995) Estimating the tensor of curvature of a surface from a polyhedral approximation. Fifth International Conference on Computer Vision (ICCV'95)

  40. Taubin G (2000) Geometric signal processing on polygonal meshes. In: Proceedings of Eurographics 2000

  41. Vandeborre J-Ph, Couillet V, Daoudi M (2002) A practical approach for 3D model indexing by combining local and global invariants. In: Proceedings of the 1st International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'02)

  42. Tsai W-H, Fu K-S (1979, November/December) Error-correcting isomorphism of attributed relational graphs for pattern analysis. IEEE Trans Systems, Man and Cybernetics 12(6):657–767

    Google Scholar 

  43. Wong K-YK, Mendonca PRS, Cipolla R (2003, February) Camera calibration from surfaces of revolution. IEEE Trans PAMI 25(2):147–161

    Google Scholar 

  44. Zhang HJ, Wu JH, Zhong D, Smoliar SW (1997) An integrated system for content-based video retrieval and browsing. Pattern Recognit 30(4):643–658

    Article  Google Scholar 

Download references

Acknowledgment

The authors thank Dr. Gianni Antini for his valuable contribution to part of this work.

Author information

Authors and Affiliations

  1. Dipartimento di Sistemi e Informatica, Via S. Marta 3, 50139, Firenze, Italy

    Jürgen Assfalg, Alberto Del Bimbo & Pietro Pala

Authors
  1. Jürgen Assfalg
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Alberto Del Bimbo
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Pietro Pala
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jürgen Assfalg.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Assfalg, J., Del Bimbo, A. & Pala, P. Content-based retrieval of 3D models through curvature maps: a CBR approach exploiting media conversion. Multimed Tools Appl 31, 29–50 (2006). https://doi.org/10.1007/s11042-006-0034-2

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-006-0034-2

Keywords

Search

Navigation