Skip to main content
Springer Nature Link
Log in

A New Shape Benchmark for 3D Object Retrieval

  • Conference paper
Advances in Visual Computing (ISVC 2008)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 5358))

Included in the following conference series:

  • 2625 Accesses

Abstract

Recently, content based 3D shape retrieval has been an active area of research. Benchmarking allows researchers to evaluate the quality of results of different 3D shape retrieval approaches. Here, we propose a new publicly available 3D shape benchmark to advance the state of art in 3D shape retrieval. We provide a review of previous and recent benchmarking efforts and then discuss some of the issues and problems involved in developing a benchmark. A detailed description of the new shape benchmark is provided including some of the salient features of this benchmark. In this benchmark, the 3D models are classified mainly according to visual shape similarity but in contrast to other benchmarks, the geometric structure of each model is modified and normalized, with each class in the benchmark sharing the equal number of models to reduce the possible bias in evaluation results. In the end we evaluate several representative algorithms for 3D shape searching on the new benchmark, and a comparison experiment between different shape benchmarks is also conducted to show the reliability of the new benchmark.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. http://www.designrepository.org/

  2. http://www.rcsb.org/pdb/home /pdb/home

  3. http://store.sae.org/caesar/

  4. http://shapes.aim-at-shape.net/

  5. http://www-c.inria.fr/gamma/gamma.php

  6. http://shape.cs.princeton.edu/search.html

  7. http://merkur01.inf.uni-konstanz.de/CCCC/

  8. http://www.3d.csie.ntu.edu.tw/

  9. http://www.cs.uu.nl/centers/give/multimedia/3Drecog/3Dmatching.html

  10. http://www.3d-search.iti.gr /3DSearch

  11. Min, P., Kazhdan, M., Funkhouser, T.: A comparison of text and shape matching for retrieval of online 3d models. In: Proc. European conference on digital libraries, pp. 209–220 (2004)

    Google Scholar 

  12. Tangelder, J.W.H., Veltkamp, R.C.: A survey of content based 3d shape retrieval methods. In: Proceedings of the Shape Modeling International, pp. 145–156 (2004)

    Google Scholar 

  13. Bustos, B., Keim, A.D., Saupe, D., Schreck, T., Vranic, V.D.: Feature-based similarity search in 3d object databases. ACM Computing Surveys 37(4), 345–387 (2005)

    Article  Google Scholar 

  14. Iyer, N., Jayanti, S., Lou, K., Kalyanaraman, Y., Ramani, K.: Three-dimensional shape searching: state-of-the-art review and future trends. Computer-Aided Design 37(5), 509–530 (2005)

    Article  Google Scholar 

  15. http://trec.nist.gov/

  16. http://www.eureka.vu.edu.au /~grubinger/IAPR/TC12_Benchmark.html

  17. http://www.imageclef.org/

  18. Smeaton, A.F., Over, P., Kraaij, W.: Evaluation campaigns and trecvid. In: Proceedings of the 8th ACM International Workshop on Multimedia Information Retrieval, pp. 321–330 (2006)

    Google Scholar 

  19. Orio, N.: Music retrieval: A tutorial and review. Foundations and Trends in Information Retrieval 1, 1–90 (2006)

    Article  MATH  Google Scholar 

  20. Typke, R., Wiering, F., Veltkamp, R.C.: A survey of music information retrieval systems. In: Proceedings of the 6th International Conference on Music Information Retrieval, pp. 153–160 (2005)

    Google Scholar 

  21. http://www.aimatshape.net /event/SHREC

  22. Veltkamp, R.C., Ruijsenaars, R., Spagnuolo, M., van Zwol, R., ter Haar, F.: Shrec2006 3d shape retrieval contest, technical report uu-cs-2006-030. Technical report, Department of Information and Computing Science, Utrecht University (2006)

    Google Scholar 

  23. Veltkamp, R.C., ter Haar, F.B.: Shrec2007 3d shape retrieval contest, technical report uu-cs-2007-015. Technical report, Department of Information and Computing Science, Utrecht University (2007)

    Google Scholar 

  24. Shilane, P., Min, P., Kazhdan, M., Funkhouser, T.: The princeton shape benchmark. In: Proceedings of the Shape Modeling International, pp. 167–178 (2004)

    Google Scholar 

  25. Iyer, N., Jayanti, S., Lou, K., Kalyanaraman, Y., Ramani, K.: Developing an engineering shape benchmark for cad models. Computer-Aided Design 38(9), 939–953 (2006)

    Article  Google Scholar 

  26. Zhang, J., Siddiqi, K., Macrini, D., Shokouf, A., Dickinson, S.: Retrieving articulated 3-d models using medial surfaces and their graph spectra. In: International Workshop On Energy Minimization Methods in Computer Vision and Pattern Recognition, pp. 285–300 (2005)

    Google Scholar 

  27. Voorhees, E.M.: Variations in relevance judgments and the measurement of retrieval effectiveness. In: Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval, pp. 315–323 (1998)

    Google Scholar 

  28. Papadakis, P., Pratikakis, I., Perantonis, S., Theoharis, T.: Efficient 3d shape matching and retrieval using a concrete radialized spherical projection representation. Pattern Recognition 40, 2437–2452 (2007)

    Article  MATH  Google Scholar 

  29. Laga, H., Takahashi, H., Nakajima, M.: Spherical wavelet descriptors for content-based 3d model retrieval. In: Proceedings of the IEEE International Conference on Shape Modeling and Applications, pp. 15 (2006)

    Google Scholar 

  30. http://www.bithack.se /methabot/start

  31. Veleba, D., Felkel, P.: Detection and correction of errors in surface representation. In: The 15th International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision (2007)

    Google Scholar 

  32. Jones, S., Van Rijsbergen, C.J.: Information retrieval test collections. Journal of Documentation 32, 59–75 (1976)

    Article  Google Scholar 

  33. Leung, C.: Benchmarking for content-based visual information search. In: Laurini, R. (ed.) VISUAL 2000. LNCS, vol. 1929, pp. 442–456. Springer, Heidelberg (2000)

    Chapter  Google Scholar 

  34. http://www.eecs.berkeley.edu/Research/Projects/CS/vision/grouping/segbench/

  35. Buckley, C., Voorhees, E.M.: Evaluating evaluation measure stability. In: Proceedings of the 16th annual international ACM SIGIR conference on Research and development in information retrieval, pp. 33–40 (2000)

    Google Scholar 

  36. Rijsbergen, C.J.V.: Information Retrieval, 2nd edn. Butterworths (1979)

    Google Scholar 

  37. Salton, G., McGill, M.J.: Introduction to Modern Information Retrieval. McGraw Hill Book Co., New York (1983)

    MATH  Google Scholar 

  38. Jarvelin, K., Kekalainen, J.: Ir evaluation methods for retrieving highly relevant documents. In: Proceedings of the 23rd annual international ACM SIGIR conference on Research and development in information retrieval, pp. 41–48 (2000)

    Google Scholar 

  39. Chen, D., Tian, X., Shen, Y., Ouhyoung, M.: On Visual Similarity Based 3 D Model Retrieval. Computer Graphics Forum 22, 223–232 (2003)

    Article  Google Scholar 

  40. Vranic, D.V.: 3d model retrieval. PH.D thesis, University of Leipzig, German (2004)

    Google Scholar 

  41. Osada, R., Funkhouser, T., Chazelle, B., Dobkin, D.: Shape distributions. ACM Transactions on Graphics (TOG) 21, 807–832 (2002)

    Article  MATH  Google Scholar 

  42. Ohbuchi, R., Minamitani, T., Takei, T.: Shape-similarity search of 3d models by using enhanced shape functions. International Journal of Computer Applications in Technology 23, 70–85 (2005)

    Article  Google Scholar 

  43. Ohbuchi, R., Otagiri, T., Ibato, M., Takei, T.: Shape-similarity search of three-dimensional models using parameterized statistics. In: Proceedings of the 10th Pacific Conference on Computer Graphics and Applications, pp. 265–274 (2002)

    Google Scholar 

  44. Vranic, D.V.: Desire: a composite 3d-shape descriptor. In: Proceedings of the IEEE International Conference on Multimedia and Expo. (2005)

    Google Scholar 

  45. Ohbuchi, R., Hata, Y.: Combining multiresolution shape descriptors for 3d model retrieval. In: Proc. WSCG 2006 (2006)

    Google Scholar 

  46. Voorhees, E.M., Buckley, C.: The effect of topic set size on retrieval experiment error. In: Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval, pp. 316–323 (2002)

    Google Scholar 

  47. Lin, W.H., Hauptmann, A.: Revisiting the effect of topic set size on retrieval error. In: Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval, pp. 637–638 (2005)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. National Institute of Standards and Technology, Maryland, USA

    Rui Fang, Afzal Godil, Xiaolan Li & Asim Wagan

  2. Zhejiang Gongshang University, P. R. China

    Xiaolan Li

Authors
  1. Rui Fang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Afzal Godil
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Xiaolan Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Asim Wagan
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Computer Science and Engineering, University of Nevada, Reno, USA

    George Bebis

  2. NASA Ames Research Center, Moffett Field, CA, USA

    Richard Boyle

  3. Lawrence Berkeley National Laboratory, Berkeley, CA, USA

    Bahram Parvin

  4. Desert Research Institute, Reno, NV, USA

    Darko Koracin

  5. Digital Image Research Center, Kingston University, London, UK

    Paolo Remagnino

  6. Mitsubishi Electric Research Laboratories, P.O. Box 02139, Cambridge, MA, USA

    Fatih Porikli

  7. Computer and Information Science and Engineering, University of Florida, P.O. Box, FL 32611-6120, Gainsville, USA

    Jörg Peters

  8. IBM T.J. Watson Research Center, 19 Skyline Drive, NY 10532, Hawthorne, USA

    James Klosowski

  9. 128 Memorial Mall, Stewart B001, IN 47907, West Lafayette, USA

    Laura Arns

  10. Denver Museum of Nature and Space, 2001 Colorade Blvd. Denver,, CO 80205, USA

    Yu Ka Chun

  11. Departmen of Computer Science,, NC State University, Campus Box 8206, NC 27695-8206, Raleigh, USA

    Theresa-Marie Rhyne

  12. Los Alamos National Labs, P.O. Box 1663, NM 87545, Los Alamos, USA

    Laura Monroe

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Fang, R., Godil, A., Li, X., Wagan, A. (2008). A New Shape Benchmark for 3D Object Retrieval. In: Bebis, G., et al. Advances in Visual Computing. ISVC 2008. Lecture Notes in Computer Science, vol 5358. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-89639-5_37

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-89639-5_37

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-89638-8

  • Online ISBN: 978-3-540-89639-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics