Skip to main content
Springer Nature Link
Log in

Selectively densified 3D object modeling based on regions of interest detection using neural gas networks

  • Methodologies and Application
  • Published:
Soft Computing Aims and scope Submit manuscript

Abstract

The paper discusses automated solutions for 3D object modeling at multiple resolutions in the context of virtual reality. An original solution, based on an unsupervised neural network, is proposed to guide the creation of selectively densified meshes. A neural gas network, applied over a sparse density object mesh, adapts its nodes during training to capture the embedded shape of the object. Regions of interest are then identified as areas with higher density of nodes in the adapted neural gas map. Meshes at different level of detail for an object, which preserve these regions of interest, are constructed by adapting a classical simplification algorithm, the QSlim. The simplification process will therefore only affect the regions of lower interest, ensuring that the characteristics of an object are preserved even at lower resolutions. Various interest point detectors are incorporated in selectively densified meshes in a similar manner to enable the comparison with the proposed neural gas approach. A novel solution based on learning is proposed to select the number of faces for the discrete models of an object at different resolutions. Finally, selectively densified object meshes are incorporated in a discrete level-of-detail method for presentation in virtual reality applications.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  • A Benchmark for 3D Interest Points Marked by Human Subjects [Online]. http://www.itl.nist.gov/iad/vug/sharp/benchmark/3DInterestPoint/

  • Castellani U, Cristiani M, Fantoni S, Murino V (2008) Sparse points matching by combining 3D mesh saliency with statistical descriptors. Eurographics 27(2):643–652

    Google Scholar 

  • Cignoni P, Rocchini C, Scopigno R (1998) Metro: measuring error on simplified surfaces. Comput Graph Forum 17(2):167–174. [AAOnline]. http://vcg.isti.cnr.it/activities/surfacegrevis/simplification/

  • CloudCompare—3D Point Cloud and Mesh Processing Software, Open Source Project [Online]. http://www.danielgm.net/cc/

  • Cretu A-M (2009) Experimental data acquisition and modeling of 3D deformable objects. Ph.D. Thesis, University of Ottawa

  • Creusot C, Pears N, Austin J (2013) A machine-learning approach to keypoint detection and landmarking on 3D meshes. Springer Int J Comput Vis 102(1–3):146–179

    Article  Google Scholar 

  • Dugataci H, Cheung CP, Godil A (2012) Evaluation of 3D interest point detection techniques via human-generated ground truth. Vis Comput 28(9):901–917

    Article  Google Scholar 

  • Feixas M, Sbert M, Gonzalez F (2009) A unified information-theoretic framework for viewpoint selection and mesh saliency. ACM Trans Appl Percept 6(1):1:2–1:23

    Article  Google Scholar 

  • Gal R, Cohen-Or D (2006) Salient geometric features for partial shape matching and similarity. ACM Trans Graph 25(1):130–150

    Article  Google Scholar 

  • Garland M, Heckbert PS (1997) Surface simplification using quadric error meshes. In: Proceedings of ACM Siggraph 97, pp 209–216

  • Godil A, Wagan AI (2011) Salient local 3D features for 3D shape retrieval. In: Beraldin, JA, Cheok GS, McCarthy MB, Neuschaefer-Rube U, Baskurt AM, McDowall IE, Dolinsky M (eds) Three-dimensional imaging, interaction, and measurement. Proceedings of the SPIE, vol 7864. San Francisco, USA, pp 78640S-1–78640S-8

  • Ho T-C, Lin Y-C, Chuang J-H, Peng C-H, Cheng Y-J (2006) User-assisted mesh simplification. In: Proceedings of ACM international conference on virtual reality continuum and its applications, pp 59–66

  • Kho Y, Garland M (2003) User-guided simplification. In: Proceedings of ACM symposium on interactive 3D graphics, pp 123–126

  • Lee CH, Varshney A, Jacobs DW (2005) Mesh saliency. ACM SIGGRAPH 174:659–666

    Article  Google Scholar 

  • Leifman G, Shtrom E, Tal A (2012) Surface regions of interest for viewpoint selection. IEEE conference on computer vision and pattern recognition, pp 414–421

  • Liu Y-S, Liu M, Kihara D, Ramani K (2007) Salient critical points for meshes. ACM symposium on solid and physical modelling, pp 277–282

  • Luebke D (2001) A developer’s survey of polygonal simplification algorithm. IEEE Comput Graph Appl 21(3):24–35

    Article  Google Scholar 

  • Luebke D, Reddy M, Cohen JD, Varshney A, Watson B, Huebner R (2003) Level of detail for 3D graphics. In: The Morgan Kaufmann Series in Computer Graphics and Geometric Modeling. Elsevier, San Francisco

  • Martinetz M, Berkovich SG, Schulten KJ (1993) Neural-gas network for vector quantization and its application to time-series prediction. IEEE Trans Neural Netw 4(4):558–568

    Article  Google Scholar 

  • Monette-Thériault H, Cretu A-M, Payeur P (2014) 3D object modeling with neural gas based selective densification of surface meshes. IEEE international conference on systems, man, and cybernetics, pp 1373–1378, San Diego, US

  • Novatnack J, Nishino K (2007) Scale-dependent 3D geometric features. IEEE international conference on computer vision, pp 1–8

  • Payeur P, Curtis P, Cretu A-M (2013) Computational methods for selective acquisition of depth measurements in machine perception. IEEE international conference on systems, man, and cybernetics, pp 876–881, Manchester, UK

  • Peyre G (2007) Toolbox graph. [Online]. http://www.mathworks.com/matlabcentral/fileexchange/5355-toolbox-graph

  • Pojar E, Schmalstieg D (2003) User-controlled creation of multiresolution meshes. In: Proceedings of ACM symposium on interactive 3D graphics, pp 127–130

  • Sipiran I, Bustos B (2010) A robust 3D interest points detector based on Harris operator. Eurographics workshop on 3D object retrieval, pp 7–14

  • Song R, Liu Y, Zhao Y, Martin RR, Rosin PL (2012) Conditional random field-based mesh saliency. IEEE international conference on image processing, pp 637–640

  • Song R, Liu Y, Martin RR, Rosin PL (2014) Mesh saliency via spectral processing. ACM Trans Graph 33(1):6:1–6:17

    Article  MATH  Google Scholar 

  • Sun J, Ovsjanikov M, Guibas L (2009) A concise and provably informative multi-scale signature based on heat diffusion. Eurograph Symp Geom Process 28(5):1383–1392

    Google Scholar 

  • Tombari F, Salti S, Di Stefano L (2013) Performance evaluation of 3D keypoint detectors. Springer Int J Comput Vis 102(1–3):198–220

    Article  Google Scholar 

  • Wu J, Shen X, Zhu W, Liu L (2013) Mesh saliency with global rarity. Graph Models 75:255–264

    Article  Google Scholar 

  • Yang Y-B, Lu T, Lin J-J (2009) Saliency regions for 3D mesh abstraction. In: Muneesawang P et al (eds) Advances in multimedia information processing, LNCS 5879, pp 292–299

  • Yu T-H, Woodford OJ, Cipolla R (2013) A performance evaluation of volumetric 3D interest point detectors. Int J Comput Vis 102(1–3):180–197

    Article  Google Scholar 

  • Zaharescu A, Boyer E, Varanasi K, Horaud R (2009) Surface feature detection and description with applications to mesh matching. IEEE international conference on computer vision and pattern recognition, pp 373–380

  • Zhao Y, Liu Y, Song R, Zhang M (2012) Extended non-local means filter for surface saliency detection. IEEE international conference on image processing, pp 633–636

  • Zhao Y, Liu Y, Song R, Zhang M (2013a) A Retinex theory based points sampling method. Int J Comput Inf Syst Ind Manag Appl 5:1–10

    Google Scholar 

  • Zhao Y, Liu Y, Zeng Z (2013b) Using region-based saliency for 3D interest points detection. In: Wilson R et al (eds) CAIP 2013, Part II, LNCS 8048, pp 108–116

  • Zou G, Hua J, Dong M, Qin H (2008) Surface matching with salient keypoints in geodesic scale space. Comput Animat Virtual Worlds 19:399–410

    Article  Google Scholar 

Download references

Acknowledgments

The authors thank H. Monette-Thériault for his help with the implementation of the adapted QSlim algorithm.

Author information

Authors and Affiliations

  1. Université du Québec en Outaouais, 101 Saint-Jean-Bosco, Gatineau, QC, J8X 3X7, Canada

    Ana-Maria Cretu & Maude Chagnon-Forget

  2. University of Ottawa, 800 King Edward, Ottawa, ON, K1N 6N5, Canada

    Ana-Maria Cretu & Pierre Payeur

Authors
  1. Ana-Maria Cretu
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Maude Chagnon-Forget
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Pierre Payeur
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Ana-Maria Cretu.

Ethics declarations

Funding

The authors acknowledge the support to this research from the Natural Sciences and Engineering Research Council of Canada, under the Discovery Grant RGPIN-2014-04953.

Conflict of interest

The authors declare that there is no conflict of interest related to this work.

Human and animal rights

This article does not contain any studies with human participants performed by any of the authors.

Additional information

Communicated by V. Loia.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Cretu, AM., Chagnon-Forget, M. & Payeur, P. Selectively densified 3D object modeling based on regions of interest detection using neural gas networks. Soft Comput 21, 5443–5455 (2017). https://doi.org/10.1007/s00500-016-2132-z

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00500-016-2132-z

Keywords