Elsevier

Computer-Aided Design

Volume 44, Issue 12, December 2012, Pages 1182-1189
Computer-Aided Design

Hole filling of triangular mesh segments using systematic grey prediction

https://doi.org/10.1016/j.cad.2012.07.007Get rights and content

Abstract

Recent advances in reverse engineering technology have made it possible to acquire accurate point information about model surfaces using 3D laser scanners. However, data capture can be reduced by limitations in the scanner structure or characteristics of the scanned objects, resulting in holes in the triangular mesh model and reducing the model’s quality. The current study seeks to fill these holes using software-based calculations and systematic grey prediction, thus preserving the original exterior surface of the reconstructed model. A 3D digital dental model was acquired using a 3D laser scanner, followed by hole detection and surface mending. Due to the simplicity and minimal dataset used in grey theory, a grey prediction system was built to perform prediction-adjustment to preserve the original dental exterior surface.

Highlights

► We adopted the prediction method for filling the holes in mesh models. ► We provided a new method to fill the holes in meshes. ► It is beneficial for mesh-handling in model scanning and solid constructions in the field of reverse engineering.

Introduction

Reverse engineering applications basically involve the direct measurement and reconstruction of the surface information of a solid model using 3D instrumentation. 3D measurement methods can be divided into two categories: contact and non-contact. Contact measurement methods are highly precise but slow, and require contact with the surface of the object, thus limiting their usefulness. Non-contact measurement methods utilize many different sensing techniques to reconstruct the object’s 3D geometry, and are particularly suitable for measuring complex solid models which are difficult to draw. Non-contact methods also have an advantage in that they are faster. The successful adaptation of computer vision techniques in dentistry to supplement missing dental model information would have considerable potential for future medical applications.

Triangular mesh segments have been widely used to represent 3D digital models in computer animations, virtual reality, the reconstruction of human organs from CT images, and so on. All models are represented using triangular mesh segments. The mesh models are generated by scanning and measuring the object structure, which may result in a partial loss of scanned information due to many factors including poor reflection of surface colour, or a blind spot in the measurement due to the design limitations of the measuring instrumentation, potentially leaving holes in the triangular mesh model. This study attempts to fill the holes in the model using software-based calculations to obtain a solid model faithful to the geometry of the original subject, and to adjust the apex coordinates of the newly added mesh segments using systematic grey prediction, thus allowing the new mesh segments to be integrated into the surrounding mesh segments.

Dental models are characterized by complex surface irregularities. During 3D scanning, the laser may be unable to adequately penetrate into gaps between the teeth, thus leaving holes in the resulting mesh segments. In addition, the significant curvature change rate of the gingival line is not easily reflected by the laser beam, making it difficult to acquire point information. The complexity of various types of holes, combined with the advantages and disadvantages of various algorithms is the greatest challenge for hole filling. Most algorithms are composed of complex mathematical calculations.

This study targets holes generated during the process of scanning dental models, and focuses on developing a high-quality hole filling method by repairing and refining the object’s surface, followed by predicting and adjusting the coordinates of the newly added points using the grey prediction model taken from grey theory.

Section snippets

Previous related work

When mesh models are acquired by scanning and measuring the object structure, partial loss of scanned information can be caused by many factors, including the poor reflection of surface colour or blind spots due to design limitations of the measuring instruments. This loss of information can result in holes in the triangular mesh model. The hardest part of filling such holes is restoring the characteristics of the mesh model to a certain degree based on limited information. A brief review of

Method development

This study employed a prediction method that combines a hole-filling algorithm with a grey system. As shown in Fig. 3, this method is divided into two major processes: the STL-scanning database construction using the TDS Scanner [17] and the hole filling process. The STL mesh models resulting from these two processes are shown using the VTK drawing environment [18].

Targeted at the hole filling process, this study mainly focused on developing an algorithm divided into two stages: surface hole

Experimental results

This study was carried out in two steps — hole surface filling and system grey prediction. Microsoft Visual Studio 2005 operating in Windows XP served as the testing platform on a PC with an AMD 2.31 GHz CPU and 2 GB of RAM.

The study uses two sets of standard model and three sets of tooth scan model data as a test model. Taking advantage of the low-reflection nature of the curvature on the tooth, the study uses laser beams to scan the tooth model. Areas without point data would generate holes

Conclusion

Grey prediction theory was adapted to achieve good hole filling results on digital dental models with only a small amount of information on hole boundaries. Hole filling results were superior to other known methods, providing a new method to fill holes in mesh segments. This method can not only be applied to hole filling in digital dental models, but can also be beneficial for mesh-handling in model scanning and solid constructions in the field of reverse engineering.

The grey system theory

References (21)

  • Y. Jun

    A piecewise hole filling algorithm in reverse engineering

    Computer-Aided Design

    (2005)
  • Z. Li et al.

    Polynomial blending in a mesh hole-filling application

    Computer-Aided Design

    (2010)
  • Wang J, Manuel O. A hole filling strategy for reconstruction of smooth surfaces in range images. In: XVI Brazilian...
  • T.P. Fang et al.

    Delaunay triangulation in three dimensions

    IEEE Xplore

    (1995)
  • W. Zhao

    A robust hole-filling algorithm for triangular mesh

    The Visual Computer

    (2007)
  • P. P’erez et al.

    Poisson image editing, vol. 22

    (2007)
  • Y. Yu et al.

    Mesh editing with Poisson-based gradient field manipulation

    (2004)
  • V. Surazhsky et al.

    Fast exact and approximate geodesics on meshes

    (2005)
  • X.J. Wu et al.

    An automatic hole-filling algorithm for polygon meshes

    Computer-Aided Design & Applications

    (2008)
  • J.C. Carr et al.

    Reconstruction and representation of 3D objects with radial basis functions

    (2001)
There are more references available in the full text version of this article.

Cited by (27)

  • Fitting missing data by means of adaptive meshes of Bézier curves

    2022, Mathematics and Computers in Simulation
    Citation Excerpt :

    To illustrate this fact we can consider, for example, the case of filling a hole of information in the top of a semisphere: Depending on what the role of the fitting patch will be, we may want to fill the hole with a ‘minimal’ criteria – i.e., minimizing some linked measure, – or we may want to fill the hole by a bending patch with semispherical shape. It is desirable then to develop methods to fit missing or unstructured data, or to fill holes, providing fitting or filling patches restoring characteristics of the models [21], sharp features [20] or fulfilling some specific geometrical constraints of industrial or design type, in such a way that the fitting patch will be no longer flat but faithful to the shape of the known dataset. In short, we may be more interested in obtaining a global fitting function faithful to the dataset that in obtaining a minimal fitting patch.

  • Improve the accuracy, surface smoothing and material adaption in STL file for RP medical models

    2016, Journal of Manufacturing Processes
    Citation Excerpt :

    A hole-repairing algorithm is developed by Qiu et al., they are proposed a new algorithm using Distance Weight interpolation and also apply it to generate the volume in Image-guided for surgical robot [26]. A holefilling method is adapted by repairing and refining the object's surface, later on predicting and adjusting the coordinates of the newly added points using grey prediction system [27]. This initial mesh is remeshed by computing discrete parameterization with Radial Basis Functions (RBF's) [28].

  • A triangulation-based hole patching method using differential evolution

    2013, CAD Computer Aided Design
    Citation Excerpt :

    The patching mesh in hole region was obtained by iteratively refining and smoothing the preciously optimized mesh according to the lengths of the adjacent triangles, based on an initial triangulation mesh of the boundary points of the considered hole region [18,19]. A grey prediction model was proposed to predict and adjust the coordinates of the newly added points by obtaining two controlled variables—the normal vector and the included angle size [20], this method tends to maintain the variation trend of the boundary points by utilizing the point information adjacent to the prediction points. While the used point information is only on one side of the boundary, the variation trend from one side to another side in the hole region cannot be detected, which may result in losing fidelity for holes where the points vary uniformly from one side to the other.

View all citing articles on Scopus
View full text