Skip to main content
SpringerLink
Log in

A survey on algorithms of hole filling in 3D surface reconstruction

  • Survey
  • Published:
The Visual Computer Aims and scope Submit manuscript

Abstract

The surface reconstruction of 3D objects has attracted more and more attention for its widespread application in many areas, such as computer science, cultural heritage restoration, medical facilities, entertainment. However, due to occlusion, reflectance, the scanning angle, raw data preprocessing, it is inevitable to lose some point data, which leads to holes in the reconstruction surface, making it undesirable for various applications. Therefore, methods for filling holes in the process of surface reconstruction are critical to the final results of reconstruction. This paper makes a survey of existing well-known hole-filling algorithms, classifies the algorithms into two main categories, analyzes and compares these algorithms from the viewpoints of theories and experimental results to make a clear introduction of their performance. At the end, the paper points out the possible development direction of hole filling in the future and hopes to be a good guide for other researchers.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

References

  1. Kirkvik, A.S.: Completing a model based on laser scan generated point cloud data. Institutt for Datateknikk Og Informasjonsvitenskap (2010)

  2. Rudolf, F., Weinbub, J., Rupp, K., Resutik, P., Morhammer, A., Selberherr, S.: Free open source mesh healing for TCAD device simulations. In: Lirkov, I., Margenov, S. D., Waśniewski, J. (eds.) Large-Scale Scientific Computing, vol.9374, pp. 293–300 Springer, Switzerland (2015). doi:10.1007/978-3-319-26520-9_32

  3. Bendels, Gerhard H., Schnabel, R., Klein, R.: Detecting holes in point set surfaces. J. Wscg 14 (2006)

  4. Xie, H., McDonnell, T., Qin, H.: Surface reconstruction of noisy and defective data sets. In Visualization, IEEE, pp. 259–266 (2004)

  5. Weber, C., Hahmann, S., Hagen, H.: Sharp feature detection in point clouds. In: Proceedings of the 2010 Shape Modeling International Conference, pp. 175–186. IEEE Computer Society, Washington, DC (2010)

  6. Tran, T.T., Cao, V.T., Laurendeau, D.: Extraction of reliable primitives from unorganized point clouds. 3D Res. 6(4), 1–12 (2015)

    Article  Google Scholar 

  7. Franchini, E., Morigi, S., Sgallari, F.: Implicit shape reconstruction of unorganized points using PDE-based deformable 3D manifolds. Numer. Math. Theory Methods Appl. 3(4), 405–430 (2010)

    MathSciNet  MATH  Google Scholar 

  8. Casciola, G., Lazzaro, D., Montefusco, L.B., Morigi, S.: Fast surface reconstruction and hole filling using positive definite radial basis functions. Numer. Algorithms 39(1–3), 289–305 (2005)

    Article  MathSciNet  MATH  Google Scholar 

  9. Park, S., Guo, X., Shin, H., Qin, H.: Surface completion for shape and appearance. Vis. Comput. 22(3), 168–180 (2006)

    Article  Google Scholar 

  10. Sharf, A., Alexa, M., Cohen-Or, D.: Context-based surface completion. ACM Trans. Graph. (TOG) 23(3), 878–887 (2004)

    Article  Google Scholar 

  11. Wang, J., Oliveira, M.: A hole-filling strategy for reconstruction of smooth surfaces in range images. In: Computer Graphics and Image Processing. SIBGRAPI 2003. XVI Brazilian Symposium, pp. 11–18. IEEE (2003)

  12. Hoppe, H., DeRose, T., Duchamp, T., McDonald, J., Stuetzle, W.: Surface reconstruction from unorganized points, vol. 26, No. 2, pp. 71–78. ACM (1992)

  13. Chalmoviansky, P., Jttler, B.: Filling holes in point clouds. In: Mathematics of Surfaces, pp. 196–212. Springer, Berlin, Heidelberg (2003)

  14. Wu, X., Chen, W.: A scattered point set hole-filling method based on boundary extension and convergence. In: Intelligent Control and Automation (WCICA), 2014 11th World Congress on (pp. 5329-5334). IEEE.(2014)

  15. Doria, D., Radke, R.J.: Filling large holes in lidar data by inpainting depth gradients. In: 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, pp. 65–72. IEEE (2012)

  16. Yang, N.E., Kim, Y.G., Park, R.H.: Depth hole filling using the depth distribution of neighboring regions of depth holes in the Kinect sensor. In: Signal Processing, Communication and Computing (ICSPCC), 2012 IEEE International Conference, pp. 658-661. IEEE (2012)

  17. Jun, Y.: A piecewise hole filling algorithm in reverse engineering. Comput. Aided Des. 37(2), 263–270 (2005)

    Article  MathSciNet  Google Scholar 

  18. Qiang, H., Shusheng, Z., Xiaoliang, B., et al.: Hole filling based on local surface approximation. In: Computer Application and System Modeling (ICCASM), International Conference, vol. 3, pp. V3-242–V3-245. IEEE (2010)

  19. Attene, M., Campen, M., Kobbelt, L.: Polygon mesh repairing: an application perspective. ACM Comput. Surv. (CSUR) 45(2), 15 (2013)

    Article  MATH  Google Scholar 

  20. Davis, J., Marschner, S.R., Garr, M., Levoy, M.: Filling holes in complex surfaces using volumetric diffusion. In: 3D Data Processing Visualization and Transmission. Proceedings. IEEE. First International Symposium, pp. 428–441 (2002)

  21. Ju, T.: Robust repair of polygonal models. In: ACM Transactions on Graphics (TOG), vol. 23, No. 3, pp. 888–895 (2004)

  22. Guo, T.Q., Li, J.J., Weng, J.G., Zhuang, Y.T.: Filling holes in complex surfaces using oriented voxel diffusion. In: Machine Learning and Cybernetics, 2006 International Conference, pp. 4370–4375. IEEE (2006)

  23. Centin, Marco, Pezzotti, Nicola, Signoroni, Alberto: Poisson-driven seamless completion of triangular meshes. Comput. Aided Geom. Des. 35, 42–55 (2015)

    Article  MathSciNet  Google Scholar 

  24. Liepa, P.: Filling holes in meshes. In: Proceedings of the 2003 Eurographics/ACM SIGGRAPH symposium on Geometry processing, pp. 200–205. Eurographics Association (2003)

  25. Attene, M.: A lightweight approach to repairing digitized polygon meshes. Vis. Comput. 26(11), 1393–1406 (2010)

    Article  Google Scholar 

  26. Wei, M., Wu, J., Pang, M.: An integrated approach to filling holes in meshes. In: Artificial Intelligence and Computational Intelligence (AICI), 2010 International Conference, vol. 3, pp. 306–310. IEEE (2010)

  27. Harary, G., Ayellet T., Grinspun, E.: Context-based coherent surface completion. ACM Trans. Graph. (TOG) 33(1), 5 (2014)

  28. Branch, J., Prieto, F., Boulanger, P.: Automatic hole-filling of triangular meshes using local radial basis function. In: 3D Data Processing, Visualization, and Transmission, Third International Symposium, pp. 727–734. IEEE (2006)

  29. Tekumalla, L.S., Elaine, C.: Reverse engineering point clouds to fit tensor product B-spline surfaces by blending local fits. arXiv:1411.5993 (2014)

  30. Dellepiane, M., Venturi, A., Scopigno, R.: Image guided reconstruction of un-sampled data: a coherent filling for uncomplete Cultural Heritage models. In: Computer Vision Workshops (ICCV Workshops), 2009 IEEE 12th International Conference, pp. 939–946. IEEE (2009)

  31. Quinsat, Y.: Filling holes in digitized point cloud using a morphing-based approach to preserve volume characteristics[J]. Int. J. Adv. Manuf. Technol. 81(1–4), 411–421 (2015)

    Article  Google Scholar 

Download references

Acknowledgments

This work is supported by the National Natural Science Foundation of China (No. 61471338), President Fund of UCAS, Youth Innovation Promotion Association CAS (2015361).

Author information

Authors and Affiliations

  1. School of Engineering Science, University of the Chinese Academy and Sciences, Beijing, China

    Xiaoyuan Guo, Jun Xiao & Ying Wang

Authors
  1. Xiaoyuan Guo
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jun Xiao
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ying Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jun Xiao.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Guo, X., Xiao, J. & Wang, Y. A survey on algorithms of hole filling in 3D surface reconstruction. Vis Comput 34, 93–103 (2018). https://doi.org/10.1007/s00371-016-1316-y

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00371-016-1316-y

Keywords

Search

Navigation