Skip to main content

Advertisement

Springer Nature Link
Log in

Regularity-constrained point cloud reconstruction of building models via global alignment

  • Original article
  • Published:
The Visual Computer Aims and scope Submit manuscript

Abstract

Recovering the shape of an object from a 3D point cloud is a challenging task due to the complex shapes and diverse requirements of different tasks. For buildings in urban scenes, maintaining geometric constraints such as parallelism, perpendicularity, symmetry, and coplanarity is important during the model fitting process. In this paper, we present a regularity-constrained point cloud reconstruction framework that comprises primitive initialization, constraint construction, and global optimization. Our approach first performs normal optimization and plane segmentation on the input point cloud. We then compute the global reference directions to set the target normal for each plane to construct the constraints. Finally, we obtain the model by globally optimizing the position and orientation of the planes while considering the constraints. Our experimental results demonstrate that our proposed algorithm not only strictly enforces geometric constraints but also closely fits the input point cloud. Furthermore, our framework outperforms state-of-the-art methods in terms of shape recovery and constraint maintenance, as demonstrated by comparative evaluations.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

Data availability

The data that support the findings of this study are available from the author upon reasonable request.

References

  1. Bauchet, J.-P., Lafarge, F.: Kinetic shape reconstruction. ACM Trans. Graph. (TOG) 39(5), 1–14 (2020)

    Article  Google Scholar 

  2. Chen, Z., Ledoux, H., Khademi, S., Nan, L.: Reconstructing compact building models from point clouds using deep implicit fields. ISPRS J. Photogramm. Remote. Sens. 194, 58–73 (2022)

    Article  Google Scholar 

  3. Dalitz, C., Schramke, T., Jeltsch, M.: Iterative Hough transform for line detection in 3D point clouds. Image Process. On Line 7, 184–196 (2017)

    Article  MathSciNet  Google Scholar 

  4. Derpanis, K.G.: Overview of the RANSAC algorithm. Image Rochester NY 4(1), 2–3 (2010)

    Google Scholar 

  5. Erler, P., Guerrero, P., Ohrhallinger, S., Mitra, N.J., Wimmer, M.: Points2surf learning implicit surfaces from point clouds. In: European Conference on Computer Vision, pp. 108–124. Springer (2020)

  6. Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24(6), 381–395 (1981)

  7. Hazewinkel, M.: Orthogonalization. In: Encyclopedia of Mathematics. Kluwer Academic Publishers, New York (2001)

  8. Huang, L.L., Li, W.G., Yang, Q.L., Chen, Y.C.: Segmentation algorithm of three-dimensional point cloud data based on region growing. In: Applied Mechanics and Materials

  9. Hulik, R., Spanel, M., Smrz, P., Materna, Z.: Continuous plane detection in point-cloud data based on 3D Hough transform. J. Vis. Commun. Image Represent. 25(1), 86–97 (2014)

  10. Isack, H., Boykov, Y.: Energy-based geometric multi-model fitting. Int. J. Comput. Vis. 97(2), 123–147 (2012)

    Article  Google Scholar 

  11. Jenke, P., Wand, M., Bokeloh, M., Schilling, A., Straßer, W.: Bayesian point cloud reconstruction. In: Computer Graphics Forum, vol. 25, pp. 379–388. Wiley (2006)

  12. Kazhdan, M., Bolitho, M., Hoppe, H.: Poisson surface reconstruction. In: Proceedings of the Fourth Eurographics Symposium on Geometry Processing, vol. 7 (2006)

  13. Kazhdan, M., Hoppe, H.: Screened poisson surface reconstruction. ACM Trans. Graph. (ToG) 32(3), 1–13 (2013)

    Article  Google Scholar 

  14. Kelly, T., Femiani, J., Wonka, P., Mitra, N.J.: Bigsur: large-scale structured urban reconstruction. ACM Trans. Graph. 36(6) (2017)

  15. Khaloo, A., Lattanzi, D.: Robust normal estimation and region growing segmentation of infrastructure 3D point cloud models. Adv. Eng. Inform. 34, 1–16 (2017)

    Article  Google Scholar 

  16. Korman, S., Litman, R.: Latent RANSAC. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 6693–6702 (2018)

  17. Li, L., Sung, M., Dubrovina, A., Yi, L., Guibas, L.J.: Supervised fitting of geometric primitives to 3d point clouds. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 2652–2660 (2019)

  18. Li, L., Yang, F., Zhu, H., Li, D., Li, Y., Tang, L.: An improved RANSAC for 3D point cloud plane segmentation based on normal distribution transformation cells. Remote Sens. 9(5), 433 (2017)

    Article  Google Scholar 

  19. Li, Y., Wu, X., Chrysanthou, Y., Sharf, A., Cohen-Or, D., Mitra, N.J.: GlobFit: consistently fitting primitives by discovering global relations. ACM Trans. Graph. 30(4), 52:1-52:12 (2011)

    Article  Google Scholar 

  20. Lim, S.P., Haron, H.: Surface reconstruction techniques: a review. Artif. Intell. Rev. 42(1), 59–78 (2014)

    Article  Google Scholar 

  21. Lin, Y., Li, J., Wang, C., Chen, Z., Wang, Z., Li, J.: Fast regularity-constrained plane fitting. ISPRS J. Photogramm. Remote. Sens. 161, 208–217 (2020)

    Article  Google Scholar 

  22. Madsen, K., Nielsen, H.B., Tingleff, O.: Methods for non-linear least squares problems (2004)

  23. Mandikal, P., Radhakrishnan, V.B.: Dense 3d point cloud reconstruction using a deep pyramid network. In: 2019 IEEE Winter Conference on Applications of Computer Vision (WACV), pp. 1052–1060. IEEE (2019)

  24. Monszpart, A., Mellado, N., Brostow, G.J., Mitra, N.J.: RAPter: rebuilding man-made scenes with regular arrangements of planes. ACM Trans. Graph. 34(4), 103:1-103:12 (2015)

    Article  Google Scholar 

  25. Musialski, P., Wonka, P., Aliaga, D.G., Wimmer, M., Van Gool, L., Purgathofer, W.: A survey of urban reconstruction. In: Computer Graphics Forum, vol. 32, pp. 146–177. Wiley Online Library (2013)

  26. Nan, L., Sharf, A., Zhang, H., Cohen-Or, D., Chen, B.: Smartboxes for interactive urban reconstruction. In: ACM SIGGRAPH 2010 papers, pp. 1–10 (2010)

  27. Nan, L., Wonka, P.: Polyfit: polygonal surface reconstruction from point clouds. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2353–2361 (2017)

  28. Oesau, S., Lafarge, F., Alliez, P.: Planar shape detection and regularization in tandem. In: Computer Graphics Forum, vol. 35, pp. 203–215. Wiley Online Library (2016)

  29. Schnabel, R., Wahl, R., Klein, R.: Efficient RANSAC for point-cloud shape detection. In: Computer Graphics Forum, vol. 26, pp. 214–226. Wiley Online Library (2007)

  30. Sharma, G., Liu, D., Maji, S., Kalogerakis, E., Chaudhuri, S., Měch, R.: Parsenet: a parametric surface fitting network for 3d point clouds. In: European Conference on Computer Vision, pp. 261–276. Springer (2020)

  31. Sheung, H., Wang, C.C.: Robust mesh reconstruction from unoriented noisy points. In: 2009 SIAM/ACM Joint Conference on Geometric and Physical Modeling, pp. 13–24 (2009)

  32. Vo, A.-V., Truong-Hong, L., Laefer, D.F., Bertolotto, M.: Octree-based region growing for point cloud segmentation. ISPRS J. Photogramm. Remote. Sens. 104, 88–100 (2015)

    Article  Google Scholar 

  33. Wang, S., Cai, G., Cheng, M., Junior, J.M., Huang, S., Wang, Z., Su, S., Li, J.: Robust 3D reconstruction of building surfaces from point clouds based on structural and closed constraints. ISPRS J. Photogramm. Remote. Sens. 170, 29–44 (2020)

    Article  Google Scholar 

  34. Xu, R., Wang, Z., Dou, Z., Zong, C., Xin, S., Jiang, M., Ju, T., Tu, C.: Rfeps: reconstructing feature-line equipped polygonal surface. ACM Trans. Graph. (TOG) 41(6), 1–15 (2022)

    Google Scholar 

  35. Yan, S., Yang, Z., Ma, C., Huang, H., Vouga, E., Huang, Q.: Hpnet: deep primitive segmentation using hybrid representations. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 2753–2762 (2021)

  36. Yang, M.Y., Förstner, W.: Plane detection in point cloud data. In: Proceedings of the 2nd International Conference on Machine Control Guidance, Bonn, vol. 1, pp. 95–104 (2010)

  37. Zhang, L., Liu, L., Gotsman, C., Huang, H.: Mesh reconstruction by meshless denoising and parameterization. Comput. Graph. 34(3), 198–208 (2010)

    Article  Google Scholar 

Download references

Acknowledgements

The research was supported by National Natural Science Foundation of China (61972327, 62272402), Special Fund for Key Program of Science and Technology of Fujian Province (2022YZ040011), Natural Science Foundation of Fujian Province (2022J01001), and Fundamental Research Funds for the Central Universities (20720220037).

Author information

Authors and Affiliations

  1. School of Mathematical Sciences, Xiamen University, Xiamen, China

    Hang Yu & Juan Cao

  2. School of Informatics, Xiamen University, Xiamen, China

    Xiangrong Liu & Zhonggui Chen

Authors
  1. Hang Yu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Juan Cao
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Xiangrong Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Zhonggui Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zhonggui Chen.

Ethics declarations

Conflict of interest

We declare that we do not have any commercial or associative interest that represents a conflict of interest in connection with the work submitted.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yu, H., Cao, J., Liu, X. et al. Regularity-constrained point cloud reconstruction of building models via global alignment. Vis Comput 40, 8363–8375 (2024). https://doi.org/10.1007/s00371-023-03241-x

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00371-023-03241-x

Keywords

Search

Navigation