Skip to main content
SpringerLink
Log in

3D Facade Reconstruction Using the Fusion of Images and LiDAR: A Review

  • Conference paper
  • First Online:
New Trends in Computer Technologies and Applications (ICS 2018)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1013))

Included in the following conference series:

  • 1413 Accesses

Abstract

Three-dimensional (3D) urban reconstruction becomes increasingly crucial in many application areas, such as entertainment, urban planning, digital mapping. To achieve photorealistic 3D urban reconstruction, the detailed reconstruction of building facades is the key. Light Detection and Ranging (LiDAR) point clouds and images are the two most important data types for 3D urban reconstruction, which are complementary regarding data characteristic. LiDAR scans are sparse and noisy but contain the precise depth data, whereas images can offer the color and high-resolution data but no depth information. In recent years, an increasing number of studies show that the fusion of LiDAR point clouds and images can attain better 3D reconstruction results than a single data type. In this paper, we aim to provide a systematic review of the research in the area of the 3D facade reconstruction based on the fusion of LiDAR and images. The reviewed studies are classified by the different usage of images in the reconstruction process. We hope that this research could help future researchers have a more clear understanding of how existing studies leverage the data in LiDAR scans and images and promote more innovations in this area.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 89.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 119.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Becker, S., Haala, N.: Refinement of building fassades by integrated processing of LIDAR and image data. Int. Arch. Photogrammetry Remote Sens. Spat. Inf. Sci. 36, 7–12 (2007)

    Google Scholar 

  2. Biljecki, F., Stoter, J., Ledoux, H., Zlatanova, S., Çöltekin, A.: Applications of 3D city models: state of the art review. ISPRS Int. J. Geo-Inf. 4(4), 2842–2889 (2015). https://doi.org/10.3390/ijgi4042842

    Article  Google Scholar 

  3. Brenner, C.: Building reconstruction from images and laser scanning. Int. J. Appl. Earth Obs. Geoinf. 6(3), 187–198 (2005). https://doi.org/10.1016/j.jag.2004.10.006

    Article  Google Scholar 

  4. Campbell, J.B., Wynne, R.H.: Introduction to Remote Sensing. Guilford Press, New York (2011)

    Google Scholar 

  5. Edum-Fotwe, K., Shepherd, P., Brown, M., Harper, D., Dinnis, R.: Fast, accurate and sparse, automatic facade reconstruction from unstructured ground laser-scans. In: ACM SIGGRAPH 2016 Posters, SIGGRAPH 2016, pp. 45:1–45:2. ACM, New York (2016). https://doi.org/10.1145/2945078.2945123

  6. Fruh, C., Zakhor, A.: 3D model generation for cities using aerial photographs and ground level laser scans. In: Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2001, vol. 2, p. II, December 2001. https://doi.org/10.1109/CVPR.2001.990921

  7. Haala, N., Kada, M.: An update on automatic 3D building reconstruction. ISPRS J. Photogrammetry Remote Sens. 65(6), 570–580 (2010). https://doi.org/10.1016/j.isprsjprs.2010.09.006

    Article  Google Scholar 

  8. Hohmann, B., Krispel, U., Havemann, S., Fellner, D.: Cityfit-high-quality urban reconstructions by fitting shape grammars to images and derived textured point clouds. In: Proceedings of the 3rd ISPRS International Workshop 3D-ARCH, vol. 2009, p. 3D (2009)

    Google Scholar 

  9. Li, Y., Zheng, Q., Sharf, A., Cohen-Or, D., Chen, B., Mitra, N.J.: 2D–3D fusion for layer decomposition of urban facades. In: 2011 International Conference on Computer Vision, pp. 882–889, November 2011. https://doi.org/10.1109/ICCV.2011.6126329

  10. Liu, L., Stamos, I.: Automatic 3D to 2D registration for the photorealistic rendering of urban scenes. In: 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2005), vol. 2, pp. 137–143, June 2005. https://doi.org/10.1109/CVPR.2005.80

  11. Liu, L., Stamos, I.: A systematic approach for 2D-image to 3D-range registration in urban environments. In: 2007 IEEE 11th International Conference on Computer Vision, pp. 1–8, October 2007. https://doi.org/10.1109/ICCV.2007.4409215

  12. Müller, P., Zeng, G., Wonka, P., Van Gool, L.: Image-based procedural modeling of facades. In: ACM SIGGRAPH 2007 Papers, SIGGRAPH 2007. ACM, New York (2007). https://doi.org/10.1145/1275808.1276484

  13. Musialski, P., Wonka, P., Aliaga, D.G., Wimmer, M., Gool, L., Purgathofer, W.: A survey of urban reconstruction. Comput. Graph. Forum 32(6), 146–177 (2013). https://doi.org/10.1111/cgf.12077

    Article  Google Scholar 

  14. Pu, S., Vosselman, G.: Building facade reconstruction by fusing terrestrial laser points and images. Sensors 9(6), 4525–4542 (2009). https://doi.org/10.3390/s90604525

    Article  Google Scholar 

  15. Sadeghi, F., Arefi, H., Fallah, A., Hahn, M.: 3D building Façade reconstruction using handheld laser scanning data. Int. Arch. Photogrammetry Remote Sens. Spat. Inf. Sci. 40 (2015). https://doi.org/10.5194/isprsarchives-XL-1-W5-625-2015

    Article  Google Scholar 

  16. Stamos, I., Allen, P.K.: 3-D model construction using range and image data. In: CVPR, p. 1531. IEEE (2000). https://doi.org/10.1109/CVPR.2000.855865

  17. Stamos, I., Allen, P.K.: Automatic registration of 2-D with 3-D imagery in urban environments. In: Proceedings Eighth IEEE International Conference on Computer Vision, ICCV 2001, vol. 2, pp. 731–736, July 2001. https://doi.org/10.1109/ICCV.2001.937699

  18. Wang, J., et al.: Automatic modeling of urban facades from raw lidar point data. Comput. Graph. Forum 35(7), 269–278 (2016). https://doi.org/10.1111/cgf.13024

    Article  Google Scholar 

  19. Wang, R., Peethambaran, J., Chen, D.: Lidar point clouds to 3-D urban models: a review. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 11(2), 606–627 (2018). https://doi.org/10.1109/JSTARS.2017.2781132

    Article  Google Scholar 

  20. Wang, R.: 3D building modeling using images and lidar: a review. Int. J. Image Data Fusion 4(4), 273–292 (2013). https://doi.org/10.1080/19479832.2013.811124

    Article  Google Scholar 

  21. Wang, R., Bach, J., Ferrie, F.P.: Window detection from mobile LIDAR data. In: 2011 IEEE Workshop on Applications of Computer Vision (WACV), pp. 58–65. IEEE (2011)

    Google Scholar 

  22. Xiao, J., Fang, T., Tan, P., Zhao, P., Ofek, E., Quan, L.: Image-based Façade modeling. ACM Trans. Graph. 27(5), 161:1–161:10 (2008). https://doi.org/10.1145/1457515.1409114

    Article  Google Scholar 

  23. Xiao, J., Fang, T., Zhao, P., Lhuillier, M., Quan, L.: Image-based street-side city modeling. ACM Trans. Graph. 28(5), 114:1–114:12 (2009). https://doi.org/10.1145/1661412.1618460

    Article  Google Scholar 

  24. Yang, L., Sheng, Y., Wang, B.: 3D reconstruction of building facade with fused data of terrestrial LIDAR data and optical image. Optik - Int. J. Light Electron Opt. 127(4), 2165–2168 (2016). https://doi.org/10.1016/j.ijleo.2015.11.147

    Article  Google Scholar 

  25. Zhang, J., Lin, X.: Advances in fusion of optical imagery and LiDAR point cloud applied to photogrammetry and remote sensing. Int. J. Image Data Fusion 8(1), 1–31 (2017). https://doi.org/10.1080/19479832.2016.1160960

    Article  MathSciNet  Google Scholar 

  26. Zhao, H., Shibasaki, R.: Reconstructing a textured cad model of an urban environment using vehicle-borne laser range scanners and line cameras. Mach. Vis. Appl. 14(1), 35–41 (2003). https://doi.org/10.1007/s00138-002-0099-5

    Article  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science, The University of Auckland, Auckland, 1010, New Zealand

    Haotian Xu & Chia-Yen Chen

Authors
  1. Haotian Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Chia-Yen Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Haotian Xu .

Editor information

Editors and Affiliations

  1. National Yunlin University of Science and Technology, Douliu, Taiwan

    Chuan-Yu Chang

  2. National Yunlin University of Science and Technology, Douliu, Taiwan

    Chien-Chou Lin

  3. Southern Taiwan University of Science and Technology, Tainan, Taiwan

    Horng-Horng Lin

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Xu, H., Chen, CY. (2019). 3D Facade Reconstruction Using the Fusion of Images and LiDAR: A Review. In: Chang, CY., Lin, CC., Lin, HH. (eds) New Trends in Computer Technologies and Applications. ICS 2018. Communications in Computer and Information Science, vol 1013. Springer, Singapore. https://doi.org/10.1007/978-981-13-9190-3_18

Download citation

  • DOI: https://doi.org/10.1007/978-981-13-9190-3_18

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-13-9189-7

  • Online ISBN: 978-981-13-9190-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation