Skip to main content
SpringerLink
Log in

3D model reconstruction with common hand-held cameras

  • Original Article
  • Published:
Virtual Reality Aims and scope Submit manuscript

Abstract

A 3D model reconstruction workflow with hand-held cameras is developed. The exterior and interior orientation models combined with the state-of-the-art structure from motion and multi-view stereo techniques are applied to extract dense point cloud and reconstruct 3D model from digital images. An overview of the presented 3D model reconstruction methods is given. The whole procedure including tie point extraction, relative orientation, bundle block adjustment, dense point production and 3D model reconstruction is all reviewed in brief. Among them, we focus on bundle block adjustment procedure; the mathematical and technical details of bundle block adjustment are introduced and discussed. Finally, four scenes of images collected by hand-held cameras are tested in this paper. The preliminary results have shown that sub-pixel (<1 pixel) accuracy can be achieved with the proposed exterior–interior orientation models and satisfactory 3D models can be reconstructed using images collected by hand-held cameras. This work can be applied in indoor navigation, crime scene reconstruction, heritage reservation and other applications in geosciences.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

References

  • Ackermann F (1999) Airborne laser scanning-present status and future expectations. ISPRS J Photogr Remote Sens 54(2):64–67

    Article  Google Scholar 

  • Acute3D (2015) Turn photos into 3D models automatically with Smart3DCapture. http://www.acute3d.com/smart3dcapture/. Last Accessed at 7 Sept 2015

  • Agarwal S, Furukawa Y, Snavely N, Simon I, Curless B, Seitz SM, Szeliski R (2011) Building Rome in a day. Commun ACM 54(10):105–112

    Article  Google Scholar 

  • Agarwal S, Snavely N, Seitz SM et al (2010) Bundle adjustment in the large. In: Computer vision—ECCV 2010. Springer, Berlin. pp 29–42

  • Agisoft (2015) Photoscan. http://www.agisoft.com/. Last Accessed at 7 Sept 2015

  • Arefi H, Engels J, Hahn M, Mayer H (2008) Levels of detail in 3D building reconstruction from LiDAR data. Int Arch Photogr Remote Sens Spat Inf Sci 37(B3b):485–490

    Google Scholar 

  • Baltsavias EP (1999) A comparison between photogrammetry and laser scanning. ISPRS J Photogr Remote Sens 54(2):83–94

    Article  Google Scholar 

  • Bell N, Garland M (2009) Implementing sparse matrix-vector multiplication on throughput-oriented processors. In: Proceedings of the 2009 ACM/IEEE conference on supercomputing, pp 1–11

  • Bru R, MarÍn J, Mas J, Tůma M (2008) Balanced incomplete factorization. SIAM J Sci Comput 30(5):2302–2318

    Article  MathSciNet  MATH  Google Scholar 

  • Bujnak M, Kukelova Z, Pajdla T (2009) 3D reconstruction from image collections with a single known focal length. In: IEEE 12th international conference on computer vision, 2009, pp 1803–1810

  • Byröd M, Åström K (2010) Conjugate gradient bundle adjustment. Lect Notes Comput Sci 6312:114–127

    Article  Google Scholar 

  • Byröd M, Åström K (2009) Bundle adjustment using conjugate gradients with multiscale preconditioning. In: British machine vision conference

  • Chen TI, Zhang YX, Chen LY et al (2014) Integration of LiDAR and camera data for 3D reconstruction. In: IEEE international conference on consumer electronics-Taiwan, pp 93–94

  • Elias M, Kebisek M (2010) An overview of method for 3D model reconstruction from 2D orthoraphic views. In: Proceedings of the 3rd international workshop “innovation in information technologies—theory and practice”, Sept 6th–10th, Dresden, Germany, pp 1–5

  • Eos Software module Inc. (2015) Accurate and affordable 3D modeling—measuring—scanning. http://www.photomodeler.com/index.html. Last Accessed at 7 Sept 2015

  • Furukawa Y, Ponce J (2010) Accurate, dense, and robust multiview stereopsis. IEEE Trans Pattern Anal Mach Intell 32(8):1362–1376

    Article  Google Scholar 

  • García-Gago J, González-Aguilera D, Gómez-Lahoz J et al (2014) A photogrammetric and computer vision-based approach for automated 3D architectural modeling and its typological analysis. Remote Sens 6(6):5671–5691

    Article  Google Scholar 

  • Hestenes MR, Stiefel E (1952) Methods of conjugate gradients for solving linear system. J Res Natl Bureau Stand 49(6):409–436

    Article  MathSciNet  MATH  Google Scholar 

  • Jesse (2015) Open source photogrammetry: ditching 123D catch. http://wedidstuff.heavyimage.com/index.php/2013/07/12/open-source-photogrammetry-workflow/. Last Accessed at 7 Sept 2015

  • Jian YD, Balcan DC, Dellaert F (2011) Generalized subgraph preconditioners for large-scale bundle adjustment. IEEE Int Conf Comput Vis 6669:295–302

    Google Scholar 

  • Jiang T, Luo S, Zhang R (2014) Automatic reconstruction of multi-layer building 3D contour model from airborne LiDAR point clouds. In: ISPRS technical commission I symposium, sustaining land imaging: UAVs to satellites. 17–20 Nov 2014, Denver, Colorado, USA, MTSTC1-9

  • Kato A, Moskal LM, Schiess P et al (2009) Capturing tree crown formation through implicit surface reconstruction using airborne LiDAR data. Remote Sens Environ 113(6):1148–1162

    Article  Google Scholar 

  • Kim C, Habib A (2009) Object-based integration of photogrammetric and LiDAR data for automated generation of complex polyhedral building models. Sensors 9(7):5679–5701

    Article  Google Scholar 

  • Kocaman S, Zhang L, Gruen A, Poli D (2006) 3D city modeling from high-resolution satellite images. In: ISPRS workshop on topographic mapping from space

  • Krasić S, Pejić P (2014) Comparative analysis of terrestrial semi-automatic and automatic photogrammetry in 3D modeling process. Nexus Netw J 16:273–283

    Article  Google Scholar 

  • Li HY, Yang C, Wang Z et al (2012) A hierarchical contour method for automatic 3D city reconstruction from LiDAR data. In: IEEE international geoscience and remote sensing symposium, pp 463–466

  • Lowe D (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60(2):91–110

    Article  Google Scholar 

  • Ma RJ (2004) Building model reconstruction from LiDAR data and aerial photographs. Doctoral Dissertation for the Degree Doctor of Philosophy in the Graduate School of the Ohio State University

  • Martin VL, Nicholas CC, Michael AW (2010) Canopy surface reconstruction from a LiDAR point cloud using hough transform. Remote Sens Lett 1(3):125–132

    Article  Google Scholar 

  • Ozaki M, Tan JK, Kim H et al (2011) 3-D modeling of dynamic remote environment employing the images from cell-phone cameras and a communication network. In: SICE annual conference, 2011 proceedings of IEEE, pp 48–51

  • Park SY, Subbarao M (2004) Automatic 3D model reconstruction based on novel pose estimation and integration techniques. Image Vis Comput 22(8):623–635

    Article  Google Scholar 

  • Park SW, Heo J, Savvides M (2008) 3D face reconstruction from a single 2D face image. In: IEEE computer society conference on computer vision and pattern recognition workshops, pp 1–8

  • Rau JY, Chen LC (2003) Robust reconstruction of building models from three-dimensional line segments. Photogr Eng Remote Sens 69(2):181–188

    Article  Google Scholar 

  • Rothganger F, Lazebnik S, Schmid C et al (2006) 3D object modeling and recognition using local affine-invariant image descriptors and multi-view spatial constraints. Int J Comput Vis 66(3):231–259

    Article  Google Scholar 

  • SimActive Inc. (2015) Simactive announces correlator3D™ version 6.2. http://www.simactive.com/en. Last Accessed at 7 Sept 2015

  • Sohn G, Dowman I (2007) Data fusion of high-resolution satellite imagery and LiDAR data for automatic building extraction. Int J Photogr Remote Sens 62(1):43–63

    Article  Google Scholar 

  • Susaki J (2013) Knowledge-based modeling of buildings in dense urban areas by combining airborne LiDAR Data and aerial images. Remote Sens 5(11):5944–5968

    Article  Google Scholar 

  • Wang Y (2012) A framework for GPU 3D model reconstruction using structure-from-motion. Dissertations & Theses submitted to the Faculty of the Graduate School of the University of Maryland

  • Wu C (2011) Multicore bundle adjustment. In: IEEE conference on computer vision and pattern recognition, pp 3057–3064

  • Yang XY, Strahler AH, Schaaf CB et al (2013) Three-dimensional forest reconstruction and structural parameter retrievals using a terrestrial full-waveform LiDAR instrument. Remote Sens Environ 135:36–51

    Article  Google Scholar 

  • Yu Q, Helmholz P, Belton D et al (2014) Grammar-based automatic 3D model reconstruction from terrestrial laser scanning data. In: The international archives of the photogrammetry, remote sensing and spatial information sciences, XL-4, pp 335–340

  • Zhang KQ, Yan JH, Chen SC (2006) Automatic construction of building footprints from airborne LIDAR data. IEEE Trans Geosci Remote Sens 44(9):2523–2533

    Article  Google Scholar 

  • Zhang Z, Zhang M, Chang Y et al (2013) Real-time 3D model reconstruction and interaction using kinect for a game-based virtual laboratory. In: Proceedings of the ASME 2013 international mechanical engineering congress & exposition, pp 1–8

  • Zheng MT, Zhang YJ, Zhou SP, Zhu JF, Xiong XD (2016) Bundle block adjustment of large-scale remote sensing data with block-based sparse matrix compression combined with preconditioned conjugate gradient. Comput Geosci 92(1):70–78

    Article  Google Scholar 

  • Zhu L (2014) The use of airborne and mobile laser scanning for modeling railway environments in 3D. Remote Sens 6(4):3075–3100

    Article  Google Scholar 

Download references

Acknowledgments

This project is funded by the National Natural Science Foundation of China under grant 41601502 and 41571434, China Postdoctoral Science Foundation under Grant 2015M572224, the Fundamental Research Funds for the Central Universities, China University of Geosciences (Wuhan) under Grant CUG160838, and the Key Laboratory for Aerial Remote Sensing Technology of National Administration of Surveying, Mapping and Geoinformation (NASG) under Grant 2014B01.

Author information

Authors and Affiliations

  1. National Engineering Research Center for Geographic Information System, China University of Geosciences, Wuhan, China

    Maoteng Zheng & Shunping Zhou

  2. Smart Mapping Technology Inc., Beijing, China

    Junfeng Zhu & Xiaodong Xiong

  3. School of Remote Sensing and Information Engineering, Wuhan University, Wuhan, China

    Yongjun Zhang

Authors
  1. Maoteng Zheng
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Junfeng Zhu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Xiaodong Xiong
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Shunping Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Yongjun Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Maoteng Zheng.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zheng, M., Zhu, J., Xiong, X. et al. 3D model reconstruction with common hand-held cameras. Virtual Reality 20, 221–235 (2016). https://doi.org/10.1007/s10055-016-0297-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10055-016-0297-5

Keywords

Search

Navigation