Skip to main content
Springer Nature Link
Log in

3D Estimation of Isometric Surfaces Using a ToF-Based Approach

  • Conference paper
Advances in Visual Computing (ISVC 2014)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 8888))

Included in the following conference series:

Abstract

This paper addresses the 3D reconstruction of non-rigid surfaces deforming isometrically. In fact, this reconstruction process aims at the estimation of isometric 3D surface. To this end, a ToF camera is used with a conventional monocular camera. The goal is to use the high-resolution images from the RGB camera in combination with the low-resolution depth map to enhance the estimation of non-rigid shapes. We describe how to model an isometric surface by means of a triangular mesh. The ToF sensor provides the depth of feature points, which is subsequently used to obtain the depth of the mesh vertices by means of linear programming-based approach. Given the mesh depth data, a second-order cone programming method is then developed to determine the image points of the mesh vertices. Bundle adjustment is then used to isometrically reconstruct the surfaces. Experimental results show that the proposed approach is robust against noise, generating accurate 3D reconstructions despite the low-resolution of the depth images.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Terzopoulos, D., Platt, J., Barr, A., Fleicher, K.: Elastically deformable models. ACM SIGGRAPH (1987)

    Google Scholar 

  2. Pentland, A., Sclaroff, S.: Closed-form solutions for physically based shape modeling and recognition 13(7), 715–729 (1991)

    Google Scholar 

  3. Xiao, J., Kanade, T.: Uncalibrated perspective reconstruction of deformable structures. In: ICCV (2005)

    Google Scholar 

  4. Bartoli, A., Olsen, S.: A batch algorithm for implicit non-rigid shape and motion recovery. In: ICCV Workshop on Dynamical Vision (2005)

    Google Scholar 

  5. Aans, H., Kahl, F.: Estimation of deformable structure and motion. In: Workshop on Vision and Modelling of Dynamic Scenes, ECCV, Denmark (2002)

    Google Scholar 

  6. Del-Bue, A., Llad, X., Agapito, L.: Non-rigid metric shape and motion recovery from uncalibrated images using priors. In: IEEE Conference on Computer Vision and Pattern Recognition, New York (2006)

    Google Scholar 

  7. Gay-Bellile, V., Perriollat, M., Bartoli, A., Sayd, P.: Image registration by combining thin-plate splines with a 3d morphable model. In: International Conference on Image Processing (2006)

    Google Scholar 

  8. Salzmann, M., Hartley, R., Fua, P.: Convex optimization for deformable surface 3-d tracking. In: IEEE International Conference on Computer Vision (2007)

    Google Scholar 

  9. Gumerov, N., Zandifar, A., Duraiswami, R., Davis, L.S.: Structure of applicable surfaces from single views. In: Pajdla, T., Matas, J(G.) (eds.) ECCV 2004. LNCS, vol. 3023, pp. 482–496. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  10. Prasad, M., Zisserman, A., Fitzgibbon, A.: Single view reconstruction of curved surfaces. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1345–1354 (2006)

    Google Scholar 

  11. Perriollat, M., R., Hartley, B.: Monocular template-based reconstruction of inextensible surfaces. International Journal of Computer Vision (2010)

    Google Scholar 

  12. Salzmann, M., Moreno-Noguer, F., Lepetit, V., Fua, P.: Closed-form solution to non-rigid 3D surface registration. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008, Part IV. LNCS, vol. 5305, pp. 581–594. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  13. Torresani, L., Hertzmann, A., Bregler, C.: Nonrigid structure-from-motion: Estimating shape and motion with hierarchical priors 30(5), 878–892 (2008)

    Google Scholar 

  14. Metaxas, D., Terzopoulos, D.: Constrained deformable superquadrics and nonrigid motion tracking. PAMI 15, 580–591 (1993)

    Article  Google Scholar 

  15. Diebel, J., Thrun, S.: An application of markov random fields to range sensing. In: Proc. NIPS (2005)

    Google Scholar 

  16. Yang, R., Davis, J., Nister, D.: Spatial-depth super resolution for range images. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2007, Minneapolis, MN, pp. 1–8 (2007)

    Google Scholar 

  17. Hosseini, J., Araujo, H.: Structure from motion - tof-aided 3d reconstruction of isometric surfaces. In: ICPRAM, pp. 544–552 (2014)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Institute of Systems and Robotics, Department of Electrical and Computer Engineering, University of Coimbra, Coimbra, Portugal

    S. Jafar Hosseini & Helder Araujo

Authors
  1. S. Jafar Hosseini
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Helder Araujo
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Computer Science and Engineering, University of Nevada at Reno, USA

    George Bebis

  2. NASA Ames Research Center, Moffett Field, CA, USA

    Richard Boyle

  3. Lawrence Berkeley National Laboratory, Berkeley, CA, USA

    Bahram Parvin

  4. Desert Research Institute, Reno, NV, USA

    Darko Koracin

  5. The University of Texas at Dallas, 75080, Richardson, TX, USA

    Ryan McMahan

  6. NextGen Interactions, 27604, Raleigh, NC, USA

    Jason Jerald

  7. Indiana University, 46202, Indianapolis, IN, USA

    Hui Zhang

  8. Microsoft Research, 1 Microsoft Way, 98052, Redmond, WA, USA

    Steven M. Drucker

  9. University of Delaware, 19716-2712, Newark, DE, USA

    Chandra Kambhamettu

  10. Intel Corp., 95054, Sata Clara, CA, USA

    Maha El Choubassi

  11. Computer Graphics and Interactive Media Lab, Department of Computer Science, University of Houston, 77004, Houston, TX, USA

    Zhigang Deng

  12. NVIDIA, 34788, Leesburg, FL, USA

    Mark Carlson

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this paper

Cite this paper

Hosseini, S.J., Araujo, H. (2014). 3D Estimation of Isometric Surfaces Using a ToF-Based Approach. In: Bebis, G., et al. Advances in Visual Computing. ISVC 2014. Lecture Notes in Computer Science, vol 8888. Springer, Cham. https://doi.org/10.1007/978-3-319-14364-4_13

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-14364-4_13

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-14363-7

  • Online ISBN: 978-3-319-14364-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics