skip to main content
10.1145/2491832.2491834acmconferencesArticle/Chapter ViewAbstractPublication PagessiggraphConference Proceedingsconference-collections
research-article

An interactive system for set reconstruction from multiple input sources

Published: 20 July 2013 Publication History

Abstract

Visual effects pipelines typically require accurate set and environment geometry. However, the type and quality of data obtained on set during production are typically outside the control of the post-production visual effects crew. We present a photogrammetry system which is flexible with respect to input data, and with respect to the specific needs of a shot. Geometry can be reconstructed from a set of input images, which can include a combination of perspective images and spherical images. Direct geometry inputs (e.g. LIDAR scans or Kinect depth maps) can also be integrated into the reconstruction. Alternatively, a pre-existing model can be refined to conform to input imagery, preserving mesh topology if desired, or adaptively re-meshed according to local detail. This process can be guided interactively, to efficiently produce satisfactory geometry though the form and quality of input data may vary.

Supplementary Material

JPG File (p21-smirnov.jpg)
MP4 File (p21-smirnov.mp4)

References

[1]
Acute3D, 2013. http://www.acute3d.com/.
[2]
Artec, 2013. http://www.artec3d.com/.
[3]
Autodesk, 2013. http://www.123dapp.com/catch.
[4]
Bastian, J., Ward, B., Hill, R., van den Hengel, A., and Dick, A. 2010. Interactive modelling for ar applications. In Mixed and Augmented Reality (ISMAR), 2010 9th IEEE International Symposium on, 199--205.
[5]
Botsch, M., Pauly, M., Kobbelt, L., Alliez, P., Lévy, B., Bischoff, S., and Rössl, C. 2007. Geometric modeling based on polygonal meshes. In ACM SIGGRAPH 2007 Courses, ACM, New York, NY, USA, SIGGRAPH '07.
[6]
Brox, T., Bruhn, A., Papenberg, N., and Weickert, J. 2004. High accuracy optical flow estimation based on a theory for warping. In Computer Vision-ECCV 2004. Springer, 25--36.
[7]
Bruhn, A., Weickert, J., Feddern, C., Kohlberger, T., and Schnorr, C. 2005. Variational optical flow computation in real time. Trans. Img. Proc. 14, 5 (May), 608--615.
[8]
Chen, J., Bautembach, D., and Izadi, S. 2013. Scalable Live Volumetric Surface Reconstruction. ACM Transactions on Graphics (Proceedings of SIGGRAPH).
[9]
Curless, B., and Levoy, M. 1996. A volumetric method for building complex models from range images. In Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, ACM, New York, NY, USA, SIGGRAPH '96, 303--312.
[10]
Debevec, P. E., Taylor, C. J., and Malik, J. 1996. Modeling and rendering architecture from photographs: a hybrid geometry- and image-based approach. In Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, ACM, New York, NY, USA, SIGGRAPH '96, 11--20.
[11]
Debevec, P. 1998. Rendering synthetic objects into real scenes: bridging traditional and image-based graphics with global illumination and high dynamic range photography. In Proceedings of the 25th annual conference on Computer graphics and interactive techniques, ACM, New York, NY, USA, SIGGRAPH '98, 189--198.
[12]
Du, H., Henry, P., Ren, X., Cheng, M., Goldman, D. B., Seitz, S. M., and Fox, D. 2011. Interactive 3d modeling of indoor environments with a consumer depth camera. In Proceedings of the 13th international conference on Ubiquitous computing, ACM, New York, NY, USA, UbiComp '11, 75--84.
[13]
Enwaii, 2013. http://www.banzai-pipeline.com/home.html.
[14]
Furukawa, Y., and Ponce, J. 2007. Accurate, dense, and robust multi-view stereopsis. In Computer Vision and Pattern Recognition, 2007. CVPR '07. IEEE Conference on, 1--8.
[15]
Hoppe, H., DeRose, T., Duchamp, T., McDonald, J., and Stuetzle, W. 1992. Surface reconstruction from unorganized points. In Proceedings of the 19th annual conference on Computer graphics and interactive techniques, ACM, New York, NY, USA, SIGGRAPH '92, 71--78.
[16]
Izadi, S., Kim, D., Hilliges, O., Molyneaux, D., Newcombe, R., Kohli, P., Shotton, J., Hodges, S., Freeman, D., Davison, A., and Fitzgibbon, A. 2011. Kinect-fusion: real-time 3d reconstruction and interaction using a moving depth camera. In Proceedings of the 24th annual ACM symposium on User interface software and technology, ACM, New York, NY, USA, UIST '11, 559--568.
[17]
Kazhdan, M., Bolitho, M., and Hoppe, H. 2006. Poisson surface reconstruction. In Proceedings of the fourth Eurographics symposium on Geometry processing, Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, SGP '06, 61--70.
[18]
Lowe, D. G. 2004. Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vision 60, 2 (Nov.), 91--110.
[19]
Moons, T., Van Gool, L., and Vergauwen, M. 2010. 3d reconstruction from multiple images part 1: Principles. Found. Trends. Comput. Graph. Vis. 4, 4 (Apr.), 287--404.
[20]
Newcombe, R. A., and Davison, A. 2010. Live dense reconstruction with a single moving camera. In Computer Vision and Pattern Recognition (CVPR), 2010 IEEE Conference on, 1498--1505.
[21]
Ohtake, Y., Belyaev, A., and Seidel, H.-P. 2003. A multi-scale approach to 3d scattered data interpolation with compactly supported basis functions. In Proceedings of the Shape Modeling International 2003, IEEE Computer Society, Washington, DC, USA, SMI '03, 292--.
[22]
Okun, J. A., and Zwerman, S. 2010. The VES Handbook of Visual Effects: Industry Standard VFX Practices and Procedures. Focal Press.
[23]
Panorama Tools, 2013. http://panotools.sourceforge.net.
[24]
PFTrack, 2013. http://www.thepixelfarm.co.uk.
[25]
Seitz, S., Curless, B., Diebel, J., Scharstein, D., and Szeliski, R. 2006. A comparison and evaluation of multi-view stereo reconstruction algorithms. In Computer Vision and Pattern Recognition, 2006 IEEE Computer Society Conference on, vol. 1, 519--528.
[26]
Shi, J., and Tomasi, C. 1994. Good features to track. In Computer Vision and Pattern Recognition, 1994. Proceedings CVPR '94., 1994 IEEE Computer Society Conference on, 593--600.
[27]
Slesareva, N., Bruhn, A., and Weickert, J. 2005. Optic flow goes stereo: A variational method for estimating discontinuity-preserving dense disparity maps. In Pattern Recognition. Springer, 33--40.
[28]
Snavely, N., Seitz, S. M., and Szeliski, R. 2006. Photo tourism: exploring photo collections in 3d. ACM Trans. Graph. 25, 3 (July), 835--846.
[29]
Strecha, C., Von Hansen, W., Van Gool, L., Fua, P., and Thoennessen, U. 2008. On benchmarking camera calibration and multi-view stereo for high resolution imagery. In Computer Vision and Pattern Recognition, 2008. CVPR 2008. IEEE Conference on, 1--8.
[30]
Szeliski, R. 2010. Computer Vision: Algorithms and Applications. Springer.
[31]
Triggs, B., McLauchlan, P. F., Hartley, R. I., and Fitzgibbon, A. W. 2000. Bundle adjustment - a modern synthesis. In Proceedings of the International Workshop on Vision Algorithms: Theory and Practice, Springer-Verlag, London, UK, UK, ICCV '99, 298--372.

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
DigiPro '13: Proceedings of the Symposium on Digital Production
July 2013
52 pages
ISBN:9781450321365
DOI:10.1145/2491832
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 July 2013

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. computer vision
  2. interactive techniques
  3. photogrammetry

Qualifiers

  • Research-article

Conference

DigiPro '13
Sponsor:
DigiPro '13: The Digital Production Symposium
July 20, 2013
California, Anaheim

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 226
    Total Downloads
  • Downloads (Last 12 months)4
  • Downloads (Last 6 weeks)2
Reflects downloads up to 13 Jan 2025

Other Metrics

Citations

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media