Skip to main content

Real-Time Rendering of Real World Environments

  • Conference paper
  • First Online:
Rendering Techniques’ 99 (EGSR 1999)

Part of the book series: Eurographics ((EUROGRAPH))

Included in the following conference series:

Abstract

One of the most important goals of interactive computer graphics is to allow a user to freely walk around a virtual recreation of a real environment that looks as real as the world around us. But hand-modeling such a virtual environment is inherently limited and acquiring the scene model using devices also presents challenges. Interactively rendering such a detailed model is beyond the limits of current graphics hardware, but image-based approaches can significantly improve the status quo.

We present an end-to-end system for acquiring highly detailed scans of large real world spaces, consisting of forty to eighty million range and color samples, using a digital camera and laser rangefinder. We explain successful techniques to represent these large data sets as image-based models and present contributions to image-based rendering that allow these models to be rendered in real time on existing graphics hardware without sacrificing the high resolution at which the data sets were acquired.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Besl, P. J. and N. D. McKay. A Method for Registration of 3-D Shapes. IEEE Transactions on Pattern Analysis and Machine Intelligence14(2): 239–256, 1992.

    Article  Google Scholar 

  • Chen, E. QuickTime VR — An Image-Based Approach to Virtual Environment Navigation. Proc. of SIGGRAPH’ 95, Los Angeles, CA, August, 1995.

    Google Scholar 

  • Chen, E. and L. Williams. View Interpolation for Image Synthesis. Proc. of SIGGRAPH’ 93, Anaheim, CA, August, 1993.

    Google Scholar 

  • Curless, B. and M. Levoy. A volumetric method for building complex models from range images. Proc. of SIGGRAPH’ 96, New Orleans, LA, August, 1996.

    Google Scholar 

  • Debevec, P. E., C. J. Taylor, et al. Modeling and Rendering Architecture from Photographs. Proc. of SIGGRAPH’ 96, New Orleans, LA, August, 1996.

    Google Scholar 

  • Eberly, D. MAGIC: My Alternate Graphics and Image Code. http://www.magic-sofiware.com, 1998.

    Google Scholar 

  • El-Hakim, S. F., P. Boulanger, et al. Sensor Based Creation of Indoor Virtual Environment Models. Intl. Conf. on Virtual Systems and MultiMedia — VSMM’97, Geneva, Switzerland, September, 1997.

    Google Scholar 

  • Eyles, J., S. Molnar, et al. PixelFlow: The Realization. SIGGRAPH/Eurographics Workshop on Graphics Hardware, Los Angeles, CA, August, 1997.

    Google Scholar 

  • Gortler, S. J., R. Grzeszczuk, et al. The Lumigraph. Proc. of SIGGRAPH’ 96, New Orleans, LA, August, 1996.

    Google Scholar 

  • Grossman, J. P. and W. Dally. Point Sample Rendering. Proc. of Eurographics Workshop on Rendering, Vienna, Austria, June, 1998.

    Google Scholar 

  • Haeberli, P. Paint By Numbers: Abstract Image Representations. Proc. of SIGGRAPH’ 90, Dallas, TX, August, 1990.

    Google Scholar 

  • Larson, G. W. The Holodeck: A Parallel Ray-caching Rendering System. Proc. of Eurographics Workshop on Parallel Graphics and Visualisation, September, 1998.

    Google Scholar 

  • Laveau, S. and O. Faugeras. 3-D Scene Representation as a Collection of Images and Fundamental Matrices. Proc. of Intl. Conf. on Pattern Recognition, Jerusalem, Israel, 1994.

    Google Scholar 

  • Levoy, M. and P. Hanrahan. Light field rendering. Proc. of SIGGRAPH’ 96, New Orleans, LA, August, 1996.

    Google Scholar 

  • Levoy, M. and T. Whitted. The Use of Points as a Display Primitive. Univ. of North Carolina, Computer Science, Technical Report 85-022, 1985.

    Google Scholar 

  • Mark, B., L. McMillan, et al. Post-Rendering 3D Warping. Proc. of Symposium on Interactive 3D Graphics, Providence, RI, April, 1997.

    Google Scholar 

  • Max, N. Hierarchical Rendering of Trees from Precomputed Multi-Layer Z-Buffers. Proc. of Eurographics Workshop on Rendering, Porto, Portugal, June, 1996.

    Google Scholar 

  • McMillan, L. An Image-based Approach to Three-Dimensional Computer Graphics. Univ. of North Carolina, Computer Science, Ph.D. Dissertation, 1997.

    Google Scholar 

  • McMillan, L. and G. Bishop. Plenoptic Modeling: An Image-Based Rendering System. Proc. of SIGGRAPH’ 95, Los Angeles, CA, August, 1995.

    Google Scholar 

  • Molnar, S. Efficient Supersampling Antialisasing for High-Performance Architectures. Univ. of North Carolina, Computer Science, Technical Report 91-023, 1991.

    Google Scholar 

  • Montrym, J. S., D. R. Baum, et al. InifiniteReality: A Real-Time Graphics System. Proc. of SIGGRAPH’ 97, Los Angeles, CA, August, 1997.

    Google Scholar 

  • Neider, J., T. Davis, et al. OpenGL Programming Guide, Addison Wesley, 1993.

    Google Scholar 

  • Olano, M. and A. Lastra. A Shading Language on Graphics Hardware: The PixelFlow Shading System. Proc. of SIGGRAPH’ 98, Orlando, FL, July, 1998.

    Google Scholar 

  • Pulli, K., M. Cohen, et al. View-based Rendering: Visualizing Real Objects from Scanned Range and Color Data. Proc. of Eurographics Workshop on Rendering, St. Etienne, France, June, 1997.

    Google Scholar 

  • Pulli, K., T. Duchamp, et al. Robust Meshes From Multiple Range Maps. Intl. Conf. on Recent Advances in 3-D Digital Imaging and Modeling, Ottowa, ON, 1997.

    Google Scholar 

  • Rademacher, P. and G. Bishop. Multiple-Center-of-Projection Images. Proc. of SIGGRAPH’ 98, Orlando, FL, July, 1998.

    Google Scholar 

  • Rander, P., P. J. Narayanan, et al. Virtualized Reality: Constructing Time-Varying Virtual Worlds from Real World Events. Proc. of IEEE Visualization’ 97, Phoenix, AZ, October, 1997.

    Google Scholar 

  • Rushmeier, H., F. Bernardini, et al. Acquiring Input for Rendering at Appropriate Levels of Detail: Dgitizing a Pieta. Proc. of Eurographics Workshop on Rendering, June, 1998.

    Google Scholar 

  • Sara, R., R. Bajcsy, et al. 3-D Data Acquisition and Interpretation for Virtual Reality and Telepresence. Proc. of IEEE Workshop on Computer Vision for Virtual Reality Based Human Communications, Bombay, India, January, 1998.

    Google Scholar 

  • Sato, Y., M. D. Wheeler, et al. Object Shape and Reflectance Modeling From Observation. Proc. of SIGGRAPH’ 97, Los Angeles, FL, July, 1997.

    Google Scholar 

  • Seitz, S. M. and K. N. Kutulakos. Plenoptic Image Editing. Proc. of ICCV’98, 1998.

    Google Scholar 

  • Shade, J., S. Gortler, et al. Layered Depth Images. Proc. of SIGGRAPH’98, Orlando, FL, August, 1998.

    Google Scholar 

  • Taylor, R. M., W. Robinett, et al. The Nanomanipulator: A Virtual-Reality Interface for a Scanning Tunneling Microscope. Proc. of SIGGRAPH’ 93, Anaheim, CA, August, 1993.

    Google Scholar 

  • Teller, S. MIT City Scanning Project. http://graphics.lcs.mit.edu/city/city.html, 1998.

    Google Scholar 

  • Tsai, R. Y. An Efficient and Accurate Camera Calibration Technique for 3D Machine Vision. Proc. of IEEE Conf. on Computer Vision and Pattern Recognition, Miami Beach, FL, 1986.

    Google Scholar 

  • Turk, G. and M. Levoy. Zippered Polygon Meshes from Range Images. Proc. of SIGGRAPH’ 94, Orlando, FL, August, 1994.

    Google Scholar 

  • Westover, L. Footprint Evaluation for Volume Rendering. Proc. of SIGGRAPH’ 90, Dallas, TX, August, 1990.

    Google Scholar 

  • Whitaker, R. T. A Level-Set Approach to 3D Reconstruction from Range Data. Intl. Journal of Computer Vision 29(3): 203–231, 1998.

    Article  Google Scholar 

  • Yoo, T. S. and J. M. Coggins. Using Statistical Pattern Recognition Techniques to Control Variable Conductance Diffusion. Information Processing in Medical Imaging (Lecture Notes in Computer Science 687). H. H. Barrett and A. F. Gmitro. Berlin, Springer-Verlag: 459–471, 1993.

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 1999 Springer-Verlag/Wien

About this paper

Cite this paper

McAllister, D.K., Nyland, L., Popescu, V., Lastra, A., McCue, C. (1999). Real-Time Rendering of Real World Environments. In: Lischinski, D., Larson, G.W. (eds) Rendering Techniques’ 99. EGSR 1999. Eurographics. Springer, Vienna. https://doi.org/10.1007/978-3-7091-6809-7_14

Download citation

  • DOI: https://doi.org/10.1007/978-3-7091-6809-7_14

  • Published:

  • Publisher Name: Springer, Vienna

  • Print ISBN: 978-3-211-83382-7

  • Online ISBN: 978-3-7091-6809-7

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics