Abstract
One of the most important goals of interactive computer graphics is to allow a user to freely walk around a virtual recreation of a real environment that looks as real as the world around us. But hand-modeling such a virtual environment is inherently limited and acquiring the scene model using devices also presents challenges. Interactively rendering such a detailed model is beyond the limits of current graphics hardware, but image-based approaches can significantly improve the status quo.
We present an end-to-end system for acquiring highly detailed scans of large real world spaces, consisting of forty to eighty million range and color samples, using a digital camera and laser rangefinder. We explain successful techniques to represent these large data sets as image-based models and present contributions to image-based rendering that allow these models to be rendered in real time on existing graphics hardware without sacrificing the high resolution at which the data sets were acquired.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Besl, P. J. and N. D. McKay. A Method for Registration of 3-D Shapes. IEEE Transactions on Pattern Analysis and Machine Intelligence14(2): 239–256, 1992.
Chen, E. QuickTime VR — An Image-Based Approach to Virtual Environment Navigation. Proc. of SIGGRAPH’ 95, Los Angeles, CA, August, 1995.
Chen, E. and L. Williams. View Interpolation for Image Synthesis. Proc. of SIGGRAPH’ 93, Anaheim, CA, August, 1993.
Curless, B. and M. Levoy. A volumetric method for building complex models from range images. Proc. of SIGGRAPH’ 96, New Orleans, LA, August, 1996.
Debevec, P. E., C. J. Taylor, et al. Modeling and Rendering Architecture from Photographs. Proc. of SIGGRAPH’ 96, New Orleans, LA, August, 1996.
Eberly, D. MAGIC: My Alternate Graphics and Image Code. http://www.magic-sofiware.com, 1998.
El-Hakim, S. F., P. Boulanger, et al. Sensor Based Creation of Indoor Virtual Environment Models. Intl. Conf. on Virtual Systems and MultiMedia — VSMM’97, Geneva, Switzerland, September, 1997.
Eyles, J., S. Molnar, et al. PixelFlow: The Realization. SIGGRAPH/Eurographics Workshop on Graphics Hardware, Los Angeles, CA, August, 1997.
Gortler, S. J., R. Grzeszczuk, et al. The Lumigraph. Proc. of SIGGRAPH’ 96, New Orleans, LA, August, 1996.
Grossman, J. P. and W. Dally. Point Sample Rendering. Proc. of Eurographics Workshop on Rendering, Vienna, Austria, June, 1998.
Haeberli, P. Paint By Numbers: Abstract Image Representations. Proc. of SIGGRAPH’ 90, Dallas, TX, August, 1990.
Larson, G. W. The Holodeck: A Parallel Ray-caching Rendering System. Proc. of Eurographics Workshop on Parallel Graphics and Visualisation, September, 1998.
Laveau, S. and O. Faugeras. 3-D Scene Representation as a Collection of Images and Fundamental Matrices. Proc. of Intl. Conf. on Pattern Recognition, Jerusalem, Israel, 1994.
Levoy, M. and P. Hanrahan. Light field rendering. Proc. of SIGGRAPH’ 96, New Orleans, LA, August, 1996.
Levoy, M. and T. Whitted. The Use of Points as a Display Primitive. Univ. of North Carolina, Computer Science, Technical Report 85-022, 1985.
Mark, B., L. McMillan, et al. Post-Rendering 3D Warping. Proc. of Symposium on Interactive 3D Graphics, Providence, RI, April, 1997.
Max, N. Hierarchical Rendering of Trees from Precomputed Multi-Layer Z-Buffers. Proc. of Eurographics Workshop on Rendering, Porto, Portugal, June, 1996.
McMillan, L. An Image-based Approach to Three-Dimensional Computer Graphics. Univ. of North Carolina, Computer Science, Ph.D. Dissertation, 1997.
McMillan, L. and G. Bishop. Plenoptic Modeling: An Image-Based Rendering System. Proc. of SIGGRAPH’ 95, Los Angeles, CA, August, 1995.
Molnar, S. Efficient Supersampling Antialisasing for High-Performance Architectures. Univ. of North Carolina, Computer Science, Technical Report 91-023, 1991.
Montrym, J. S., D. R. Baum, et al. InifiniteReality: A Real-Time Graphics System. Proc. of SIGGRAPH’ 97, Los Angeles, CA, August, 1997.
Neider, J., T. Davis, et al. OpenGL Programming Guide, Addison Wesley, 1993.
Olano, M. and A. Lastra. A Shading Language on Graphics Hardware: The PixelFlow Shading System. Proc. of SIGGRAPH’ 98, Orlando, FL, July, 1998.
Pulli, K., M. Cohen, et al. View-based Rendering: Visualizing Real Objects from Scanned Range and Color Data. Proc. of Eurographics Workshop on Rendering, St. Etienne, France, June, 1997.
Pulli, K., T. Duchamp, et al. Robust Meshes From Multiple Range Maps. Intl. Conf. on Recent Advances in 3-D Digital Imaging and Modeling, Ottowa, ON, 1997.
Rademacher, P. and G. Bishop. Multiple-Center-of-Projection Images. Proc. of SIGGRAPH’ 98, Orlando, FL, July, 1998.
Rander, P., P. J. Narayanan, et al. Virtualized Reality: Constructing Time-Varying Virtual Worlds from Real World Events. Proc. of IEEE Visualization’ 97, Phoenix, AZ, October, 1997.
Rushmeier, H., F. Bernardini, et al. Acquiring Input for Rendering at Appropriate Levels of Detail: Dgitizing a Pieta. Proc. of Eurographics Workshop on Rendering, June, 1998.
Sara, R., R. Bajcsy, et al. 3-D Data Acquisition and Interpretation for Virtual Reality and Telepresence. Proc. of IEEE Workshop on Computer Vision for Virtual Reality Based Human Communications, Bombay, India, January, 1998.
Sato, Y., M. D. Wheeler, et al. Object Shape and Reflectance Modeling From Observation. Proc. of SIGGRAPH’ 97, Los Angeles, FL, July, 1997.
Seitz, S. M. and K. N. Kutulakos. Plenoptic Image Editing. Proc. of ICCV’98, 1998.
Shade, J., S. Gortler, et al. Layered Depth Images. Proc. of SIGGRAPH’98, Orlando, FL, August, 1998.
Taylor, R. M., W. Robinett, et al. The Nanomanipulator: A Virtual-Reality Interface for a Scanning Tunneling Microscope. Proc. of SIGGRAPH’ 93, Anaheim, CA, August, 1993.
Teller, S. MIT City Scanning Project. http://graphics.lcs.mit.edu/city/city.html, 1998.
Tsai, R. Y. An Efficient and Accurate Camera Calibration Technique for 3D Machine Vision. Proc. of IEEE Conf. on Computer Vision and Pattern Recognition, Miami Beach, FL, 1986.
Turk, G. and M. Levoy. Zippered Polygon Meshes from Range Images. Proc. of SIGGRAPH’ 94, Orlando, FL, August, 1994.
Westover, L. Footprint Evaluation for Volume Rendering. Proc. of SIGGRAPH’ 90, Dallas, TX, August, 1990.
Whitaker, R. T. A Level-Set Approach to 3D Reconstruction from Range Data. Intl. Journal of Computer Vision 29(3): 203–231, 1998.
Yoo, T. S. and J. M. Coggins. Using Statistical Pattern Recognition Techniques to Control Variable Conductance Diffusion. Information Processing in Medical Imaging (Lecture Notes in Computer Science 687). H. H. Barrett and A. F. Gmitro. Berlin, Springer-Verlag: 459–471, 1993.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1999 Springer-Verlag/Wien
About this paper
Cite this paper
McAllister, D.K., Nyland, L., Popescu, V., Lastra, A., McCue, C. (1999). Real-Time Rendering of Real World Environments. In: Lischinski, D., Larson, G.W. (eds) Rendering Techniques’ 99. EGSR 1999. Eurographics. Springer, Vienna. https://doi.org/10.1007/978-3-7091-6809-7_14
Download citation
DOI: https://doi.org/10.1007/978-3-7091-6809-7_14
Published:
Publisher Name: Springer, Vienna
Print ISBN: 978-3-211-83382-7
Online ISBN: 978-3-7091-6809-7
eBook Packages: Springer Book Archive