Jonas Unger
ABSTRACT
We present a novel technique for capturing spatially and temporally resolved light probe sequences, and using them for rendering. For this purpose we have designed and built a Real Time Light Probe; a catadioptric imaging system that can capture the full dynamic range of the lighting incident at each point in space at video frame rates, while being moved through a scene. The Real Time Light Probe uses a digital imaging system which we have programmed to capture high quality, photometrically accurate color images with a dynamic range of 10,000,000:1 at 25 frames per second.By tracking the position and orientation of the light probe, it is possible to transform each light probe into a common frame of reference in world coordinates, and map each point in space along the path of motion to a particular frame in the light probe sequence. We demonstrate our technique by rendering synthetic objects illuminated by complex real world lighting, using both traditional image based lighting methods with temporally varying light probe illumination and an extension to handle spatially varying lighting conditions across large objects.
- Adelson, E. H., and Bergen, J. R. 1991. Computational Models of Visual Processing. MIT Press, Cambridge, Mass., ch. 1. The Plenoptic Function and the Elements of Early Vision.Google Scholar
- Blinn, J. F. 1976. Texture and reflection in computer generated images. Communications of the ACM 19, 10 (October), 542--547. Google ScholarDigital Library
- Debevec, P. E., and Malik, J. 1997. Recovering high dynamic range radiance maps from photographs. In SIGGRAPH 97, 369--378. Google ScholarDigital Library
- Debevec, P., Hawkins, T., Tchou, C., Duiker, H.-P., Sarokin, W., and Sagar, M. 2000. Acquiring the reflectance field of a human face. Proceedings of SIGGRAPH 2000 (July), 145--156. Google ScholarDigital Library
- Debevec, P. 1998. Rendering synthetic objects into real scenes: Bridging traditional and image-based graphics with global illumination and high dynamic range photography. In SIGGRAPH 98. Google ScholarDigital Library
- Gortler, S. J., Grzeszczuk, R., Szeliski, R., and Cohen, M. F. 1996. The Lumigraph. In SIGGRAPH 96, 43--54. Google ScholarDigital Library
- Kang, S. B., Uyttendaele, M., Winder, S., and Szeliski, R. 2003. High dynamic range video. ACM Trans. Graph. 22, 3, 319--325. Google ScholarDigital Library
- Krawczyk, G., Goesele, M., and Seidel, H. P. 2005. Photometric calibration of high dynamic range cameras. Tech. Rep. Research Report MPI-I-2005-4-005.Google Scholar
- Levoy, M., and Hanrahan, P. 1996. Light field rendering. In SIGGRAPH 96, 31--42. Google ScholarDigital Library
- Madden, B. C. 1993. Extended intensity range imaging. Tech. rep., GRASP Laboratory, University of Pennsylvania.Google Scholar
- Mann, S., and Picard, R. W. 1995. Being 'undigital' with digital cameras: Extending dynamic range by combining differently exposed pictures. In Proceedings of IS&T 46th annual conference, 422--428.Google Scholar
- Masselus, V., Peers, P., Dutre;, P., and Willems, Y. D. 2003. Relighting with 4d incident light fields. ACM Trans. Graph. 22, 3, 613--620. Google ScholarDigital Library
- Miller, G. S., and Hoffman, C. R. 1984. Illumination and reflection maps: Simulated objects in simulated and real environments. In SIGGRAPH 84 Course Notes for Advanced Computer Graphics Animation.Google Scholar
- Mitsunaga, T., and Nayar, S. 1999. Radiometric Self Calibration. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol. 1, 374--380.Google Scholar
- Nayar, S., and Mitsunaga, T. 2000. High Dynamic Range Imaging: Spatially Varying Pixel Exposures. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol. 1, 472--479.Google Scholar
- Reinhard, E., Ward, G., Pattanaik, S., and Debevec, P. 2006. High Dynamic Range Imaging, Acquisition, Display and Image-Based Lighitng. Morgan Kaufmann, San Francisco, CA. Google ScholarDigital Library
- Robertson, M. A., Borman, S., and Stevenson, R. L. 1999. Dynamic range improvement through multiple exposures. In IEEE International Conference on Image Processing, 159--163.Google Scholar
- Sato, I., Sato, Y., and Ikeuchi, K. 1999. Acquiring a radiance distribution to superimpose virtual objects onto a real scene. IEEE Transactions on Visualization and Computer Graphics 5, 1 (January-March), 1--12. Google ScholarDigital Library
- Swaminathan, R., Grossberg, M. D., and Nayar, S. K. 2006. Non-Single Viewpoint Catadioptric Cameras: Geometry and Analysis. International Journal of Computer Vision 66, 3 (Mar), 211--229. Google ScholarDigital Library
- Unger, J., Wenger, A., Hawkins, T., Gardner, A., and Debevec, P. 2003. Capturing and rendering with incident light fields. In EGRW '03: Proceedings of the 14th Eurographics workshop on Rendering, Eurographics Association, Aire-Ia-Ville, Switzerland, Switzerland, 141--149. Google ScholarDigital Library
- Unger, J., Gustavson, S., Ollila, M., and Johannesson, M. 2004. A real time light probe. In In Proceedings of the 25th Eurographics Annual Conference, vol. Short Papers and Interactive Demos, 17--21.Google Scholar
- Waese, J., and Debevec, P. 2002. A real-time high dynamic range light probe. In Proceedings of the 27th annual conference on Computer graphics and interactive techniques: Conference Abstracts and Applications, ACM Press/Addison-Wesley Publishing Co., 247.Google Scholar
- Ward, G. 1991. Real pixels. Graphics Gems II, 80--83. ISBN 0-12-064481-9. Held in Boston.Google Scholar
Index Terms
- Densely sampled light probe sequences for spatially variant image based lighting
Recommendations
Next generation image based lighting using HDR video
SIGGRAPH '11: ACM SIGGRAPH 2011 TalksWe present an overview of our recently developed systems pipeline for capture, reconstruction, modeling and rendering of real world scenes based on state-of-the-art high dynamic range video (HDRV). The reconstructed scene representation allows for photo-...
Spatially varying image based lighting by light probe sequences: Capture, processing and rendering
AbstractWe present a novel technique for capturing spatially or temporally resolved light probe sequences, and using them for image based lighting. For this purpose we have designed and built a real-time light probe, a catadioptric imaging system that can ...
HDR light probe sequence resampling for realtime incident light field rendering
SCCG '09: Proceedings of the 25th Spring Conference on Computer GraphicsThis paper presents a method for resampling a sequence of high dynamic range light probe images into a representation of Incident Light Field (ILF) illumination which enables realtime rendering. The light probe sequences are captured at varying ...
Comments