Hendrik P. A. Lensch
Michael Goesele
Skip Abstract Section
Abstract
Real-world objects are usually composed of a number of different materials that often show subtle changes even within a single material. Photorealistic rendering of such objects requires accurate measurements of the reflection properties of each material, as well as the spatially varying effects. We present an image-based measuring method that robustly detects the different materials of real objects and fits an average bidirectional reflectance distribution function (BRDF) to each of them. In order to model local changes as well, we project the measured data for each surface point into a basis formed by the recovered BRDFs leading to a truly spatially varying BRDF representation. Real-world objects often also have fine geometric detail that is not represented in an acquired mesh. To increase the detail, we derive normal maps even for non-Lambertian surfaces using our measured BRDFs. A high quality model of a real object can be generated with relatively little input data. The generated model allows for rendering under arbitrary viewing and lighting conditions and realistically reproduces the appearance of the original object.
- Bernardini, F., Martin, I. M., and Rushmeier, H. 2001. High-quality texture reconstruction from multiple scans. IEEE Trans. Visual. Comput. Graph. 7, 4 (October-November), 318--332. ISSN 1077-2626. Google Scholar
- Boivin, S. and Gagalowicz, A. 2001. Image-based rendering of diffuse, specular and glossy surfaces from a single image. In Proceedings of SIGGRAPH 2001, E. Fiume, Ed. Computer Graphics Proceedings, Annual Conference Series. ACM Press/ACM SIGGRAPH, 107--116. ISBN 1-58113-292-1. Google Scholar
- Dana, K., van Ginneken, B., Nayar, S., and Koenderink, J. 1999. Reflectance and texture of real-world surfaces. ACM Trans. Graph. 18, 1 (January), 1--34. Google Scholar
- Debevec, P., Hawkins, T., Tchou, C., Duiker, H.-P., Sarokin, W., and Sagar, M. 2000. Acquiring the Reflectance Field of a Human Face. In Proceedings of SIGGRAPH. 145--156. ISBN 1-58113-208-5. Google Scholar
- Debevec, P. and Malik, J. 1997. Recovering High Dynamic Range Radiance Maps from Photographs. In Proceedings of SIGGRAPH. 369--378. Google Scholar
- Debevec, P., Taylor, C., and Malik, J. 1996. Modeling and rendering architecture from photographs: A hybrid geometry- and image-based approach. In Proceedings of SIGGRAPH. 11--20. Google Scholar
- Forsyth, D. A. and Zisserman, A. 1989. Mutual Illumination. In Proceedings of Computer Vision and Pattern Recognition (CVPR '89). IEEE Computer Society Press, 466--473.Google Scholar
- Furukawa, R., Kawasaki, H., Ikeuchi, K., and Sakauchi, M. 2002. Appearance based object modeling using texture database: Acquisition compression and rendering. In Thirteenth Eurographics Workshop on Rendering. 267--276. Google Scholar
- Garland, M. and Heckbert, P. 1997. Surface Simplification Using Quadric Error Metrics. In Proceedings of SIGGRAPH (August). 209--216. Google Scholar
- Gersho, A. and Gray, R. 1992. Vector Quantization and Signal Compression. Kluwer Academic Publishers. Google Scholar
- Gibson, S., Howard, T., and Hubbold, R. 2001. Flexible image-based photometric reconstruction using virtual light sources. Comput. Graph. Forum 20, 3. ISSN 1067--7055.Google Scholar
- Goesele, M., Heidrich, W., Lensch, H. P., and Seidel, H.-P. 2000. Building a photo studio for measurement purposes. In Proceedings of Vision, Modeling, and Visualization. 231--238.Google Scholar
- Goesele, M., Heidrich, W., and Seidel, H.-P. 2001. Entropy based dark frame subtraction. In Image Processing, Image Quality, Image Capture Systems Conference (PICS). 293--298.Google Scholar
- Gortler, S., Grzeszczuk, R., Szelinski, R., and Cohen, M. 1996. The Lumigraph. In Proceedings of SIGGRAPH. 43--54. Google Scholar
- Kautz, J. and Seidel, H.-P. August 2000. Towards Interactive Bump Mapping with Anisotropic Shift-Variant BRDFs. In Eurographics/SIGGRAPH Hardware Workshop. 51--58. Google Scholar
- Kobbelt, L. 1996. Discrete fairing. In Proceedings of the 7th IMA Conference on the Mathematics of Surfaces. 101--131.Google Scholar
- Koenderink, J., van Doorn, A., and Stavridi, M. 1996. Bidirectional Reflection Distribution Function expressed in terms of surface scattering modes. In Proceedings of the 4th Europ. Conf. on Computer Vision. 28--39. Google Scholar
- Lafortune, E., Foo, S., Torrance, K., and Greenberg, D. 1997. Non-Linear Approximation of Reflectance Functions. In Proceedings of SIGGRAPH. 117--126. Google Scholar
- Lensch, H., Heidrich, W., and Seidel, H.-P. 2000. Automated Texture Registration and Stitching for Real World Models. In Pacific Graphics '00. 317--326. Google Scholar
- Lensch, H., Heidrich, W., and Seidel, H.-P. 2001a. Silhouette-based algorithm for texture registration and stitching. Graphical Models 63, 4 (July), 245--262. Google Scholar
- Lensch, H. P. A., Kautz, J., Goesele, M., Heidrich, W., and Seidel, H.-P. 2001b. Image-based reconstruction of spatially varying materials. In Rendering Techniques 2001: 12th Eurographics Workshop on Rendering. Eurographics, 103--114. ISBN 3-211-83709-4. Google Scholar
- Levoy, M. and Hanrahan, P. 1996. Light Field Rendering. In Proceedings of SIGGRAPH. 31--42. Google Scholar
- Lewis, R. 1993. Making shaders more physically plausible. In 4th Eurographics Workshop on Rendering. 47--62.Google Scholar
- Liu, X., Yu, Y., and Shum, H.-Y. 2001. Synthesizing bidirectional texture functions for real-world surfaces. In Proceedings of ACM SIGGRAPH 2001. Computer Graphics Proceedings, Annual Conference Series. ACM Press/ACM SIGGRAPH, 97--106. ISBN 1-58113-292-1. Google Scholar
- Lloyd, S. 1982. Least squares quantization in PCM. IEEE Trans. Inform. Theory IT-28, 129--137.Google Scholar
- Lu, R., Koenderink, J., and Kappers, A. 1998. Optical Properties (bidirectional reflectance distribution functions) of velvet. Applied Optics 37, 25 (Sept.), 5974--5984.Google Scholar
- MacQueen, J. 1967. Some methods for classification and analysis of multivariate observations. In Proceedings of the 5th Berkeley Symposium on Mathematical Statistics and Probability. Vol. 1.Google Scholar
- Malzbender, T., Gelb, D., and Wolters, H. 2001. Polynomial texture maps. In Proceedings of ACM SIGGRAPH 2001. Computer Graphics Proceedings, Annual Conference Series. ACM Press/ACM SIGGRAPH, 519--528. ISBN 1-58113-292-1. Google Scholar
- Marschner, S. 1998. Inverse rendering for computer graphics. Ph.D. thesis, Cornell University. Google Scholar
- Marschner, S., Westin, S., Lafortune, E., Torrance, K., and Greenberg, D. 1999. Image-based BRDF Measurement Including Human Skin. In 10th Eurographics Workshop on Rendering. 131--144. Google Scholar
- Matusik, W., Pfister, H., Ngan, A., Beardsley, P., and McMillan, L. 2002a. Image-Based 3D Photography Using Opacity Hulls. In Proceedings of SIGGRAPH. 427--437. Google Scholar
- Matusik, W., Pfister, H., Ziegler, R., Ngan, A., and McMillan, L. 2002b. Acquisition and Rendering of Transparent and Refractive Objects. In Thirteenth Eurographics Workshop on Rendering. 277--288. Google Scholar
- McAllister, D. 2002. A Generalized Representation of Surface Appearance. Ph.D. thesis, University of North Carolina.Google Scholar
- McAllister, D., Lastra, A., and Heidrich, W. 2002. Efficient Rendering of Spatial Bi-directional Reflectance Distribution Functions. In Proceedings of Conference on Graphics Hardware. Google Scholar
- Miller, G., Rubin, S., and Ponceleon, D. 1998. Lazy decompression of surface light fields for precomputed global illumination. In 9th Eurographics Workshop on Rendering. 281--292.Google Scholar
- Nayar, S., Ikeuchi, K., and Kanade, T. 1991. Surface reflection: physical and geometrical perspectives. IEEE Trans. PAMI 13, 7, 611--634. Google Scholar
- Nayar, S. K., Ikeuchi, K., and Kanade, T. 1990. Shape from Interreflections. In International Conference on Computer Vision (ICCV '90). Osaka, Japan, 2--11.Google Scholar
- Press, W., Teukolsky, S., Vetterling, W., and Flannery, B. 1992. Numerical Recipes in C: The Art of Scientific Computing (2nd ed.). Cambridge University Press. ISBN 0-521-43108-5. Google Scholar
- Ramamoorthi, R. and Hanrahan, P. 2001. A signal-processing framework for inverse rendering. In Proceedings of SIGGRAPH 2001, E. Fiume, Ed. Computer Graphics Proceedings, Annual Conference Series. ACM Press/ACM SIGGRAPH, 117--128. ISBN 1-58113-292-1. Google Scholar
- Robertson, M. A., Borman, S., and Stevenson, R. L. 1999. Dynamic Range Improvement Through Multiple Exposures. In Proceedings of the International Conference on Image Processing (ICIP'99). IEEE, 159--163.Google Scholar
- Rushmeier, H., Bernardini, F., Mittleman, J., and Taubin, G. 1998. Acquiring input for rendering at appropriate levels of detail: Digitizing a piet&abrave;. Eurographics Rendering Workshop 1998, 81--92. ISBN 3-211-83213-0. Held in Vienna, Austria.Google Scholar
- Rushmeier, H., Taubin, G., and Guéziec, A. 1997. Applying Shape from Lighting Variation to Bump Map Capture. In 8th Eurographics Workshop on Rendering Workshop. 35--44. Google Scholar
- Sato, Y., Wheeler, M., and Ikeuchi, K. 1997. Object Shape and Reflectance Modeling from Observation. In Proceedings of SIGGRAPH (August). 379--388. Google Scholar
- Schirmacher, H., Heidrich, W., Rubick, M., Schiron, D., and Seidel, H.-P. 1999. Image-Based BRDF Reconstruction. In Proceedings of the 4th VMV Conference. 285--292.Google Scholar
- Torrance, K. and Sparrow, E. 1967. Theory for off-specular reflection from roughened surfaces. J. Optic. Soc. Amer. 57, 9.Google Scholar
- Ward Larson, G. 1992. Measuring and Modeling Anisotropic Reflection. In Proceedings of SIGGRAPH. 265--272. Google Scholar
- Westin, S., Arvo, J., and Torrance, K. 1992. Predicting Reflectance Functions From Complex Surfaces. In Proceedings of SIGGRAPH. 255--264. Google Scholar
- Wood, D., Azuma, D., Aldinger, K., Curless, B., Duchamp, T., Salesin, D., and Stuetzle, W. 2000. Surface Light Fields for 3D Photography. In Proceedings of SIGGRAPH. 287--296. Google Scholar
- Yu, Y., Debevec, P., Malik, J., and Hawkins, T. 1999. Inverse Global Illumination: Recovering Reflectance Models of Real Scenes From Photographs. In Proceedings of SIGGRAPH. 215--224. Google Scholar
- Yu, Y. and Malik, J. July 1998. Recovering Photometric Properties of Architectural Scenes from Photographs. In Proceedings of SIGGRAPH. 207--218. Google Scholar
- Zhang, R., Tsai, P.-S., Cryer, J., and Shah, M. 1999. Shape from Shading: A Survey. IEEE Trans. Pattern Analy. Mach. Intelli. 21, 8 (August), 690--706. Google Scholar
- Zhang, Z. 1999. Flexible Camera Calibration By Viewing a Plane From Unknown Orientations. In Proceedings of the International Conference on Computer Vision. 666--673.Google Scholar
Index Terms
- Image-based reconstruction of spatial appearance and geometric detail
Recommendations
An introduction to image-based 3D surface reconstruction and a survey of photometric stereo methods
This paper provides an introduction to photometric methods for image-based 3D shape reconstruction and a survey of photometric stereo techniques. We begin with taxonomy of active and passive shape acquisition techniques. Then we describe the methodical ...
Reduction of rank-reduced orientation-from-color problem with many unknown lights to two-image known-illuminant photometric stereo
ISCV '95: Proceedings of the International Symposium on Computer VisionHow does shape from shading proceed when two or more differently colored light sources are present? For a uniformly colored Lambertian surface illuminated by a collection of point or extended light sources or inter reflections, with unknown directions ...
Comments