skip to main content
article

Adaptive sampling of reflectance fields

Published: 01 June 2007 Publication History

Abstract

Image-based relighting achieves high quality in rendering, but it requires a large number of measurements of the reflectance field. This article discusses sampling techniques that improve on the trade-offs between measurement effort and reconstruction quality.
Specifically, we (i) demonstrate that sampling with point lights and from a sparse set of incoming light directions creates artifacts which can be reduced significantly by employing extended light sources for sampling, (ii) propose a sampling algorithm which incrementally chooses light directions adapted to the properties of the reflectance field being measured, thus capturing significant features faster than fixed-pattern sampling, and (iii) combine reflectance fields from two different light domain resolutions.
We present an automated measurement setup for well-defined angular distributions of the incident, indirect illumination. It is based on programmable spotlights with controlled aperture that illuminate the walls around the scene.

References

[1]
Chai, J.-X., Chan, S.-C., Shum, H.-Y., and Tong, X. 2000. Plenoptic sampling. In Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH'00). ACM Press, New York, NY, 307--318.
[2]
Chuang, Y.-Y., Zongker, D. E., Hindorff, J., Curless, B., Salesin, D. H., and Szeliski, R. 2000. Environment matting extensions: towards higher accuracy and real-time capture. In Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH'00). ACM Press, New York, NY, 121--130.
[3]
Dana, K. J., van Ginneken, B., Nayar, S. K., and Koenderink, J. J. 1999. Reflectance and texture of real-world surfaces. ACM Trans. Graph. 18, 1, 1--34.
[4]
Debevec, P., Hawkins, T., Tchou, C., Duiker, H.-P., Sarokin, W., and Sagar, M. 2000. Acquiring the reflectance field of a human face. In Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH'00). ACM Press, New York, NY, 145--156.
[5]
Einarsson, P., Chabert, C.-F., Jones, A., Ma, W.-C., Lamond, B., Hawkins, T., Bolas, M., Sylwan, S., and Debevec, P. 2006. Relighting human locomotion with flowed reflectance fields. In Proceedings of Eurographics Symposium on Rendering. 183--194.
[6]
Fuchs, M., Blanz, V., and Seidel, H.-P. 2005. Bayesian relighting. In Proceedings of Eurographics Symposium on Rendering. 157--164.
[7]
Garg, G., Talvala, E.-V., Levoy, M., and Lensch, H. P. A. 2006. Symmetric photography: Exploiting data-sparseness in reflectance fields. In Proceedings of Eurographics Symposium on Rendering. 251--262.
[8]
Goldman, D. B. and Chen, J.-H. 2005. Vignette and exposure calibration and compensation. In The 10th IEEE International Conference on Computer Vision. 899--906.
[9]
Hawkins, T., Einarsson, P., and Debevec, P. 2005. A dual light stage. In Proceedings of Eurographics Symposium on Rendering. 91--98.
[10]
Kannala, J. and Brandt, S. 2004. A generic camera calibration method for fish-eye lenses. In Proccedings of the 17th International Conference on Pattern Recognition. IEEE, 10--13.
[11]
Lensch, H. P. A., Lang, J., Sá, A. M., and Seidel, H.-P. 2003. Planned sampling of spatially varying brdfs. Comput. Graph. For. 22, 3 (Sept.), 473--482.
[12]
Levoy, M. and Hanrahan, P. 1996. Light field rendering. In Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH'96). ACM Press, New York, NY, 31--42.
[13]
Lloyd, S. P. 1982. Least squares quantization in PCM. IEEE Trans. Inferr. Theory 28, 128--137.
[14]
Masselus, V., Dutré, P., and Anrys, F. 2002. The free-form light stage. In Proceedings of Eurographics Workshop on Rendering. 247--256.
[15]
Masselus, V., Peers, P., Dutré, P., and Willems, Y. D. 2003. Relighting with 4d incident light fields. ACM Trans. Graph. 22, 3, 613--620.
[16]
Masselus, V., Peers, P., Dutré, P., and Willems, Y. D. 2004. Smooth reconstruction and compact representation of reflectance functions for image-based relighting. In Proceedings of Eurographics Symposium on Rendering. 287--298.
[17]
Matusik, W., Loper, M., and Pfister, H. 2004. Progressively-refined reflectance functions from natural illumination. In Proceedings of Eurographics Symposium on Rendering. 299--308.
[18]
Matusik, W., Pfister, H., Brand, M., and McMillan, L. 2003. Efficient isotropic brdf measurement. In Proceedings of Eurographics Symposium on Rendering. 241--248.
[19]
Matusik, W., Pfister, H., Ngan, A., Beardsley, P., Ziegler, R., and McMillan, L. 2002. Image-based 3d photography using opacity hulls. ACM Trans. Graph. 21, 3, 427--437.
[20]
Mohan, A., Tumblin, J., Bodenheimer, B., Grimm, C., and Bailey, R. 2005. Table-top computed lighting for practical digital photography. In Proceedings of Eurographics Symposium on Rendering. 165--172.
[21]
Peers, P. and Dutré, P. 2003. Wavelet environment matting. In Proceedings of Eurographics Symposium on Rendering. 157--166.
[22]
Peers, P. and Dutré, P. 2005. Inferring reflectance functions from wavelet noise. In Proceedings of Eurographics Symposium on Rendering. 173--182.
[23]
Ramamoorthi, R. and Hanrahan, P. 2001. A signal-processing framework for inverse rendering. In Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques. ACM Press, New York, NY, 117--128.
[24]
Robertson, M. A., Borman, S., and Stevenson, R. L. 2003. Estimation-theoretic approach to dynamic range improvement using multiple exposures. J. Electron. Imag. 12, 2 (April), 219--228.
[25]
Schechner, Y. Y., Nayar, S. K., and Belhumeur, P. N. 2003. A theory of multiplexed illumination. In Proceedings of the 9th IEEE International Conference on Computer Vision (ICCV'03). IEEE Computer Society, 808.
[26]
Schirmacher, H., Heidrich, W., and Seidel, H.-P. 1999. Adaptive acquisition of lumigraphs from synthetic scenes. Comput. Graph. For. 18, 3 (Sept.), 151--160.
[27]
Sen, P., Chen, B., Garg, G., Marschner, S. R., Horowitz, M., Levoy, M., and Lensch, H. P. A. 2005. Dual photography. ACM Trans. Graph. 24, 3 (Aug.), 745--755.
[28]
Shannon, C. E. 1949. Communication in the presence of noise. In Proceedings of IRE. Vol. 37, 10--21.
[29]
Wenger, A., Gardner, A., Tchou, C., Unger, J., Hawkins, T., and Debevec, P. 2005. Performance relighting and reflectance transformation with time-multiplexed illumination. ACM Trans. Graph. 24, 3 (Aug.), 756--764.
[30]
Wexler, Y., Fitzgibbon, A. W., and Zisserman, A. 2002. Image-based environment matting. In Proceedings of Eurographics Workshop on Rendering. 279--290.
[31]
Weyrich, T., Pfister, H., and Gross, M. 2005. Rendering deformable surface reflectance fields. IEEE Trans. Visualiz. Comput. Graph. 11, 1, 48--58.

Cited By

View all
  • (2025)Intelligent Cinematography: a review of AI research for cinematographic productionArtificial Intelligence Review10.1007/s10462-024-11089-358:4Online publication date: 25-Jan-2025
  • (2024)Deep SVBRDF Acquisition and Modelling: A SurveyComputer Graphics Forum10.1111/cgf.1519943:6Online publication date: 16-Sep-2024
  • (2023)Towards Practical Capture of High-Fidelity Relightable AvatarsSIGGRAPH Asia 2023 Conference Papers10.1145/3610548.3618138(1-11)Online publication date: 10-Dec-2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics
ACM Transactions on Graphics  Volume 26, Issue 2
June 07
106 pages
ISSN:0730-0301
EISSN:1557-7368
DOI:10.1145/1243980
Issue’s Table of Contents

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 June 2007
Published in TOG Volume 26, Issue 2

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Image-based relighting
  2. reflectance fields

Qualifiers

  • Article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)15
  • Downloads (Last 6 weeks)4
Reflects downloads up to 13 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2025)Intelligent Cinematography: a review of AI research for cinematographic productionArtificial Intelligence Review10.1007/s10462-024-11089-358:4Online publication date: 25-Jan-2025
  • (2024)Deep SVBRDF Acquisition and Modelling: A SurveyComputer Graphics Forum10.1111/cgf.1519943:6Online publication date: 16-Sep-2024
  • (2023)Towards Practical Capture of High-Fidelity Relightable AvatarsSIGGRAPH Asia 2023 Conference Papers10.1145/3610548.3618138(1-11)Online publication date: 10-Dec-2023
  • (2023)Learning to Learn and Sample BRDFsComputer Graphics Forum10.1111/cgf.1475442:2(201-211)Online publication date: 23-May-2023
  • (2022)Face Illumination Transfer and Swapping via Dense Landmark and Semantic ParsingIEEE Sensors Journal10.1109/JSEN.2020.302591822:18(17391-17398)Online publication date: 15-Sep-2022
  • (2020)X-FieldsACM Transactions on Graphics10.1145/3414685.341782739:6(1-15)Online publication date: 27-Nov-2020
  • (2020)Towards Geometry Guided Neural Relighting with Flash Photography2020 International Conference on 3D Vision (3DV)10.1109/3DV50981.2020.00124(1137-1146)Online publication date: Nov-2020
  • (2018)Deep image-based relighting from optimal sparse samplesACM Transactions on Graphics10.1145/3197517.320131337:4(1-13)Online publication date: 30-Jul-2018
  • (2018)Image-based relighting using image segmentation and bootstrap strategyComputers & Graphics10.1016/j.cag.2018.10.01577(217-226)Online publication date: Dec-2018
  • (2017)Adaptive measurement of anisotropic material appearanceProceedings of the 25th Pacific Conference on Computer Graphics and Applications10.2312/pg.20171316(1-6)Online publication date: 16-Oct-2017
  • Show More Cited By

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media