Susan F. te Pas
ABSTRACT
The appearance of objects in natural scenes is determined by their reflectance, their 3D texture, their shape and by the nature of the illumination. Results of previous experiments using computer generated images of spheres with different reflectance modes and under different canonical illuminations suggested that perception of reflectance mode and illumination are basically confounded. In the present study we investigate whether the conclusions from the experiments with simplified rendered spheres can be extended to ecologically valid images. We use two sets of photographs of real spheres, the first set is taken from the Dror Database [Dror et al. 2001], with simple reflectance modes but complex natural illumination (e.g. desklamp, lab, foodcourt). The second set is taken from the Utrecht Oranges Database [Pont and Koenderink 2003], with simple canonical illumination but material consisting of both reflectance and 3D texture differences (e.g. orange, golf ball, christmas decoration).We find that, although to a lesser extent, even in images of complex objects, perception of material and illumination are basically confounded. Overall, illumination and material are confounded most when we present rendered spheres that differ only in reflectance mode under simple canonical illumination conditions. Interestingly, adding complex natural illumination containing higher order angular frequencies helps to disambiguate this confound in material judgments, but not in illumination judgments. Most helpful was the addition of 3D texture.
- Adelson, E. H., and Pentland, A. P. 1996. The perception of shading and reflectance. In D. Knill and W. Richards (Eds.), "Perception as Bayesian inference" (Pp 409--423), Cambridge University Press, New York. Google Scholar
Digital Library
- Adelson, E. H. 2001. On seeing stuff: The perception of materials by humans and machines. In B. E. Rogowitz and T. N. Pappas (Eds.) "Proceedings of the SPIE Vol 4299. Human Vision and Electgronic Imagagin VI" (Pp 1--12).Google Scholar
- Belhumeur, P. N., Kriegman, D., and Yuille, A. 1999. The bas-relief ambiguity. Int. Journal of Computer Vision 35(1), 33--44. Google ScholarDigital Library
- Brainard, D. H. 1997. The psychophysics toolbox. Spatial Vision 10, 433--436.Google ScholarCross Ref
- Dana, K. J., van Ginneken, B., Nayar, S. K., and Koen-Derink, J. J. 1999. Reflectance and texture of real-world surfaces. ACM Transactions on Graphics 18, 1--34. Google ScholarDigital Library
- Dror, R. O., and Willsky, A. 2004. Statistical characterization of real-world illumination. Journal of Vision 4, 821--837.Google ScholarCross Ref
- Dror, R. O., Adelson, E. H., and Willsky, A. S. 2001. Estimating surface reflectance properties from images under unknown illumination. In Proceedings of the SPIE Conference on Human Vision and Electronic Imaging, San Jose, CA.Google Scholar
- Fleming, R. W., Dror, R. O., and Adelson, E. H. 2003. Real-world illumination and the perception of surface reflectance properties. Journal of Vision 3, 347--368.Google ScholarCross Ref
- Gershun, A. 1939. The light field. transl. by p. moon and g. timoshenko. J.Math.Phys. 18(51).Google Scholar
- Gooch, B., and Gooch, A. 2001. Non-Photorealistic Rendering. A. K. Peters Ltd. Publishers. Google ScholarDigital Library
- Koenderink, J. J., and Pont, S. C. 2003. The secret of velvety skin. Machine Vision and Applications; Special Issue on Human Modeling, Analysis and Synthesis 14, 260--268. Google ScholarDigital Library
- Koenderink, J. J., and van Doorn, A. J. 1996. Illuminance texture due to surface mesostructure. JOSA A 13(3), 452--463.Google ScholarCross Ref
- Lambert, J. H. 1760. Photometria Sive de Mensure de Gradibus Luminis, Colorum et Umbræ.Google Scholar
- Meier, B. J. 1996. Painterly rendering for animation. In Proceedings of SIGGRAPH 1996, Computer Graphics Proceedings, Annual Conference Series, ACM. Google ScholarDigital Library
- Oren, M., and Nayar, S. K. 1995. Visual appearance of matte surfaces. Science 267, 1153--1156.Google ScholarCross Ref
- Pelli, D. G. 1997. The videotoolbox software for visual psychophysics: Transforming numbers into movies. Spatial Vision 10, 437--442.Google ScholarCross Ref
- Pont, S. C., and Koenderink, J. J. 2002. Brdf of specular surfaces with hemispherical pits. JOSA A 19(2), 2456--2466.Google ScholarCross Ref
- Pont, S. C., and Koenderink, J. J. 2003. The utrecht oranges set. Technical report and database.Google Scholar
- Pont, S. C., and Koenderink, J. J. 2005. Reflectance from locally glossy thoroughly pitted surfaces. Computer Vision and Image Understanding 98, 211--2222. Google ScholarDigital Library
- Pont, S. C., and Te Pas, S. F. 2005. Material-illumination ambiguities and the perception of solid objects. submitted to Perception.Google Scholar
- Torrance, K. E., Sparrow, E. M., and Birkebak, R. C. 1966. Polarization, directional distribution, and off-specular peak phenomena in light reflected from roughened surfaces. JOSA A 56(7), 916--925.Google ScholarCross Ref
- van Ginneken, B., Stavridi, M., and Koenderink, J. J. 1998. Diffuse and specular reflection from rough surfaces. Applied Optics 37(1), 130--139.Google ScholarCross Ref
Index Terms
- A comparison of material and illumination discrimination performance for real rough, real smooth and computer generated smooth spheres
Recommendations
A signal-processing framework for inverse rendering
SIGGRAPH '01: Proceedings of the 28th annual conference on Computer graphics and interactive techniquesRealism in computer-generated images requires accurate input models for lighting, textures and BRDFs. One of the best ways of obtaining high-quality data is through measurements of scene attributes from real photographs by inverse rendering. However, ...
A Signal-Processing Framework for Inverse Rendering
Seminal Graphics Papers: Pushing the Boundaries, Volume 2Realism in computer-generated images requires accurate input models for lighting, textures and BRDFs. One of the best ways of obtaining high-quality data is through measurements of scene attributes from real photographs by inverse rendering. However, ...
Real-time global illumination using precomputed light field probes
I3D '17: Proceedings of the 21st ACM SIGGRAPH Symposium on Interactive 3D Graphics and GamesWe introduce a new data structure and algorithms that employ it to compute real-time global illumination from static environments. Light field probes encode a scene's full light field and internal visibility. They extend current radiance and irradiance ...
Comments