Fabio Pellacini
Abstract
Scenes lit with high dynamic range environment maps of real-world environments exhibit all the complex nuances of natural illumination. For applications that need lighting adjustments to the rendered images, editing environment maps directly is still cumbersome. First, designers have to determine which region in the environment map is responsible for the specific lighting feature (e.g. diffuse gradients, highlights and shadows) they desire to edit. Second, determining the parameters of image-editing operations needed to achieve specific changes to the selected lighting feature requires extensive trial-and-error.
This paper presents envyLight, an interactive interface for editing natural illumination that combines an algorithm to select environment map regions, by sketching strokes on lighting features in the rendered image, with a small set of editing operations to quickly adjust the selected feature. The envyLight selection algorithm works well for indoor and outdoor lighting corresponding to rendered images where lighting features vary widely in number, size, contrast and edge blur. Furthermore, envyLight selection is general with respect to material type, from matte to sharp glossy, and the complexity of scenes' shapes. envyLight editing operations allow designers to quickly alter the position, contrast and edge blur of the selected lighting feature and can be keyframed to support animation.
Supplemental Material
Available for Download
This archive contains the following files: - envylight-video.mov: video that illustrates the envylight interface - envylight-hdrimages.zip: her image files for all figures in the paper - envylight-additionaledit.pdf: a collection of additional editing results
- Adobe Systems Inc., 2009. Photoshop CS 4.Google Scholar
- Anrys, F., and Dutré, P. 2004. Image based lighting design. In 4th IASTED International Conference on Visualization, Imaging, and Image Processing.Google Scholar
- Autodesk Inc., 2009. Maya 2009.Google Scholar
- Debevec, P. 1998. Rendering synthetic objects into real scenes: Bridging traditional and image-based graphics with global illumination and high dynamic range photography. In Proceedings of SIGGRAPH 98, 189--198. Google ScholarDigital Library
- Deussen, O., Hanrahan, P. M., Lintermann, B., Mech, R., Pharr, M., and Prusinkiewicz, P. 1998. Realistic modeling and rendering of plant ecosystems. In Proceedings of SIGGRAPH 98, 275--286. Google ScholarDigital Library
- Gleicher, M., and Witkin, A. 1992. Through-the-lens camera control. In Proceedings of SIGGRAPH '92, 331--340. Google ScholarDigital Library
- Kerr, W. B., and Pellacini, F. 2009. Toward evaluating lighting design interface paradigms for novice users. ACM Transactions on Graphics 28, 3 (July), 26:1--26:9. Google ScholarDigital Library
- Lafortune, E. P., and Willems, Y. D. 1994. Using the modified phong reflectance model for physically based rendering. Tech. rep., Katholieke Universiteit Leuven.Google Scholar
- Mohan, A., Tumblin, J., Bodenheimer, B., Grimm, C., and Bailey, R. 2005. Table-top computed lighting for practical digital photography. In Rendering Techniques 2005: 16th Eurographics Workshop on Rendering, 165--172. Google ScholarDigital Library
- Ng, R., Ramamoorthi, R., and Hanrahan, P. 2003. All-frequency shadows using non-linear wavelet lighting approximation. ACM Transactions on Graphics 22, 3 (July), 376--381. Google ScholarDigital Library
- Okabe, M., Matsushita, Y., Shen, L., and Igarashi, T. 2007. Illumination brush: Interactive design of all-frequency lighting. In Proc. of Pacific Graphics, 171--180. Google ScholarDigital Library
- Pellacini, F., and Lawrence, J. 2007. Appwand: Editing measured materials using appearance-driven optimization. ACM Transactions on Graphics 26, 3, 54:1--54:9. Google ScholarDigital Library
- Pellacini, F., Tole, P., and Greenberg, D. P. 2002. A user interface for interactive cinematic shadow design. ACM Transactions on Graphics 21, 3, 563--566. Google ScholarDigital Library
- Pellacini, F., Battaglia, F., Morley, R. K., and Finkelstein, A. 2007. Lighting with paint. ACM Transactions on Graphics 26, 2, 9:1--9:14. Google ScholarDigital Library
- Poulin, P., and Fournier, A. 1992. Lights from highlights and shadows. In SI3D '92: Proceedings of the 1992 symposium on Interactive 3D graphics, 31--38. Google ScholarDigital Library
- Poulin, P., Ratib, K., and Jacques, M. 1997. Sketching shadows and highlights to position lights. In Proceedings of Computer Graphics International 97, 56--63. Google ScholarDigital Library
- Ramamoorthi, R., and Hanrahan, P. 2002. Frequency space environment map rendering. ACM Transactions on Graphics 21, 3 (July), 517--526. Google ScholarDigital Library
- Schoeneman, C., Dorsey, J., Smits, B., Arvo, J., and Greenberg, D. 1993. Painting with light. In Proceedings of SIGGRAPH '93, 143--146. Google ScholarDigital Library
- Sloan, P.-P., Kautz, J., and Snyder, J. 2002. Precomputed radiance transfer for real-time rendering in dynamic, low-frequency lighting environments. ACM Transactions on Graphics 21, 3 (July), 527--536. Google ScholarDigital Library
- Stumpfel, J., Tchou, C., Jones, A., Hawkins, T., Wenger, A., and Debevec, P. 2004. Direct hdr capture of the sun and sky. In Proc. of AFRIGRAPH '04, 145--149. Google ScholarDigital Library
- Tsai, Y.-T., and Shih, Z.-C. 2006. All-frequency precomputed radiance transfer using spherical radial basis functions and clustered tensor approximation. ACM Transactions on Graphics 25, 3 (July), 967--976. Google ScholarDigital Library
- Vlasic, D., Baran, I., Matusik, W., and Popović, J. 2008. Articulated mesh animation from multi-view silhouettes. ACM Transactions on Graphics 27, 3 (Aug.), 97:1--97:9. Google ScholarDigital Library
- Wang, J., Ren, P., Gong, M., Snyder, J., and Guo, B. 2009. All-frequency rendering of dynamic, spatially-varying reflectance. ACM Transactions on Graphics 28, 5 (Dec.). Google ScholarDigital Library
Index Terms
- envyLight: an interface for editing natural illumination
Recommendations
envyLight: an interface for editing natural illumination
SIGGRAPH '10: ACM SIGGRAPH 2010 papersScenes lit with high dynamic range environment maps of real-world environments exhibit all the complex nuances of natural illumination. For applications that need lighting adjustments to the rendered images, editing environment maps directly is still ...
Shape estimation in natural illumination
CVPR '11: Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern RecognitionThe traditional shape-from-shading problem, with a single light source and Lambertian reflectance, is challenging since the constraints implied by the illumination are not sufficient to specify local orientation. Photometric stereo algorithms, a variant ...
Reflectance and Shape Estimation with a Light Field Camera Under Natural Illumination
AbstractReflectance and shape are two important components in visually perceiving the real world. Inferring the reflectance and shape of an object through cameras is a fundamental research topic in the field of computer vision. While three-dimensional ...
Comments