skip to main content
research-article

Interactive on-surface signal deformation

Published: 26 July 2010 Publication History

Abstract

We present an interactive system for the artistic control of visual phenomena visible on surfaces. Our method allows the user to intuitively reposition shadows, caustics, and indirect illumination using a simple click-and-drag user interface working directly on surfaces. In contrast to previous approaches, the positions of the lights or objects in the scene remain unchanged, enabling localized edits of individual shading components. Our method facilitates the editing by computing a mapping from one surface location to another. Based on this mapping, we can not only edit shadows, caustics, and indirect illumination but also other surface properties, such as color or texture, in a unified way. This is achieved using an intuitive user-interface that allows the user to specify position constraints with drag-and-drop or sketching operations directly on the surface. Our approach requires no explicit surface parametrization and handles scenes with arbitrary topology. We demonstrate the applicability of the approach to interactive editing of shadows, reflections, refractions, textures, caustics, and diffuse indirect light. The effectiveness of the system to achieve an artistic goal is evaluated by a user study.

Supplementary Material

JPG File (tp077-10.jpg)
Supplemental material. (036.zip)
MP4 File (tp077-10.mp4)

References

[1]
Alexa, M., Cohen-Or, D., and Levin, D. 2000. As-rigid-as-possible shape interpolation. In Proc. SIGGRAPH, 157--164.
[2]
Balzer, M., Schlömer, T., and Deussen, O. 2009. Capacity-constrained point distributions: A variant of Lloyd's method. ACM Trans Graph. (Proc. SIGGRAPH) 28, 3, 86:1--8.
[3]
Barzel, R. 1997. Lighting controls for computer cinematography. Journal of Graphics Tools 2, 1, 1--20.
[4]
Birn, J. 2006. Digital Lighting and Rendering, 2nd ed. New Riders Press.
[5]
Botsch, M., and Kobbelt, L. 2004. An intuitive framework for real-time freeform modeling. ACM Trans. Graph. (Proc. SIGGRAPH) 23, 3, 630--634.
[6]
Bronstein, A. M., Bronstein, M. M., Bruckstein, A. M., and Kimmel, R. 2006. Matching two-dimensional articulated shapes using generalized multidimensional scaling. In AMDO, 48--57.
[7]
DeCoro, C., Cole, F., Finkelstein, A., and Rusinkiewicz, S. 2007. Stylized shadows. In Proc. NPAR.
[8]
Hormann, K., Lévy, B., and Sheffer, A., 2007. Mesh parameterization: Theory and practice. ACM SIGGRAPH 2007 Courses.
[9]
Kerr, W. B., and Pellacini, F. 2009. Toward evaluating lighting design interface paradigms for novice users. ACM Trans. Graph. (Proc. SIGGRAPH) 28, 3, 1--9.
[10]
Ko, H.-S., and Breen, D., 2003. Clothing simulation and animation. ACM SIGGRAPH 2003 Courses.
[11]
Kobbelt, L., Campagna, S., Vorsatz, J., and Seidel, H.-P. 1998. Interactive multi-resolution modeling on arbitrary meshes. In SIGGRAPH '98, 105--114.
[12]
Li, H., Adams, B., Guibas, L. J., and Pauly, M. 2009. Robust single-view geometry and motion reconstruction. ACM Trans. Graph. (Proc. SIGGRAPH Asia) 28, 5.
[13]
Lévy, B., and Mallet, J.-L. 1998. Non-distorted texture mapping for sheared triangulated meshes. In Proc. SIGGRAPH, 343--352.
[14]
Müller, M., Heidelberger, B., Teschner, M., and Gross, M. 2005. Meshless deformations based on shape matching. ACM Trans. Graph. (Proc. SIGGRAPH) 24, 3, 471--478.
[15]
Obert, J., Krivánek, J., Pellacini, F., Sýkora, D., and Pattanaik, S. N. 2008. iCheat: A representation for artistic control of indirect cinematic lighting. Computer Graphics Forum (Proc. EGSR) 27, 4, 1217--1223.
[16]
Okabe, M., Matsushita, Y., Shen, L., and Igarashi, T. 2007. Illumination brush: Interactive design of all-frequency lighting. In Proc. Pacific Graphics 2007, 171--180.
[17]
Pellacini, F., Tole, P., and Greenberg, D. P. 2002. A user interface for interactive cinematic shadow design. In ACM Trans. Graph. (Proc. SIGGRAPH), 563--566.
[18]
Poulin, P., and Fournier, A. 1992. Lights from highlights and shadows. In Proc. I3D, 31--38.
[19]
Poulin, P., Ratib, K., and Jacques, M. 1997. Sketching shadows and highlights to position lights. In Proc. CGI, 56--63.
[20]
Ragan-Kelley, J., Kilpatrick, C., Smith, B. W., Epps, D., Green, P., Hery, C., and Durand, F. 2007. The lightspeed automatic interactive lighting preview system. ACM Trans. Graph. (Proc. SIGGRAPH) 26, 3.
[21]
Ritschel, T., Okabe, M., Thormählen, T., and Seidel, H.-P. 2009. Interactive reflection editing. ACM Trans. Graph. (Proc. SIGGRAPH Asia) 28, 5.
[22]
Schmidt, R., Grimm, C., and Wyvill, B. 2006. Interactive decal compositing with discrete exponential maps. ACM Trans. Graph. (Proc. SIGGRAPH) 25, 3, 605--613.
[23]
Schoeneman, C., Dorsey, J., Smits, B., Arvo, J., and Greenberg, D. 1993. Painting with light. In SIGGRAPH '93, 143--146.
[24]
Schreiner, J., Asirvatham, A., Praun, E., and Hoppe, H. 2004. Inter-surface mapping. ACM Trans. Graph. (Proc. SIGGRAPH) 23, 3, 870--877.
[25]
Sumner, R. W., Schmid, J., and Pauly, M. 2007. Embedded deformation for shape manipulation. ACM Trans. Graph. (Proc. SIGGRAPH) 26, 3, 80.
[26]
Tabellion, E., and Lamorlette, A. 2004. An approximate global illumination system for computer generated films. ACM Trans. Graph. (Proc. SIGGRAPH) 23, 3, 469--476.
[27]
Todo, H., Anjyo, K.-I., Baxter, W., and Igarashi, T. 2007. Locally controllable stylized shading. ACM Trans. Graph. (Proc. SIGGRAPH) 26, 3, 17.
[28]
Trottenberg, U., Oosterlee, C., and Schuller, A. 2000. Multigrid. Academic Press.
[29]
Tzur, Y., and Tal, A. 2009. Flexistickers: Photogrammetric texture mapping using casual images. ACM Trans. Graph. (Proc. SIGGRAPH) 28, 3, 1--10.
[30]
Zorin, D., Schröder, P., and Sweldens, W. 1997. Interactive multiresolution mesh editing. In SIGGRAPH '97, 259--268.
[31]
Zwicker, M., Pauly, M., Knoll, O., and Gross, M. 2002. Pointshop 3D: An interactive system for point-based surface editing. In Proc. SIGGRAPH, 322--329.

Cited By

View all
  • (2021)Shading Rig: Dynamic Art-directable Stylised Shading for 3D CharactersACM Transactions on Graphics10.1145/346169640:5(1-14)Online publication date: 24-Sep-2021
  • (2019)Global Illumination Shadow LayersComputer Graphics Forum10.1111/cgf.1378138:4(183-191)Online publication date: 30-Jul-2019
  • (2017)Decomposing Single Images for Layered Photo RetouchingComputer Graphics Forum10.1111/cgf.1322036:4(15-25)Online publication date: 1-Jul-2017
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics
ACM Transactions on Graphics  Volume 29, Issue 4
July 2010
942 pages
ISSN:0730-0301
EISSN:1557-7368
DOI:10.1145/1778765
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 July 2010
Published in TOG Volume 29, Issue 4

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. deformation
  2. graphics hardware
  3. intuitive editing
  4. light design
  5. real-time rendering
  6. shadows
  7. texture

Qualifiers

  • Research-article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)4
  • Downloads (Last 6 weeks)1
Reflects downloads up to 13 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2021)Shading Rig: Dynamic Art-directable Stylised Shading for 3D CharactersACM Transactions on Graphics10.1145/346169640:5(1-14)Online publication date: 24-Sep-2021
  • (2019)Global Illumination Shadow LayersComputer Graphics Forum10.1111/cgf.1378138:4(183-191)Online publication date: 30-Jul-2019
  • (2017)Decomposing Single Images for Layered Photo RetouchingComputer Graphics Forum10.1111/cgf.1322036:4(15-25)Online publication date: 1-Jul-2017
  • (2017)RayPortalsThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-015-1163-233:2(129-138)Online publication date: 1-Feb-2017
  • (2016)Advection-based function matching on surfacesProceedings of the Symposium on Geometry Processing10.5555/3061451.3061459(55-64)Online publication date: 20-Jun-2016
  • (2016)Stylized causticsProceedings of the 37th Annual Conference of the European Association for Computer Graphics10.5555/3058909.3058941(243-252)Online publication date: 9-May-2016
  • (2016)Stylized Caustics: Progressive Rendering of Animated CausticsComputer Graphics Forum10.1111/cgf.1282735:2(243-252)Online publication date: 27-May-2016
  • (2016)State of the Art in Artistic Editing of Appearance, Lighting and MaterialComputer Graphics Forum10.1111/cgf.1272135:1(216-233)Online publication date: 1-Feb-2016
  • (2015)Rendering artistic light patternsProceedings of the workshop on Computational Aesthetics10.5555/2811239.2811241(1-13)Online publication date: 20-Jun-2015
  • (2014)Feature-Based Approach for the Interactive Editing of Environmental Lighting EffectsMathematical Progress in Expressive Image Synthesis I10.1007/978-4-431-55007-5_9(63-70)Online publication date: 30-May-2014
  • Show More Cited By

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media