Allison W. Klein
ABSTRACT
We present a new set of non-photorealistic rendering (NPR) tools for processing video. Our approach is to treat the video as a space-time volume of image data. Previous tools to process video for an impressionist effect have painted collections of two-dimensional strokes on each successive frame of video. In contrast, we create a set of "rendering solids." Each rendering solid is a function defined over an interval of time; when evaluated at a particular time within that interval, it provides parameters necessary for rendering an NPR primitive. Rendering solids can be rendered interactively, giving immediate feedback to an artist along with the ability to modify styles in real time.Benefits of our approach include: a more unified treatment of the video volume's spatial and temporal dimensions; interactive, aesthetic flexibility and control; and the extension of stylized rendering techniques for video beyond the impressionist styles previously explored. We show example styles inspired by impressionist, cubist, and abstract art of the past century.
- R. C. Bolles, H. H. Baker, and D. H. Marimont. Epipolar-plane image analysis: An approach to determining structure from motion. International Journal of Computer Vision, 1(1):7-55, 1987.Google Scholar
Cross Ref
- F. C. Crow. Summed-area tables for texture mapping. Computer Graphics (Proceedings of SIGGRAPH 84), 18(3):207-212, 1984. Google ScholarDigital Library
- C. J. Curtis, S. E. Anderson, J. E. Seims, K. W. Fleischer, and D. H. Salesin. Computer-generated watercolor. Computer Graphics (Proceedings of SIGGRAPH 97), 31:421-430, 1997. Google ScholarDigital Library
- O. Faugeras. Three-Dimensional Computer Vision: A Geometric Viewpoint. MIT Press, Cambridge, Massachusetts, 1993. Google ScholarDigital Library
- S. S. Fels and K. Mase. Techniques for interactive video cubism. In Proceedings of ACM Multimedia, pages 368-370, Oct 2000. Google ScholarDigital Library
- S. J. Gortler, R. Grzeszczuk, R. Szeliski, and M. F. Cohen. The lumigraph. Computer Graphics (Proceedings of SIGGRAPH 96), 30:43-54, 1996. Google ScholarDigital Library
- L. Guibas and J. Stolfi. Primitives for the manipulation of general subdivisions and computation of voronoi diagrams. ACM Transactions on Graphics, 4(2):74-123, April 1985. Google ScholarDigital Library
- P. E. Haeberli. Paint by numbers: Abstract image representations. Computer Graphics (Proceedings of SIGGRAPH 90), 24:207-214, 1990. Google ScholarDigital Library
- A. Hertzmann. Painterly rendering with curved brush strokes of multiple sizes. Computer Graphics (Proceedings of SIGGRAPH 98), 32:453-460, 1998. Google ScholarDigital Library
- A. Hertzmann and K. Perlin. Painterly rendering for video and interaction. Computer Graphics (Proceedings of NPAR 2000), pages 7-12. Google ScholarDigital Library
- K. E. Hoff III, J. Keyser, M. Lin, D. Manocha, and T. Culver. Fast computation of generalized Voronoi diagrams using graphics hardware. Computer Graphics (Proceedings of SIGGRAPH 99), 33:277-286, 1999. Google ScholarDigital Library
- B. Jobard and W. Lefer. Creating evenly-spaced streamlines of arbitrary density. Proceedings of Eighth Eurographics Workshop on Visualization in Scientific Computing, April 1997.Google ScholarCross Ref
- M. Levoy and P. Hanrahan. Light field rendering. Computer Graphics (Proceedings of SIGGRAPH 96), 30:31-42, 1996. Google ScholarDigital Library
- P. Litwinowicz. Processing images and video for an impressionist effect. Computer Graphics (Proceedings of SIGGRAPH 97), 31:407-414, 1997. Google ScholarDigital Library
- V. Ostromoukhov. Digital facial engraving. Computer Graphics (Proceedings of SIGGRAPH 99), 33:417-424, 1999. Google ScholarDigital Library
- P. Rademacher and G. Bishop. Multiple-center-of-projection images. Computer Graphics (Proceedings of SIGGRAPH 98), 32:199-206, 1998. Google ScholarDigital Library
- M. P. Salisbury, M. T. Wong, J. F. Hughes, and D. H. Salesin. Orientable textures for image-based pen-and-ink illustration. Computer Graphics (Proceedings of SIGGRAPH 97), 31:401-406, 1997. Google ScholarDigital Library
- D. N. Wood, A. Finkelstein, J. F. Hughes, C. E. Thayer, and D. H. Salesin. Multiperspective panoramas for cel animation. Computer Graphics (Proceedings of SIGGRAPH 97), 31:243-250, 1997. Google ScholarDigital Library
- Stylized video cubes
Recommendations
Dynamic stylized shading primitives
NPAR '11: Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Non-Photorealistic Animation and RenderingShading appearance in illustrations, comics and graphic novels is designed to convey illumination, material and surface shape characteristics at once. Moreover, shading may vary depending on different configurations of surface distance, lighting, ...
Stylized shadows
NPAR '07: Proceedings of the 5th international symposium on Non-photorealistic animation and renderingWhile much research has focused on rendering physically-correct shadows, a "correct" shadow often exhibits unnecessary detail that distracts from the primary subject of the scene. Artists often prefer to have creative control over the rendered ...
Partial visibility for stylized lines
NPAR '08: Proceedings of the 6th international symposium on Non-photorealistic animation and renderingA variety of non-photorealistic rendering styles include lines extracted from 3D models. Conventional visibility algorithms make a binary decision for each line fragment, usually by a depth test against the polygons of the model. This binary visibility ...
Comments