Abstract
We present an algorithm to generate a three-dimensional (3-D) oil painting using artistic filters and sample 3-Dstructures. The artistic filter works as a two-dimensional (2-D) rendering technique a for non-photorealistic effect based on the algorithm introduced in [8]. We modified this method to properly work with a 3-Dimage, enhancing the efficiency of the filter as well. The required 3-Dstructure model is obtained from actual brushstroke samples provided by an artist. We employ a photometric stereo technique in constructing a 3-Dmodel for a brushstroke sample, since this method is capable of capturing sophisticated variation details in brushstroke textures. A 3-Doil painting is completed by incorporating the 3-Dmodel to the brushstrokes rendered by the artistic filter. The created image would show a natural illumination change as the position of the light source varies, providing a realistic effect to the image. We can further enhance the study by analyzing a real painting and by directly applying the current algorithm to synthesize a 3-Doil painting in the style of the original real painting.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Agrawal, A., Chellappa, R., Raskar, R.: An algebraic approach to surface reconstruction from gradient fields. In: Proceedings of IEEE International Conference on Computer Vision, pp. 174–181 (2005)
Baxter, W., Wendt, J., Lin, M.C.: IMPasTo: A realistic, interactive model for paint. In: Proceedings of the 2nd Annual Symposium on Non-Photorealistic Animation and Rendering (2004)
Dempster, A., Laird, N., Rubin, D.: Maximum likelihood estimation from incomplete data. J. Royal Stat. Soc. 39(1), (1977)
Goldman, D.B., Curless, B., Hertzmann, A., Seitz, S.M.: Shape and spatially-varing BRDFs from photometric stereo. In: Proceedings of IEEE International Conference on Computer Vision, pp. 341–348 (2005)
Gonzalez, R.C., Woods, R.E.: Digital Image Processing, 2nd edn. Prentice Hall, Upper Saddle River, New Jersey (2002)
Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision, 2nd edn. Cambridge University Press, Cambridge (2003)
Hays, J., Essa, I.: Image and video based painterly animation. In: Proceedings of the 2nd Annual Symposium on Non-Photorealistic Animation and Rendering (2004)
Hertzmann, A.: Painterly rendering with curved brush strokes of multiple sizes. In: Proceedings of SIGGRAPH, pp. 453–460 (1998)
Hertzmann, A.: Fast Paint Texture. In: Proceedings of the Second Annual Symposium on Non-Photorealistic Animation and Rendering, June (2002)
Hertzmann, A., Jacobs, C.E., Oliver, N., Curless, B., Salesin, D.H.: Image Analogies. In: Proceedings of SIGGRAPH, pp. 327–340 (2001)
Kowalski, M.A., Markosian, L., Northrup, J.D., Bourdev, L., Barzel, R., Holden, L.S., Hughes, J.: Art-based rendering of fur, grass, and trees. In: Proceedings of SIGGRAPH, pp. 433–438 (1999)
Lambert, J.H.: Photometria Sive de Mensura de Gratibus Luminis, Colorum et Umbrae. Eberhard Klett, Augsburg, Germany (1760)
Lee, K.M., Kuo, C.-C.J.: Shape from shading with a generalized reflectance map model. Comput. Vis. Image Underst. 67(2), 143–160 (1997)
Litwinowicz, P.: Processing images and video for an Impressionist effect. In: Proceedings of SIGGRAPH, pp. 407–414 (1997)
Nayar, S.K., Ikeuchi, K., Kanade, T.: Surface reflection: physical and geometric perspectives. IEEE Trans. Robot. Automat. 6(4), 418–431 (1990)
Nayar, S.K., Oren, M.: Generalization of the Lambertian model and implications for machine vision. Int. J. Comput. Vis. 14, 227–251 (1995)
Nishino, K., Zhang, Z., Ikeuchi, K.: Determining reflectance parameters and illumination distribution from a sparse set of images for view-dependent image synthesis. In: Proceedings of IEEE International Conference on Computer Vision, pp. 599–606 (2001)
Park, B.G., Yun, I.D., Lee, K.M., Lee, S.U.: Generalized photometric stereo for the hybrid reflectance model using N image sequences. In: Proceedings of 13th Workshop on Image Processing and Image Understanding, pp. 555–560 (2001)
Rosales, R., Achan, K., Frey, B.: Unsupervised image translation. In: Proceedings of IEEE International Conference on Computer Vision (2003)
Salisbury, M.P., Wong, M.T., Hughes, J.F., Salesin, D.H.: Orientable textures for image-based pen-and-ink illustration. In: Proceedings of SIGGRAPH, pp. 401–406 (1999)
Solomon, F., Ikeuchi, K.: Extracting the shape and roughness of specular lobe objects using four light photometric stereo. IEEE Trans. Pattern Anal. Mach. Intell. 18(4), 449–454 (1996)
Tagare, H.D., de Figueiredo, R.J.: A theory of photometric stereo for a class of diffuse non-Lambertian surfaces. IEEE Trans. Pattern Anal. Mach. Intell. 13(2), 133–152 (1991)
Wandell, B.: Foundations of Vision. Sinauer Associates, Sunderland, MA (1995)
Woodham, R.J.: Reflectance map technique for analyzing surface defects in metal castings. Massachusetts Institute of Technology AI Lab Technical Report 457, June (1978)
Yedidia, J.S., Freeman, W.T., Weiss, Y.: Understanding belief propagation and its generalizations. In: Exploring Artificial Intelligence in the New Millennium, chap. 8, pp. 239–236 (2003)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Lee, K., Kim, D., Yun, I. et al. Three-dimensional oil painting reconstruction with stroke based rendering. Visual Comput 23, 873–880 (2007). https://doi.org/10.1007/s00371-007-0142-7
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00371-007-0142-7