Abstract
This paper presents an automatic image-based approach for converting greyscale images to pencil sketches, in which strokes follow the image features. The algorithm first extracts a dense direction field automatically using Logical/Linear operators which embody the drawing mechanism. Next, a reconstruction approach based on a sampling-and-interpolation scheme is introduced to generate stroke paths from the direction field. Finally, pencil strokes are rendered along the specified paths with consideration of image tone and artificial illumination. As an important application, the technique is applied to render portraits from images with little user interaction. The experimental results demonstrate that the approach can automatically achieve compelling pencil sketches from reference images.
Similar content being viewed by others
References
Veryorka O, Buchanan J. Comprehensive halftoning of 3D scenes.Computer Graphics Forum, EUROGRAPHICS'99, 1999, 18(3): 13–22.
Deussen O, Hiller S. Floating points: A method for computing stipple drawings.Computer Graphics Forum, EUROGRAPHICS'2000, 2000, 19(3): 455–466.
Buchanan J W. Special effects with half-toning.Computer Graphics Forum, EUROGRAPHICS'96, 1996, 15(3): 97–107.
Winkenbach G. Rendering parametric surfaces in pen-and-ink.Computer Graphics, ACM Siggraph'96, 1996, pp. 469–476.
Salisbury M. Scale dependent reproduction of pen-and-ink illustrations.Computer Graphics, ACM Siggraph'96, 1996, pp. 461–468.
Zeleznik R C. SKETCH: An interface for sketching 3D scenes.Computer Graphics, ACM Siggraph'96, 1996, pp. 163–170.
Ostromoukhov V. Digital facial engraving.Computer Graphics, ACM Siggraph'99, 1999, pp. 417–424.
Salisbury M P, Anderson S E, Barzel R, Salesin D H. Interactive pen-and-ink illustration.Computer Graphics, ACM Siggraph'94, 1994, pp. 101–108.
Winkenbach G, Salesin D H. Computer-generated pen-and-ink illustration.Computer Graphics, ACM Siggraph'94, 1994, pp. 91–100.
Curtis C J, Anderson S E, Seims J E, Fleischer K W, Salesin D H. Computer-generated watercolor.Computer Graphics, ACM Siggraph'97, 1997, pp. 421–430.
Aaron Hertzmann. Painterly rendering with curved brush strokes of multiple sizes.Computer Graphics, ACM Siggraph'98, 1998, pp. 453–460.
Meier B J. Walt disney feature animation: Painterly rendering for animation.Computer Graphics, ACM Siggraph'96, 1996, pp. 477–484.
Gregg Kreutz. Problem Solving for Oil Painters. Watson-Guptill Publications, 1986.
Strothotte T, Preim B, Raab A, Schumann J, Forsey D R. How to render frames and influence people.Computer Graphics Forum, 1994, 13(3): 455–466.
Litwinowicz P. Processing images and video for impressionist effect.Computer Graphics, ACM Siggraph'97, 1997, pp. 407–414.
Sousa M C. Observational model of blenders and erasers in computer-generated pencil rendering. InProceedings of Graphics Interface'99, 1999, pp. 157–166.
Sousa M C, Buchanan J W. Observational Models of Graphite Pencil and Drawing Paper for Non-Photorealistic Rendering. In URL: http://www.cs.ualberta.ca/~mario/TR/pencil.ps
Sousa M C, Buchanan J W. Computer-generated graphite pencil rendering of 3D polygonal models.Computer Graphics Forum, EUROGRAPHICS'99, 1999, 18(3): 195–208.
Melissa Hao. Computer-Generated Figure Drawing. In URL: http://www.mit.edu/~mhao/drawing
Shiraishi M, Yamaguchi Y. An algorithm for automatic painterly rendering based on local source image approximation. InProceedings of NPR'2000, 2000, pp. 53–58.
Salibury M P, Wong M T, Hughes J F, Salesin D H. Orientable textures for image-based pen-and-ink illustration.Computer Graphics, ACM Siggraph'97, 1997, pp. 401–406.
Canny J. A computational approach to edge detection.IEEE Transactions on Pattern Analysis and Machine Intelligence, 8(6): 679–698.
Heuckel M H. An operator which locates edges in digital pictures.Journal of Association for Computing Machinery, 1971, 18(3): 113–125.
Jones J P, Palmer L A. An evaluation of the two-dimensional gabor filter model simple receptive fields in cat striate cortex.Journal of Neurophysics, 1987, 58(b): 1233–1258.
Iverson L A, Zucker S W. Logical/Linear Operators for Image Curves. In URL: ftp://ftp.cim.mcgill.ca/pub/people/leei/loglin.tar.gz
Nielson G, Foley T, Hamann B, Lane D. Visualizing and modeling scattered multivariate data.IEEE Computer Graphics and Applications, IEEE Compute. Soc. Press, Los Alamitos CA, May, 1991, 11(3): 47–55.
Kass M, Within A, Terzopoulos D. Snake: Active contour model,International Journal of Computer Vision, 1988, pp. 321–331.
Wong Y Y, Yuen P C, Tong C S. Segmented snake for contour detection.Pattern Recognition, 1998, 31(11): 111–119.
Ostromoukhov V, Hersch R D. Artistic screening.computer Graphics, ACM Siggraph'95, 1995, pp.219–227.
Dooley D, Cohen M. Automatic illustration of 3D geometric models: Lines. InProceedings of 1990 Symposium on Interactive 3D Graphics, 1990, pp. 77–82.
Markosian L, Meier B J, Kowalski M A, Holden L S, Northrup J D, Hughers J F. Art-based rendering with continuous levels of detail. InProceedings of NPR'2000, 2000, pp. 59–66.
Elber G. Line art rendering via a coverage of isoparametric curves.IEEE Transactions on Visualization and Computer Graphics, 1998, 1(3): 231–239.
Whitted T. Anti-aliased line drawing using brush extrusion.Computer Graphics, ACM Siggraph'83, 1983, pp. 151–156.
Lansdown J, Schofield S. Expressive rendering: A review of nonphotorealistic techniques.IEEE Computer Graphics and Applications, 1995, 15(3): 29–37.
Berkel P V. SIAS, strokes interpreted animated sequences.Computer Graphics Forum, 1989, 8(8): 35–45.
Strassmann S. Hairy brushes.Computer Graphics, ACM Siggraph'86, 1986, pp. 225–232.
Hsu S C, Lee I H H. Drawing and animation using skeletal strokes.Computer Graphics, ACM Siggraph'94, 1994, pp. 109–118.
Nothrup J D, Markosian L. Artistic silhouettes: A hybrid approach. InProceedings of NPR, 2000, pp. 31–37.
Girshick A, Interrants V, Haker S, Lemoine T. Line direction matters: An argument for the use of principle direction in 3D line drawing. InProceedings of NPR, 2000, pp. 43–52.
Author information
Authors and Affiliations
Corresponding author
Additional information
The project is supported by the National Natural Science Funds for Distinguished Young Scholars of China (No.69925204) and Innovative Research Groups (No.60021201).
WANG Jin received his M.S. degree in computer application from Zhejiang University in 1999. He is now a Ph.D. candidate at the State Key Lab of CAD&CG at Zhejiang University. His research interests include computer vision, NPR and image processing.
BAO Hujun received his Ph.D. degree from Zhejiang University in 1993. He is now a professor at the university. His main research interests are realtime rendering technique, digital geometry processing and field-based surface modeling.
ZHOU Weihua received his B.S. degree in engineering and communications from Zhejiang University in 1999. His research interests include computer graphics.
PENG Qunsheng received his Ph.D. degree in computer science from East Anglia University in 1983. He is now a professor and the Director of the State Key Lab of CAD&CG at Zhejiang University. His main research interests include realistic image synthesis, 3D modeling and virual reality.
XU Yingqing is a researcher of Microsoft China Research. His main research interests include computer graphics, digital geometry processing and virtual reality.
Rights and permissions
About this article
Cite this article
Wang, J., Bao, H., Zhou, W. et al. Automatic image-based pencil sketch rendering. J. of Comput. Sci. & Technol. 17, 347–355 (2002). https://doi.org/10.1007/BF02947313
Received:
Revised:
Issue Date:
DOI: https://doi.org/10.1007/BF02947313