Forrester Cole
Szymon Rusinkiewicz
Abstract
This paper investigates the ability of sparse line drawings to depict 3D shape. We perform a study in which people are shown an image of one of twelve 3D objects depicted with one of six styles and asked to orient a gauge to coincide with the surface normal at many positions on the object's surface. The normal estimates are compared with each other and with ground truth data provided by a registered 3D surface model to analyze accuracy and precision. The paper describes the design decisions made in collecting a large data set (275,000 gauge measurements) and provides analysis to answer questions about how well people interpret shapes from drawings. Our findings suggest that people interpret certain shapes almost as well from a line drawing as from a shaded image, that current computer graphics line drawing techniques can effectively depict shape and even match the effectiveness of artist's drawings, and that errors in depiction are often localized and can be traced to particular properties of the lines used. The data collected for this study will become a publicly available resource for further studies of this type.
- Agrawala, M., Phan, D., Heiser, J., Haymaker, J., Klingner, J., Hanrahan, P., and Tversky, B. 2003. Designing effective step-by-step assembly instructions. ACM Trans. Graph. 22, 3, 828--837. Google Scholar
Digital Library
- Belhumeur, P. N., Kriegman, D. J., and Yuille, A. L. 1999. The bas-relief ambiguity. Int. Journal of Computer Vision 35, 1, 33--44. Google ScholarDigital Library
- Caniard, F., and Fleming, R. W. 2007. Distortion in 3d shape estimation with changes in illumination. In ACM Applied Perception in Graphics and Visualization (APGV) 2007, 99--105. Google ScholarDigital Library
- Cole, F., Decarlo, D., Finkelstein, A., Kin, K., Morley, K., and Santella, A. 2006. Directing gaze in 3D models with stylized focus. Eurographics Symposium on Rendering (June), 377--387. Google ScholarDigital Library
- Cole, F., Golovinskiy, A., Limpaecher, A., Barros, H. S., Finkelstein, A., Funkhouser, T., and Rusinkiewicz, S. 2008. Where do people draw lines? ACM Trans. Graph. 27, 3. Google ScholarDigital Library
- Debevec, P. 1998. Rendering synthetic objects into real scenes. In SIGGRAPH 1998, 189--198. Google ScholarDigital Library
- DeCarlo, D., and Rusinkiewicz, S. 2007. Highlight lines for conveying shape. In NPAR 2007. Google ScholarDigital Library
- DeCarlo, D., Finkelstein, A., Rusinkiewicz, S., and Santella, A. 2003. Suggestive contours for conveying shape. ACM Trans. Graph. 22, 3, 848--855. Google ScholarDigital Library
- DeCarlo, D., Finkelstein, A., and Rusinkiewicz, S., 2004. Interactive rendering of suggestive contours with temporal coherence. In NPAR 2004, 15--145. Google ScholarDigital Library
- Fleming, R. W., Torralba, A., and Adelson, E. H. 2004. Specular reflections and the perception of shape. Journal of Vision 4, 9, 798--820.Google ScholarCross Ref
- Fulvio, J. M., Singh, M., and Maloney, L. T. 2006. Combining achromatic and chromatic cues to transparency. Journal of Vision 6, 8, 760--776.Google ScholarCross Ref
- Gooch, B., Reinhard, E., and Gooch, A. 2004. Human facial illustrations: Creation and psychophysical evaluation. ACM Trans. Graph. 23, 1, 27--44. Google ScholarDigital Library
- Hertzmann, A., and Zorin, D. 2000. Illustrating smooth surfaces. In Proceedings of SIGGRAPH 2000, 517--526. Google ScholarDigital Library
- Interrante, V., Fuchs, H., and Pizer, S. 1995. Enhancing transparent skin surfaces with ridge and valley lines. In Proceedings of Vis 1995, IEEE Computer Society, 52. Google ScholarDigital Library
- Isenberg, T., Neumann, P., Carpendale, S., Sousa, M. C., and Jorge, J. A. 2006. Non-photorealistic rendering in context: an observational study. In NPAR 2006, 115--126. Google ScholarDigital Library
- Judd, T., Durand, F., and Adelson, E. H. 2007. Apparent ridges for line drawing. ACM Trans. Graph. 26, 3, 19. Google ScholarDigital Library
- Kaplan, M., and Cohen, E. 2006. Producing models from drawings of curved surfaces. In Eurographics Workshop on Sketch-Based Interfaces and Modeling, 51--58. Google ScholarDigital Library
- Koenderink, J. J., van Doorn, A., and Kappers, A. 1992. Surface perception in pictures. Perception and Psychophysics 52, 487--496.Google ScholarCross Ref
- Koenderink, J. J., van Doorn, A., Christou, C., and Lappin, J. 1996. Shape constancy in pictorial relief. Perception 25, 155--164.Google ScholarCross Ref
- Koenderink, J. J., van Doorn, A., Kappers, A. M., and Todd, J. T. 2001. Ambiguity and the 'mental eye' in pictorial relief. Perception 30, 431--448.Google ScholarCross Ref
- Koenderink, J. J. 1984. What does the occluding contour tell us about solid shape? Perception 13, 321--330.Google ScholarCross Ref
- Kolomenkin, M., Shimshoni, I., and Tal, A. 2008. Demarcating curves for shape illustration. ACM Transactions on Graphics 27, 5 (Dec.), 157:1--157:9. Google ScholarDigital Library
- Langer, M. S., and Bülthoff, H. H. 2001. A prior for global convexity in local shape-from-shading. Perception 30, 4, 403--410.Google ScholarCross Ref
- Lee, Y., Markosian, L., Lee, S., and Hughes, J. F. 2007. Line drawings via abstracted shading. ACM Trans. Graph. 26, 3, 18. Google ScholarDigital Library
- Malik, J. 1987. Interpreting line drawings of curved objects. International Journal of Computer Vision 1, 1, 73--103.Google ScholarDigital Library
- Mamassian, P., and Landy, M. S. 1998. Observer biases in the 3d interpretation of line drawings. Vision Research 38.Google Scholar
- Markosian, L., Kowalski, M. A., Goldstein, D., Trychin, S. J., Hughes, J. F., and Bourdev, L. D. 1997. Real-time nonphotorealistic rendering. In Proceedings of SIGGRAPH 1997, 415--420. Google ScholarDigital Library
- Mitchell, J. L., Francke, M., and Eng, D. 2007. Illustrative rendering in Team Fortress 2. In NPAR 2007, 19--32. Google ScholarDigital Library
- Ohtake, Y., Belyaev, A., and Seidel, H.-P. 2004. Ridgevalley lines on meshes via implicit surface fitting. ACM Trans. Graph. 23, 3. Google ScholarDigital Library
- O'Shea, J. P., Banks, M. S., and Agrawala, M. 2008. The assumed light direction for perceiving shape from shading. In ACM Applied Perception in Graphics and Visualization (APGV) 2008, 135--142. Google ScholarDigital Library
- Pauly, M., Keiser, R., and Gross, M. 2003. Multi-scale feature extraction on point-sampled surfaces. Computer Graphics Forum 22, 3 (Sept.), 281--290.Google ScholarCross Ref
- Phillips, F., Todd, J. T., Koenderink, J. J., and Kappers, A. M. 2003. Perceptual representation of visible surfaces. Perception and Psychophysics 65, 5, 747--762.Google ScholarCross Ref
- Saito, T., and Takahashi, T. 1990. Comprehensible rendering of 3-d shapes. In SIGGRAPH 1990, 197--206. Google ScholarDigital Library
- Santella, A., and DeCarlo, D. 2004. Visual interest and NPR: an evaluation and manifesto. In NPAR 2004, 71--78. Google ScholarDigital Library
- Thirion, J.-P., and Gourdon, A. 1996. The 3d marching lines algorithm. Graphical Models and Image Processing 58, 6. Google ScholarDigital Library
- Todd, J. T., Koenderink, J. J., van Doorn, A. J., and Kappers, A. M. 1996. Effects of changing viewing conditions on the perceived structure of smoothly curved surfaces. Journal of Experimental Psychology: Human Perception and Performance 22, 695--706.Google ScholarCross Ref
- Wallraven, C., Bülthoff, H. H., Cunningham, D. W., Fischer, J., and Bartz, D. 2007. Evaluation of real-world and computer-generated stylized facial expressions. ACM Trans. Appl. Percept. 4, 3, 16. Google ScholarDigital Library
- Waltz, D. L. 1975. Understanding line drawings of scenes with shadows. In The Psychology of Computer Vision, P. Winston, Ed. McGraw-Hill, 19--92.Google Scholar
- Willats, J. 1997. Art and Representation: New Principles in the Analysis of Pictures. Princeton University Press.Google Scholar
- Winnemöller, H., Feng, D., Gooch, B., and Suzuki, S. 2007. Using NPR to evaluate perceptual shape cues in dynamic environments. In NPAR 2007, 85--92. Google ScholarDigital Library
Index Terms
- How well do line drawings depict shape?
Recommendations
How well do line drawings depict shape?
SIGGRAPH '09: ACM SIGGRAPH 2009 papersThis paper investigates the ability of sparse line drawings to depict 3D shape. We perform a study in which people are shown an image of one of twelve 3D objects depicted with one of six styles and asked to orient a gauge to coincide with the surface ...
Neurally-Guided Texturing for Garment Line Drawings
SA '20: SIGGRAPH Asia 2020 Technical CommunicationsAdding texture to a line drawing is an important process in the production of comics and illustrations. Garment drawings especially often have large deformations with self-occlusions, so deforming patterns is essential for representing realistic ...
Line-Drawing Interpretation: Straight Lines and Conic Sections
Line drawings of man-made scenes often exhibit instances of straight lines and conic sections, i.e. ellipses, parabolas, and hyperbolas. Constraints imposed on the scene by such instances are investigated, under the assumption of general viewpoint, i.e. ...
Comments