skip to main content
research-article

A similarity measure for illustration style

Published:27 July 2014Publication History
Skip Abstract Section

Abstract

This paper presents a method for measuring the similarity in style between two pieces of vector art, independent of content. Similarity is measured by the differences between four types of features: color, shading, texture, and stroke. Feature weightings are learned from crowdsourced experiments. This perceptual similarity enables style-based search. Using our style-based search feature, we demonstrate an application that allows users to create stylistically-coherent clip art mash-ups.

Skip Supplemental Material Section

Supplemental Material

a93-sidebyside.mp4

mp4

14.3 MB

References

  1. Aucouturier, J.-J., and Pachet, F. 2002. Music Similarity Measures: What's the Use? In Proc. SMIR, 157--163.Google ScholarGoogle Scholar
  2. Bae, S., Paris, S., and Durand, F. 2006. Two-scale tone management for photographic look. ACM Trans. Graphics 25, 3, 637--645. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Bell, R. M., and Koren, Y. 2007. Lessons from the Netflix Prize Challenge. SIGKDD Explor. Newsl. 9, 2, 75--79. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Chen, T., Cheng, M.-M., Tan, P., Shamir, A., and Hu, S.-M. 2009. Sketch2photo: Internet image montage. ACM Trans. Graphics 28, 5, 124:1--124:10. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Chen, X., Bennett, P. N., Collins-Thompson, K., and Horvitz, E. 2013. Pairwise Ranking Aggregation in a Crowdsourced Setting. In Proc. WSDM, 193--202. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Datta, R., Joshi, D., Li, J., and Wang, J. Z. 2008. Image Retrieval: Ideas, Influences, and Trends of the New Age. ACM Computing Surveys 40, 2, 5:1--5:60. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Doersch, C., Singh, S., Gupta, A., Sivic, J., and Efros, A. 2012. What Makes Paris Look like Paris? ACM Trans. Graphics 31, 4, 101:1--101:9. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Durand, F. 2002. An Invitation to Discuss Computer Depiction. In Proc. NPAR, 111--124. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Epshtein, B., Ofek, E., and Wexler, Y. 2010. Detecting Text in Natural Scenes with Stroke Width Transform. In Proc. CVPR, 2963--2970.Google ScholarGoogle Scholar
  10. Gooch, B., and Gooch, A. 2001. Non-Photorealistic Rendering. AK Peters Ltd. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Haralick, R. M., Shanmugam, K., and Dinstein, I. 1973. Textural Features for Image Classification. IEEE Trans. Systems, Man and Cybernetics 3, 6, 610--621.Google ScholarGoogle ScholarCross RefCross Ref
  12. Hasler, D., and Susstrunk, S. 2003. Measuring Colourfulness in Natural Images. In Proc. SPIE: Human Vision and Electronic Imaging, vol. 5007, 87--95.Google ScholarGoogle Scholar
  13. Hertzmann, A., Jacobs, C. E., Oliver, N., Curless, B., and Salesin, D. H. 2001. Image Analogies. In Proc. SIGGRAPH, 327--340. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Hurtut, T., Gousseau, Y., Cheriet, F., and Schmitt, F. 2011. Artistic line-drawings retrieval based on the pictorial content. ACM J. Computing and Cultural Heritage 4, 1, 1--23. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Kalogerakis, E., Nowrouzezahrai, D., Breslav, S., and Hertzmann, A. 2012. Learning Hatching for Pen-and-Ink Illustration of Surfaces. ACM Trans. Graphics 31, 1:1--1:17. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Kulis, B. 2013. Metric learning: A survey. Foundations and Trends in Machine Learning 5, 4, 287--364.Google ScholarGoogle ScholarCross RefCross Ref
  17. Lalonde, J.-F., Hoiem, D., Efros, A. A., Rother, C., Winn, J., and Criminisi, A. 2007. Photo clip art. ACM Trans. Graphics 26, 3, 3:1--3:10. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Lessig, L. 2008. Remix: Making Art and Commerce Thrive in the Hybrid Economy. Penguin Press.Google ScholarGoogle ScholarCross RefCross Ref
  19. Li, C., Member, S., and Chen, T. 2009. Aesthetic Visual Quality Assessment of Paintings. IEEE J. Sel. Topics in Signal Processing 3, 2, 236--252.Google ScholarGoogle ScholarCross RefCross Ref
  20. Li, H., Zhang, H., Wang, Y., Cao, J., Shamir, A., and Cohen-Or, D. 2013. Curve Style Analysis in a Set of Shapes. Computer Graphics Forum 32, 6, 77--88. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. McFee, B., and Lanckriet, G. 2011. Learning Multi-modal Similarity. J. Machine Learning Research 12, 491--523. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Murray, N., Barcelona, D., Marchesotti, L., and Perronnin, F. 2012. AVA: A Large-Scale Database for Aesthetic Visual Analysis. In Proc. CVPR, 2408--2415. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. O'Donovan, P., Lībeks, J., Agarwala, A., and Hertzmann, A. 2014. Exploratory Font Selection Using Crowdsourced Attributes. ACM Trans. Graphics 33. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Ojala, T., Pietikäinen, M., and Mäenpää, T. 2002. Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans. PAMI 24, 7, 971--987. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Parikh, D., and Grauman, K. 2011. Relative attributes. In Proc. ICCV, 503--510. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Radlinski, F., Bennett, P. N., Carterette, B., and Joachims, T. 2009. Redundancy, Diversity and Interdependent Document Relevance. SIGIR Forum 43, 2. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Schultz, M., and Joachims, T. 2003. Learning a Distance Metric from Relative Comparisons. In Proc. NIPS.Google ScholarGoogle Scholar
  28. Shamir, L., Macura, T., Orlov, N., Eckley, D. M., and Goldberg, I. G. 2010. Impressionism, Expressionism, Surrealism: Automated Recognition of Painters and Schools of Art. ACM Trans. Applied Perception 7, 2, 8:1--8:17. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Tamuz, O., Liu, C., Belongie, S., Shamir, O., and Kalai, A. 2011. Adaptively Learning the Crowd Kernel. In Proc. ICML, 673--680.Google ScholarGoogle Scholar
  30. Tenenbaum, J. B., and Freeman, W. T. 2000. Separating Style and Content with Bilinear Models. Neural Computation 12, 6, 1247--1283. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. van der Maaten, L., and Hinton, G. E. 2008. Visualizing High-Dimensional Data Using t-SNE. J. Machine Learning Research 9, 2579--2605.Google ScholarGoogle Scholar
  32. Welinder, P., Branson, S., Belongie, S., and Perona, P. 2010. The Multidimensional Wisdom of Crowds. In Proc. NIPS, 2424--2432.Google ScholarGoogle Scholar
  33. Willats, J., and Durand, F. 2005. Defining pictorial style: Lessons from linguistics and computer graphics. Axiomathes 15, 3, 319--351.Google ScholarGoogle ScholarCross RefCross Ref
  34. Zhu, C., Byrd, R. H., Lu, P., and Nocedal, J. 1997. Algorithm 778: L-BFGS-B: Fortran subroutines for large-scale bound-constrained optimization. ACM Trans. on Mathematical Software 23, 4. Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Zhu, C., Bichot, C.-E., and Chen, L. 2010. Multi-scale Color Local Binary Patterns for Visual Object Classes Recognition. In Proc. ICPR, 3065--3068. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. A similarity measure for illustration style

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    Full Access

    • Published in

      cover image ACM Transactions on Graphics
      ACM Transactions on Graphics  Volume 33, Issue 4
      July 2014
      1366 pages
      ISSN:0730-0301
      EISSN:1557-7368
      DOI:10.1145/2601097
      Issue’s Table of Contents

      Copyright © 2014 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 27 July 2014
      Published in tog Volume 33, Issue 4

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader