Abstract
This paper presents a method for measuring the similarity in style between two pieces of vector art, independent of content. Similarity is measured by the differences between four types of features: color, shading, texture, and stroke. Feature weightings are learned from crowdsourced experiments. This perceptual similarity enables style-based search. Using our style-based search feature, we demonstrate an application that allows users to create stylistically-coherent clip art mash-ups.
Supplemental Material
- Aucouturier, J.-J., and Pachet, F. 2002. Music Similarity Measures: What's the Use? In Proc. SMIR, 157--163.Google Scholar
- Bae, S., Paris, S., and Durand, F. 2006. Two-scale tone management for photographic look. ACM Trans. Graphics 25, 3, 637--645. Google ScholarDigital Library
- Bell, R. M., and Koren, Y. 2007. Lessons from the Netflix Prize Challenge. SIGKDD Explor. Newsl. 9, 2, 75--79. Google ScholarDigital Library
- Chen, T., Cheng, M.-M., Tan, P., Shamir, A., and Hu, S.-M. 2009. Sketch2photo: Internet image montage. ACM Trans. Graphics 28, 5, 124:1--124:10. Google ScholarDigital Library
- Chen, X., Bennett, P. N., Collins-Thompson, K., and Horvitz, E. 2013. Pairwise Ranking Aggregation in a Crowdsourced Setting. In Proc. WSDM, 193--202. Google ScholarDigital Library
- Datta, R., Joshi, D., Li, J., and Wang, J. Z. 2008. Image Retrieval: Ideas, Influences, and Trends of the New Age. ACM Computing Surveys 40, 2, 5:1--5:60. Google ScholarDigital Library
- Doersch, C., Singh, S., Gupta, A., Sivic, J., and Efros, A. 2012. What Makes Paris Look like Paris? ACM Trans. Graphics 31, 4, 101:1--101:9. Google ScholarDigital Library
- Durand, F. 2002. An Invitation to Discuss Computer Depiction. In Proc. NPAR, 111--124. Google ScholarDigital Library
- Epshtein, B., Ofek, E., and Wexler, Y. 2010. Detecting Text in Natural Scenes with Stroke Width Transform. In Proc. CVPR, 2963--2970.Google Scholar
- Gooch, B., and Gooch, A. 2001. Non-Photorealistic Rendering. AK Peters Ltd. Google ScholarDigital Library
- Haralick, R. M., Shanmugam, K., and Dinstein, I. 1973. Textural Features for Image Classification. IEEE Trans. Systems, Man and Cybernetics 3, 6, 610--621.Google ScholarCross Ref
- Hasler, D., and Susstrunk, S. 2003. Measuring Colourfulness in Natural Images. In Proc. SPIE: Human Vision and Electronic Imaging, vol. 5007, 87--95.Google Scholar
- Hertzmann, A., Jacobs, C. E., Oliver, N., Curless, B., and Salesin, D. H. 2001. Image Analogies. In Proc. SIGGRAPH, 327--340. Google ScholarDigital Library
- Hurtut, T., Gousseau, Y., Cheriet, F., and Schmitt, F. 2011. Artistic line-drawings retrieval based on the pictorial content. ACM J. Computing and Cultural Heritage 4, 1, 1--23. Google ScholarDigital Library
- Kalogerakis, E., Nowrouzezahrai, D., Breslav, S., and Hertzmann, A. 2012. Learning Hatching for Pen-and-Ink Illustration of Surfaces. ACM Trans. Graphics 31, 1:1--1:17. Google ScholarDigital Library
- Kulis, B. 2013. Metric learning: A survey. Foundations and Trends in Machine Learning 5, 4, 287--364.Google ScholarCross Ref
- Lalonde, J.-F., Hoiem, D., Efros, A. A., Rother, C., Winn, J., and Criminisi, A. 2007. Photo clip art. ACM Trans. Graphics 26, 3, 3:1--3:10. Google ScholarDigital Library
- Lessig, L. 2008. Remix: Making Art and Commerce Thrive in the Hybrid Economy. Penguin Press.Google ScholarCross Ref
- Li, C., Member, S., and Chen, T. 2009. Aesthetic Visual Quality Assessment of Paintings. IEEE J. Sel. Topics in Signal Processing 3, 2, 236--252.Google ScholarCross Ref
- Li, H., Zhang, H., Wang, Y., Cao, J., Shamir, A., and Cohen-Or, D. 2013. Curve Style Analysis in a Set of Shapes. Computer Graphics Forum 32, 6, 77--88. Google ScholarDigital Library
- McFee, B., and Lanckriet, G. 2011. Learning Multi-modal Similarity. J. Machine Learning Research 12, 491--523. Google ScholarDigital Library
- Murray, N., Barcelona, D., Marchesotti, L., and Perronnin, F. 2012. AVA: A Large-Scale Database for Aesthetic Visual Analysis. In Proc. CVPR, 2408--2415. Google ScholarDigital Library
- O'Donovan, P., Lībeks, J., Agarwala, A., and Hertzmann, A. 2014. Exploratory Font Selection Using Crowdsourced Attributes. ACM Trans. Graphics 33. Google ScholarDigital Library
- Ojala, T., Pietikäinen, M., and Mäenpää, T. 2002. Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans. PAMI 24, 7, 971--987. Google ScholarDigital Library
- Parikh, D., and Grauman, K. 2011. Relative attributes. In Proc. ICCV, 503--510. Google ScholarDigital Library
- Radlinski, F., Bennett, P. N., Carterette, B., and Joachims, T. 2009. Redundancy, Diversity and Interdependent Document Relevance. SIGIR Forum 43, 2. Google ScholarDigital Library
- Schultz, M., and Joachims, T. 2003. Learning a Distance Metric from Relative Comparisons. In Proc. NIPS.Google Scholar
- Shamir, L., Macura, T., Orlov, N., Eckley, D. M., and Goldberg, I. G. 2010. Impressionism, Expressionism, Surrealism: Automated Recognition of Painters and Schools of Art. ACM Trans. Applied Perception 7, 2, 8:1--8:17. Google ScholarDigital Library
- Tamuz, O., Liu, C., Belongie, S., Shamir, O., and Kalai, A. 2011. Adaptively Learning the Crowd Kernel. In Proc. ICML, 673--680.Google Scholar
- Tenenbaum, J. B., and Freeman, W. T. 2000. Separating Style and Content with Bilinear Models. Neural Computation 12, 6, 1247--1283. Google ScholarDigital Library
- van der Maaten, L., and Hinton, G. E. 2008. Visualizing High-Dimensional Data Using t-SNE. J. Machine Learning Research 9, 2579--2605.Google Scholar
- Welinder, P., Branson, S., Belongie, S., and Perona, P. 2010. The Multidimensional Wisdom of Crowds. In Proc. NIPS, 2424--2432.Google Scholar
- Willats, J., and Durand, F. 2005. Defining pictorial style: Lessons from linguistics and computer graphics. Axiomathes 15, 3, 319--351.Google ScholarCross Ref
- Zhu, C., Byrd, R. H., Lu, P., and Nocedal, J. 1997. Algorithm 778: L-BFGS-B: Fortran subroutines for large-scale bound-constrained optimization. ACM Trans. on Mathematical Software 23, 4. Google ScholarDigital Library
- Zhu, C., Bichot, C.-E., and Chen, L. 2010. Multi-scale Color Local Binary Patterns for Visual Object Classes Recognition. In Proc. ICPR, 3065--3068. Google ScholarDigital Library
Index Terms
- A similarity measure for illustration style
Recommendations
Style-based exploration of illustration datasets
Searching by style in illustration data sets is a particular problem in Information Retrieval which has received little attention so far. One of its main problems is that the perception of style is highly subjective, which makes labeling styles a very ...
Style as Sentiment Versus Style as Formality: The Same or Different?
Artificial Neural Networks and Machine Learning – ICANN 2021AbstractUnsupervised textual style transfer presupposes that style is a coherent and consistent concept and that style transfer approaches will generalise consistently across different domains of style. This paper explores whether this presupposition is ...
Style similarity measure for video documents comparison
CIVR'05: Proceedings of the 4th international conference on Image and Video RetrievalWe define a style similarity measure for video documents based on the localization of common elements and on the temporal order in which they appear in each document. Common elements for a couple of compared videos are segments presenting similar ...
Comments