Ali Jahanian
Skip Abstract Section
Abstract
We study the concept of color semantics by modeling a dataset of magazine cover designs, evaluating the model via crowdsourcing, and demonstrating several prototypes that facilitate color-related design tasks. We investigate a probabilistic generative modeling framework that expresses semantic concepts as a combination of color and word distributions -- color-word topics. We adopt an extension to Latent Dirichlet Allocation (LDA) topic modeling, called LDA-dual, to infer a set of color-word topics over a corpus of 2,654 magazine covers spanning 71 distinct titles and 12 genres. Although LDA models text documents as distributions over word topics, we model magazine covers as distributions over color-word topics. The results of our crowdsourcing experiments confirm that the model is able to successfully discover the associations between colors and linguistic concepts. Finally, we demonstrate several prototype applications that use the learned model to enable more meaningful interactions in color palette recommendation, design example retrieval, pattern recoloring, image retrieval, and image color selection.
- Francis M. Adams and Charles E. Osgood. 1973. A cross-cultural study of the affective meanings of color. Journal of Cross-Cultural Psychology 4, 2 (1973), 135--156. Google Scholar
Cross Ref
- Adobe Kuler. 2016. Adobe System, Inc. (2016). Retrieved May 20, 2016 from https://color.adobe.com.Google Scholar
- Christophe Andrieu, Nando De Freitas, Arnaud Doucet, and Michael I. Jordan. 2003. An introduction to MCMC for machine learning. Machine Learning 50, 1--2 (2003), 5--43.Google ScholarCross Ref
- Astronomy Magazine. 2010. Kalmbach Publishing. Retrieved from http://www.astronomy.com.Google Scholar
- Lawrence W. Barsalou. 1999. Perceptual symbol systems. Behavioral and Brain Sciences 22, 4 (1999), 577--660. Google ScholarCross Ref
- Brent Berlin. 1969. Basic Color Terms: Their Universality and Evolution. University of California Press.Google Scholar
- David M. Blei. 2012. Probabilistic topic models. Communications of the ACM 55, 4 (April 2012), 77--84. Google ScholarDigital Library
- David M. Blei, Andrew Y. Ng, and Michael I. Jordan. 2003. Latent Dirichlet allocation. The Journal of Machine Learning Research 3 (2003), 993--1022.Google ScholarDigital Library
- Bloomberg Businessweek. September, 24, 2012. Bloomberg L.P. http://www.bloomberg.com/businessweek.Google Scholar
- Allison June-Barlow Chaney and David M. Blei. 2012. Visualizing topic models. In Proceedings of the International AAAI Conference on Weblogs and Social Media (ICWSM’12).Google Scholar
- Jonathan Chang, Sean Gerrish, Chong Wang, Jordan L. Boyd-Graber, and David M. Blei. 2009. Reading tea leaves: How humans interpret topic models. In Advances in Neural Information Processing Systems, 288--296.Google Scholar
- Jason Chuang, Christopher D. Manning, and Jeffrey Heer. 2012. Termite: Visualization techniques for assessing textual topic models. In Proceedings of the International Working Conference on Advanced Visual Interfaces. ACM, 74--77. Google ScholarDigital Library
- Jason Chuang, Maureen Stone, and Pat Hanrahan. 2008. A probabilistic model of the categorical association between colors. In Color and Imaging Conference, Vol. 2008. Society for Imaging Science and Technology, 6--11.Google Scholar
- ColourLovers. 2016. ColourLovers Creative Market Labs, Inc. Retrieved May 20, 2016 from http://www.colourlovers.com.Google Scholar
- Gabriela Csurka, Sandra Skaff, Luca Marchesotti, and Craig Saunders. 2010. Learning moods and emotions from color combinations. In Proceedings of the Seventh Indian Conference on Computer Vision, Graphics and Image Processing. ACM, 298--305. Google ScholarDigital Library
- Gunilla Derefeldt, Tiina Swartling, Ulf Berggrund, and Peter Bodrogi. 2004. Cognitive color. Color Research 8 Application 29, 1 (2004), 7--19.Google Scholar
- Steven P. Dow, Alana Glassco, Jonathan Kass, Melissa Schwarz, Daniel L. Schwartz, and Scott R. Klemmer. 2010. Parallel prototyping leads to better design results, more divergence, and increased self-efficacy. ACM Transactions on Computer-Human Interaction 17, 4 (2010), 18.Google ScholarDigital Library
- Leatrice Eisemann. 2000. Pantones Guide to Communicating with Color. Grafix Press, Ltd.Google Scholar
- Pedro F. Felzenszwalb and Daniel P. Huttenlocher. 2004. Efficient graph-based image segmentation. International Journal of Computer Vision 59, 2 (2004), 167--181. Google ScholarDigital Library
- David R. Flatla, Katharina Reinecke, Carl Gutwin, and Krzysztof Z Gajos. 2013. SPRWeb: Preserving subjective responses to website colour schemes through automatic recolouring. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 2069--2078. Google ScholarDigital Library
- Flickr. 2016. Yahoo! Inc. Retrieved May 20, 2016 from https://www.flickr.com/.Google Scholar
- Chris Foges. 1999. Magazine Design. RotoVision Press, Switzerland.Google Scholar
- Forbes Magazine. 2009. Forbes, Inc. Retrieved from http://www.forbes.com/forbes.Google Scholar
- Jorge Frascara. 2004. Communication Design: Principles, Methods, and Practice. Allworth Communications, Inc.Google Scholar
- Glamour. 2009a. Condé Nast Publications. Retrieved from http://www.glamour.com.Google Scholar
- Glamour. 2009b. Condé Nast Publications. Retrieved from http://www.glamour.com.Google Scholar
- Google n-grams. 2016. Google, Inc. (2016). Retrieved May 20, 2016 from https://books.google.com/ngrams/.Google Scholar
- Dinesh Govindaraj, Tao Wang, and S. V. N. Vishwanathan. 2014. Modeling attractiveness and multiple clicks in sponsored search results. arXiv:1401.0255.Google Scholar
- GQ Magazine. 2012. Condé Nast Publications. (March, 2012). Retrieved from http://www.gq.com.Google Scholar
- Thomas L. Griffiths. 2002. Gibbs Sampling in the Generative Model of Latent Dirichlet Allocation. Technical Report. Standford University.Google Scholar
- Thomas L. Griffiths and Mark Steyvers. 2004. Finding scientific topics. Proceedings of the National Academy of Sciences of the United States of America 101, Suppl. 1 (2004), 5228--5235. Google ScholarCross Ref
- Jonathan Harel, Christof Koch, and Pietro Perona. 2007. Graph-based visual saliency. In Advances in Neural Information Processing Systems, Vol. 19. MIT Press, 545--552.Google ScholarDigital Library
- Jeffrey Heer and Maureen Stone. 2012. Color naming models for color selection, image editing and palette design. In Proceedings of the 2012 ACM Annual Conference on Human Factors in Computing Systems. ACM, 1007--1016. Google ScholarDigital Library
- Scarlett R. Herring, Chia-Chen Chang, Jesse Krantzler, and Brian P. Bailey. 2009. Getting inspired!: Understanding how and why examples are used in creative design practice. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 87--96.Google Scholar
- House8Garden. 2016. Condé Nast Publications, Ltd. (2016). Retrieved May 20, 2016 from http://www. houseandgarden.co.uk/.Google Scholar
- Glyn W. Humphreys and Vicki Bruce. 1989. Visual Cognition: Computational, Experimental, and Neuropsychological Perspectives. Lawrence Erlbaum Associates, Inc.Google Scholar
- Ali Jahanian. 2011. Automatic Magazine Cover Design. Master’s Thesis. Purdue University.Google Scholar
- Ali Jahanian. 2014. Quantifying Aesthetics of Visual Design Applied to Automatic Design. Ph.D. Dissertation. Purdue University.Google Scholar
- Ali Jahanian, Jerry Liu, Daniel R. Tretter, Qian Lin, Eamonn O’Brien-Strain, Seungyon Lee, Nic Lyons, and Jan P. Allebach. 2013. Recommendation system for automatic design of magazine covers. In Proceedings of the 2013 ACM International Conference on Intelligent User Interfaces. ACM. Google ScholarDigital Library
- Michael I. Jordan, Zoubin Ghahramani, Tommi S. Jaakkola, and Lawrence K. Saul. 1999. An introduction to variational methods for graphical models. Machine Learning 37, 2 (1999), 183--233. Google ScholarDigital Library
- Tilke Judd, Krista Ehinger, Frédo Durand, and Antonio Torralba. 2009. Learning to predict where humans look. In Proceedings of the 2009 IEEE 12th International Conference on Computer Vision. IEEE, 2106--2113. Google ScholarCross Ref
- Paul Kay, Brent Berlin, Luisa Maffi, William R. Merrifield, and Richard Cook. 2009. The World Color Survey. Springer. https://web.stanford.edu/group/cslipublications/cslipublications/site/9781575864150.shtml.Google Scholar
- Paul Kay and Chad K. McDaniel. 1978. The linguistic significance of the meanings of basic color terms. Language 54, 3 (Sept. 1978), 610--646. Google ScholarCross Ref
- Shigenobu Kobayashi. 1981. The aim and method of the color image scale. Color Research 8 Application 6, 2 (1981), 93--107.Google Scholar
- Shigenobu Kobayashi. 1991. Color Image Scale. Kodansha Intern.Google Scholar
- Harold W. Kuhn. 1955. The Hungarian method for the assignment problem. Naval Research Logistics Quarterly 2, 1--2 (1955), 83--97.Google ScholarCross Ref
- Sharon Lin, Julie Fortuna, Chinmay Kulkarni, Maureen Stone, and Jeffrey Heer. 2013a. Selecting semantically-resonant colors for data visualization. In Proceedings of the 2013 15th Annual Eurographics Conference on Visualization (EuroVis’13), Vol. 32. Google ScholarDigital Library
- Sharon Lin and Pat Hanrahan. 2013. Modeling how people extract color themes from images. In Proceeding of the ACM Human Factors in Computing Systems (CHI’13). Google ScholarDigital Library
- Sharon Lin, Daniel Ritchie, Matthew Fisher, and Pat Hanrahan. 2013b. Probabilistic color-by-numbers: Suggesting pattern colorizations using factor graphs. In ACM SIGGRAPH’13 Papers. Google ScholarDigital Library
- Albrecht Lindner and Sabine Süsstrunk. 2013. Automatic color palette creation from words. In Color and Imaging Conference, Vol. 2013. Society for Imaging Science and Technology, 69--74.Google Scholar
- Albrecht Lindner and Sabine Süsstrunk. 2015. Semantic-improved color imaging applications: It is all about context. IEEE Transactions on Multimedia 17, 5 (2015), 700--710. Google ScholarCross Ref
- Linwood Fabric. 2016. Linwood Fabric 8 Wallpapers. (2016). Retrieved from www.linwoodfabric.com.Google Scholar
- Ying Liu, Dengsheng Zhang, Guojun Lu, and Wei-Ying Ma. 2007. A survey of content-based image retrieval with high-level semantics. Pattern Recognition 40, 1 (2007), 262--282. Google ScholarDigital Library
- Colin M. MacLeod. 1991. Half a century of research on the Stroop effect: An integrative review. Psychological Bulletin 109, 2 (1991), 163.Google ScholarCross Ref
- Y. Matsuda. 1995. Color Design. Asakura Shoten.Google Scholar
- Jon D. Mcauliffe and David M. Blei. 2008. Supervised topic models. In Advances in Neural Information Processing Systems, 121--128.Google Scholar
- Jean-Baptiste Michel, Yuan Kui Shen, Aviva Presser Aiden, Adrian Veres, Matthew K. Gray, Joseph P. Pickett, Dale Hoiberg, Dan Clancy, Peter Norvig, Jon Orwant, et al. 2011. Quantitative analysis of culture using millions of digitized books. Science 331, 6014 (2011), 176--182. Google ScholarCross Ref
- Aleksandra Mojsilovic and Bernice Rogowitz. 2001. Capturing image semantics with low-level descriptors. In Proceedings of the 2001 International Conference on Image Processing, Vol. 1. IEEE, 18--21. Google ScholarCross Ref
- Naila Murray, Sandra Skaff, Luca Marchesotti, and Florent Perronnin. 2012. Toward automatic and flexible concept transfer. Computers 8 Graphics 36, 6 (2012), 622--634.Google Scholar
- Quentin Newark. 2007. What is Graphic Design? Rockport Publishers.Google Scholar
- NgramViewer. 2016. Google, Inc. (2016). Retrieved May 20, 2016 from https://books.google.com/ngrams.Google Scholar
- OCLC. 2016a. Dewey Decimal Classification. (2016). Retrieved May 20, 2016 from http://www.oclc. org/dewey.en.html.Google Scholar
- OCLC. 2016b. WorldCat. (2016). Retrieved May 20, 2016 from http://www.worldcat.org.Google Scholar
- Peter O’Donovan, Aseem Agarwala, and Aaron Hertzmann. 2011. Color compatibility from large datasets. ACM Transactions on Graphics 30, 4 (2011), 63.Google ScholarDigital Library
- Charles E. Osgood. 1952. The nature and measurement of meaning. Psychological Bulletin 49, 3 (1952), 197.Google ScholarCross Ref
- Charles E. Osgood. 1971. Exploration in semantic space: A personal diary1. Journal of Social Issues 27, 4 (1971), 5--64. Google ScholarCross Ref
- Li-Chen Ou, M. Ronnier Luo, Andrée Woodcock, and Angela Wright. 2004a. A study of colour emotion and colour preference. Part I: Colour emotions for single colours. Color Research 8 Application 29, 3 (2004), 232--240.Google Scholar
- Li-Chen Ou, M. Ronnier Luo, Andree Woodcock, and Angela Wright. 2004b. A study of colour emotion and colour preference. Part II: Colour emotions for two-colour combinations. Color Research 8 Application 29, 4 (2004), 292--298.Google Scholar
- Li-Chen Ou, M. Ronnier Luo, Andrée Woodcock, and Angela Wright. 2004c. A study of colour emotion and colour preference. Part III: Colour preference modeling. Color Research 8 Application 29, 5 (2004), 381--389.Google Scholar
- Li-Chen Ou, M. Ronnier Luo, Pei-Li Sun, Neng-Chung Hu, Hung-Shing Chen, Shing-Sheng Guan, Andree Woodcock, José Luis Caivano, Rafael Huertas, Alain Treméau, and others. 2012. A cross-cultural comparison of colour emotion for two-colour combinations. Color Research 8 Application 37, 1 (2012), 23--43.Google Scholar
- Galina V. Paramei. 2005. Singing the Russian blues: An argument for culturally basic color terms. Cross-Cultural Research 39, 1 (2005), 10--38. Google ScholarCross Ref
- Pinterest. 2016. Homepage. Retrieved May 20, 2016 from https://www.pinterest.com/.Google Scholar
- Martin F. Porter. 1980. An algorithm for suffix stripping. Program: Electronic Library and Information Systems 14, 3 (1980), 130--137. Google ScholarCross Ref
- Katharina Reinecke and Krzysztof Z. Gajos. 2014. Quantifying visual preferences around the world. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM. Google ScholarDigital Library
- Debi Roberson, Ian Davies, and Jules Davidoff. 2000. Color categories are not universal: Replications and new evidence from a stone-age culture. Journal of Experimental Psychology: General 129, 3 (2000), 369.Google ScholarCross Ref
- Yossi Rubner, Carlo Tomasi, and Leonidas J. Guibas. 2000. The earth mover’s distance as a metric for image retrieval. International Journal of Computer Vision 40, 2 (2000), 99--121. Google ScholarDigital Library
- Tim Samara. 2007. Design Elements: A Graphic Style Manual. Rockport Publishers.Google Scholar
- Boris Schauerte and Rainer Stiefelhagen. 2012. Learning robust color name models from web images. In Proceedings of the 2012 21st International Conference on Pattern Recognition (ICPR’12). IEEE, 3598--3601.Google Scholar
- Science Magazine. 2013. American Association for the Advancement of Science (AAAS). (February 2013). Retrieved from http://www.sciencemag.org/.Google Scholar
- Science Magazine. 2011. American Association for the Advancement of Science (AAAS). (September, 9, 2011). Retrieved from http://www.sciencemag.org/.Google Scholar
- Christin Seifert, Barbara Kump, Wolfgang Kienreich, Gisela Granitzer, and Michael Granitzer. 2008. On the beauty and usability of tag clouds. In Proceedings of the 12th International Conference on Information Visualisation (IV’08). IEEE, 17--25. Google ScholarDigital Library
- Ishwar K. Sethi, Ioana L. Coman, and Daniela Stan. 2001. Mining association rules between low-level image features and high-level concepts. Proceedings of the SPIE Data Mining and Knowledge Discovery 3 (2001), 279--290. Google ScholarCross Ref
- Vidya Setlur and Maureen C. Stone. 2016. A linguistic approach to categorical color assignment for data visualization. IEEE Transactions on Visualization and Computer Graphics 22, 1 (2016), 698--707. Google ScholarDigital Library
- Gaurav Sharma. 2002. Color fundamentals for digital imaging. In Digital Color Imaging Handbook. Gaurav Sharma (Ed.). CRC Press. Google ScholarCross Ref
- Ben Shneiderman. 2009. Creativity support tools: A grand challenge for HCI researchers. Engineering the User Interface (2009), Springer London, 1--9.Google Scholar
- Liangcai Shu, Bo Long, and Weiyi Meng. 2009. A latent topic model for complete entity resolution. In Proceedings of the IEEE 25th International Conference on Data Engineering (ICDE’09). IEEE, 880--891. Google ScholarDigital Library
- Arnold W. M. Smeulders, Marcel Worring, Simone Santini, Amarnath Gupta, and Ramesh Jain. 2000. Content-based image retrieval at the end of the early years. IEEE Transactions on Pattern Analysis and Machine Intelligence 22, 12 (2000), 1349--1380. Google ScholarDigital Library
- Martin Solli and Reiner Lenz. 2010. Color semantics for image indexing. In Proceedings of the 5th European Conference on Colour in Graphics, Imaging, and Vision (CGIV’10). IS8T, 353--358.Google Scholar
- Anna Starmer. 2005. The Color Scheme Bible: Inspirational Palettes for Designing Home Interiors. Firefly Books.Google Scholar
- Mark Steyvers and Tom Griffiths. 2007. Probabilistic topic models. In Handbook of Latent Semantic Analysis, Simon Dennis Thomas K. Landauer, Danielle S. McNamara and Walter Kintsch (Eds.). Lawrence Erlbaum.Google Scholar
- Mark Steyvers and Tom Griffiths. 2014. Matlab Topic Modeling Toolbox. Retrieved November 14, 2014 from http://psiexp.ss.uci.edu/research/programs_data/toolbox.htm.Google Scholar
- Technology Review. 2009. Technology Review, Inc. (owned by MIT). Retrieved from https://www.technologyreview.com.Google Scholar
- Yee Whye Teh, David Newman, and Max Welling. 2006. A collapsed variational Bayesian inference algorithm for latent Dirichlet allocation. In Neural Information Processing Systems (NIPS), Vol. 6, 1378--1385.Google Scholar
- TripAdvisor. 2014. TripAdvisor LCC. Retrieved November 14, 2014 from http://www.tripadvisor.com/.Google Scholar
- Joost Van De Weijer, Cordelia Schmid, Jakob Verbeek, and Diane Larlus. 2009. Learning color names for real-world applications. IEEE Transactions on Image Processing 18, 7 (2009), 1512--1523. Google ScholarDigital Library
- Walker Greenbank. 2016. Walker Greenbank PLC. (2016). Retrieved from http://walkergreenbank.co.uk.Google Scholar
- Hanna M. Wallach, David M. Mimno, and Andrew McCallum. 2009. Rethinking LDA: Why priors matter. In Advances in Neural Information Processing Systems, 1973--1981.Google Scholar
- Baoyuan Wang, Yizhou Yu, Tien-Tsin Wong, Chun Chen, and Ying-Qing Xu. 2010. Data-driven image color theme enhancement. ACM Transactions on Graphics 29, 6 (2010), 146.Google ScholarDigital Library
- Chong Wang, David Blei, and Fei-Fei Li. 2009. Simultaneous image classification and annotation. In Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition (CVPR’09). IEEE, 1903--1910. Google ScholarCross Ref
- Allan Whitfield and John Wiltshire. 1982. Design training and aesthetic evaluation: An intergroup comparison. Journal of Environmental Psychology 2, 2 (1982), 109--117. Google ScholarCross Ref
- Jonathan Winawer, Nathan Witthoft, Michael C. Frank, Lisa Wu, Alex R Wade, and Lera Boroditsky. 2007. Russian blues reveal effects of language on color discrimination. Proceedings of the National Academy of Sciences 104, 19 (2007), 7780--7785. Google ScholarCross Ref
- WIRED. 2009. Condé Nast. Retrieved from https://www.wired.com.Google Scholar
Index Terms
- Colors -- Messengers of Concepts: Visual Design Mining for Learning Color Semantics
Recommendations
An Image Retrieval Method Based on Spatial Features of Colors
ISCSCT '08: Proceedings of the 2008 International Symposium on Computer Science and Computational Technology - Volume 01This paper presents a method for expressing color features of images through color hue histograms, according to the distribution characteristics of image color space. In this method, the spatial features of colors are described in terms of three ...
Image retrieval using spatiograms of colors quantized by Gaussian Mixture Models
In this paper we propose a novel image representation method that characterizes an image as a spatiogram--a generalized histogram--of colors quantized by Gaussian Mixture Models (GMMs). First, we quantize the color space using a GMM, which is learned by ...
De-Stijl: Facilitating Graphics Design with Interactive 2D Color Palette Recommendation
CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing SystemsSelecting a proper color palette is critical in crafting a high-quality graphic design to gain visibility and communicate ideas effectively. To facilitate this process, we propose De-Stijl, an intelligent and interactive color authoring tool to assist ...
Comments