Abstract
Images are widely used by companies to advertise their products and promote awareness of their brands. The automatic synthesis of advertising images is challenging because the advertising message must be clearly conveyed while complying with the style required for the product, brand, or target audience. In this study, we proposed a data-driven method to capture individual design attributes and the relationships between elements in advertising images with the aim of automatically synthesizing the input of elements into an advertising image according to a specified style. To achieve this multi-format advertisement design, we created a dataset containing 13 280 advertising images with rich annotations that encompassed the outlines and colors of the elements, in addition to the classes and goals of the advertisements. Using our probabilistic models, users guided the style of synthesized advertisements via additional constraints (e.g., context-based keywords). We applied our method to a variety of design tasks, and the results were evaluated in several perceptual studies, which showed that our method improved users’ satisfaction by 7.1% compared to designs generated by nonprofessional students, and that more users preferred the coloring results of our designs to those generated by the color harmony model and Colormind.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Antonacopoulos A, Bridson D, Papadopoulos C, et al., 2009. A realistic dataset for performance evaluation of document layout analysis. 10th Int Conf on Document Analysis and Recognition, p.296–300. https://doi.org/10.1109/ICDAR.2009.271
Borji A, Cheng MM, Jiang H, et al., 2015. Salient object detection: a benchmark. IEEE Trans Image Process, 24(12):5706–5722. https://doi.org/10.1109/TIP.2015.2487833
Buldas A, Kroonmaa A, Laanoja R, 2013. Keyless signatures’ infrastructure: how to build global distributed hashtrees. Nordic Conf on Secure IT Systems, p.313–320. https://doi.org/10.1007/978-3-642-41488-6_21
Cao Y, Chan AB, Lau RW, 2012. Automatic stylistic manga layout. ACM Trans Graph, 31(6):141–151. https://doi.org/10.1145/2366145.2366160
Charpiat G, Hofmann M, Schölkopf B, 2008. Automatic image colorization via multimodal predictions. European Conf on Computer Vision, p.126–139. https://doi.org/10.1007/978-3-540-88690-7_10
Choi J, Kim C, 2016. Object-aware image thumbnailing using image classification and enhanced detection of ROI. Multim Tools Appl, 75(23):16191–16207. https://doi.org/10.1007/s11042-015-2926-5
Geigel J, Loui A, 2003. Using genetic algorithms for album page layouts. IEEE Multim, 10(4):16–27. https://doi.org/10.1109/MMUL.2003.1237547
Gu Z, Lou J, 2016. Data driven webpage color design. Comput Aid Des, 77:46–59. https://doi.org/10.1016/j.cad.2016.03.001
Hussain Z, Zhang M, Zhang X, et al., 2017. Automatic understanding of image and video advertisements. IEEE Conf on Computer Vision and Pattern Recognition, p.1705–1715. https://doi.org/10.1109/CVPR.2017.123
Jahanian A, Liu J, Tretter DR, et al., 2012. Automatic design of magazine covers. IS&T/SPIE Electronic Imaging, Article 83020N. https://doi.org/10.1117/12.914596
Jiang B, Zhang L, Lu H, et al., 2013. Saliency detection via absorbing Markov chain. IEEE Int Conf on Computer Vision, p.1665–1672. https://doi.org/10.1109/TIP.2017.2766787
Labrecque LI, Milne GR, 2012. Exciting red and competent blue: the importance of color in marketing. J Acad Mark Sci, 40(5):711–727. https://doi.org/10.1007/s11747-010-0245-y
Li J, Xu T, Zhang J, et al., 2019. LayoutGAN: generating graphic layouts with wireframe discriminator. https://arxiv.org/abs/1901.06767
Li X, Zhao H, Nie G, et al., 2015. Image recoloring using geodesic distance based color harmonization. Comput Vis Media, 1(2):143–155. https://doi.org/10.1007/s41095-015-0013-5
Li Y, Qi H, Dai J, et al., 2017. Fully convolutional instance-aware semantic segmentation. IEEE Conf on Computer Vision and Pattern Recognition, p.2359–2367. https://doi.org/10.1109/CVPR.2017.472
Lin S, Hanrahan P, 2013. Modeling how people extract color themes from images. SIGCHI Conf on Human Factors in Computing Systems, p.3101–3110. https://doi.org/10.1145/2470654.2466424
Lin S, Ritchie D, Fisher M, et al., 2013. Probabilistic color-by-numbers: suggesting pattern colorizations using factor graphs. ACM Trans Graph, 32(4):37. https://doi.org/10.1145/2461912.2461988
Liu KL, Li W, Yang CY, et al., 2019. Intelligent design of multimedia content in Alibaba. Front Inform Technol Electron Eng, 20(12):1657–1664. https://doi.org/10.1631/FITEE.1900580
O’Donovan P, Agarwala A, Hertzmann A, 2011. Color compatibility from large datasets. ACM Trans Graph, 30(4):63–75. https://doi.org/10.1145/2010324.1964958
O’Donovan P, Agarwala A, Hertzmann A, 2014. Learning layouts for single-pagegraphic designs. IEEE Trans Vis Comput Graph, 20(8):1200–1213. https://doi.org/10.1109/TVCG.2014.48
O’Donovan P, Agarwala A, Hertzmann A, 2015. Design-Scape: design with interactive layout suggestions. 33rd Annual ACM Conf on Human Factors in Computing Systems, p.1221–1224. https://doi.org/10.1145/2702123.2702149
Qiang YT, Fu YW, Yu X, et al., 2019. Learning to generate posters of scientific papers by probabilistic graphical models. J Comput Sci Techn, 34(1):155–169. https://doi.org/10.1007/s11390-019-1904-1
Russell BC, Torralba A, Murphy KP, et al., 2008. Labelme: a database and web-based tool for image annotation. Int J Comput Vis, 77(1–3):157–173. https://doi.org/10.1007/s11263-007-0090-8
Scott DW, Sain SR, 2005. 9 - multidimensional density estimation. Handbook Stat, 24:229–261. https://doi.org/10.1016/S0169-7161(04)24009-3
Seo S, Park Y, Ostromoukhov V, 2013. Image recoloring using linear template mapping. Multim Tools Appl, 64(2):293–308. https://doi.org/10.1007/s11042-012-1024-1
Tang YC, Huang JJ, Yao MT, et al., 2019. A review of design intelligence: progress, problems, and challenges. Front Inform Technol Electron Eng, 20(12):1595–1617. https://doi.org/10.1631/FITEE.1900398
Tokumaru M, Muranaka N, Imanishi S, 2002. Color design support system considering color harmony. IEEE World Congress on Computational Intelligence, p.378–383. https://doi.org/10.1109/FUZZ.2002.1005020
Tuch AN, Bargas-Avila JA, Opwis K, 2010. Symmetry and aesthetics in website design: it’s a man’s business. Comput Human Behav, 26(6):1831–1837. https://doi.org/10.1016/j.chb.2010.07.016
Wang TC, Liu MY, Zhu JY, et al., 2018. High-resolution image synthesis and semantic manipulation with conditional GANs. IEEE Conf on Computer Vision and Pattern Recognition, p.8798–8807. https://doi.org/10.1109/CVPR.2018.00917
Xu T, Zhang P, Huang Q, et al., 2018. AttnGAN: finegrained text to image generation with attentional generative adversarial networks. IEEE Conf on Computer Vision and Pattern Recognition, p.1316–1324. https://doi.org/10.1109/CVPR.2018.00143
Yang X, Mei T, Xu YQ, et al., 2016. Automatic generation of visual-textual presentation layout. ACM Trans Multim Comput Commun Appl, 12(2):33–55. https://doi.org/10.1145/2818709
You WT, Sun LY, Yang ZY, et al., 2019. Automatic advertising image color design incorporating a visual color analyzer. J Comput Lang, 55:100910. https://doi.org/10.1016/j.cola.2019.100910
Yu LF, Yeung SK, Tang CK, et al., 2011. Make it home: automatic optimization of furniture arrangement. ACM Trans Graph, 30(4):86:1–86:12. https://doi.org/10.1145/2010324.1964981
Zhang Y, Hu K, Ren P, et al., 2017. Layout style modeling for automating banner design. Thematic Workshops of ACM Multimedia, p.451–459. https://doi.org/10.1145/3126686.3126718
Zheng X, Qiao X, Cao Y, et al., 2019. Content-aware generative modeling of graphic design layouts. ACM Trans Graph, 38(4):133. https://doi.org/10.1145/3306346.3322971
Zhu JY, Park T, Isola P, et al., 2017. Unpaired image-to-image translation using cycle-consistent adversarial networks. IEEE Int Conf on Computer Vision, p.2223–2232. https://doi.org/10.1109/ICCV.2017.244
Author information
Authors and Affiliations
Corresponding author
Additional information
Project supported by the National Science and Technology Innovation 2030 Major Project of the Ministry of Science and Technology of China (No. 2018AAA0100700), the National Natural Science Foundation of China (No. 61672451), the Provincial Key Research and Development Plan of Zhejiang Province, China (No. 2019C03137), the China Postdoctoral Science Foundation (No. 2018M630658), and the Alibaba-Zhejiang University Joint Institute of Frontier Technologies
Contributors
Wei-tao YOU and Zhi-yuan YANG designed the research. Wei-tao YOU and Hao JIANG processed the data. Wei-tao YOU drafted the manuscript. Hao JIANG and Lingyun SUN helped organize the manuscript. Hao JIANG, Chang-yuan YANG, and Ling-yun SUN revised and finalized the paper.
Compliance with ethics guidelines
Wei-tao YOU, Hao JIANG, Zhi-yuan YANG, Chang-yuan YANG, and Ling-yun SUN declare that they have no conflict of interest.
Rights and permissions
About this article
Cite this article
You, Wt., Jiang, H., Yang, Zy. et al. Automatic synthesis of advertising images according to a specified style. Front Inform Technol Electron Eng 21, 1455–1466 (2020). https://doi.org/10.1631/FITEE.1900367
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1631/FITEE.1900367