skip to main content
research-article

Automatic Generation of Visual-Textual Presentation Layout

Published: 09 February 2016 Publication History

Abstract

Visual-textual presentation layout (e.g., digital magazine cover, poster, Power Point slides, and any other rich media), which combines beautiful image and overlaid readable texts, can result in an eye candy touch to attract users’ attention. The designing of visual-textual presentation layout is therefore becoming ubiquitous in both commercially printed publications and online digital magazines. However, handcrafting aesthetically compelling layouts still remains challenging for many small businesses and amateur users. This article presents a system to automatically generate visual-textual presentation layouts by investigating a set of aesthetic design principles, through which an average user can easily create visually appealing layouts. The system is attributed with a set of topic-dependent layout templates and a computational framework integrating high-level aesthetic principles (in a top-down manner) and low-level image features (in a bottom-up manner). The layout templates, designed with prior knowledge from domain experts, define spatial layouts, semantic colors, harmonic color models, and font emotion and size constraints. We formulate the typography as an energy optimization problem by minimizing the cost of text intrusion, the utility of visual space, and the mismatch of information importance in perception and semantics, constrained by the automatically selected template and further preserving color harmonization. We demonstrate that our designs achieve the best reading experience compared with the reimplementation of parts of existing state-of-the-art designs through a series of user studies.

References

[1]
Rudolf Arnheim. 1954. Art and visual perception: A psychology of the creative eye. University of California Press, berkeley and Los Angeles.
[2]
Shai Avidan and Ariel Shamir. 2007. Seam Carving for Content-aware Image Resizing. ACM Transactions on Graphics (TOG) 26, 3 (2007), 10.
[3]
Michael Bauerly and Yili Liu. 2006. Computational modeling and experimental investigation of effects of compositional elements on interface and design aesthetics. International Journal of Human-Computer Studies 64, 8 (2006), 670--682.
[4]
Ming-Ming Cheng, Guo-Xin Zhang, Niloy J Mitra, Xiaolei Huang, and Shi-Min Hu. 2011. Global contrast based salient region detection. In 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 409--416.
[5]
Daniel Cohen-Or, Olga Sorkine, Ran Gal, Tommer Leyvand, and Ying-Qing Xu. 2006. Color Harmonization. ACM Transactions on Graphics 25, 3 (2006), 624--630.
[6]
Catherine Havasi, Robert Speer, and Justin Holmgren. 2010. Automated color selection using semantic knowledge. In Proceedings of the AAAI Fall Symposium Series.
[7]
Qiang Huo and Zhi-Dan Feng. 2003. Improving Chinese/English OCR performance by using MCE-based character-pair modeling and negative training. In Proceedings of International Conference on Document Analysis and Recognition. IEEE, 364--368.
[8]
Charles Jacobs, Wilmot Li, Evan Schrier, David Bargeron, and David Salesin. 2003. Adaptive Grid-based Document Layout. ACM Transactions on Graphics 22, 3 (2003), 838--847.
[9]
Ali Jahanian, Jerry Liu, Qian Lin, Daniel Tretter, Eamonn O’Brien-Strain, Seungyon Claire Lee, Nic Lyons, and Jan Allebach. 2013. Recommendation System for Automatic Design of Magazine Covers. In Proceedings of International Conference on Intelligent User Interfaces. ACM, 95--106.
[10]
Ali Jahanian, Jerry Liu, Daniel R. Tretter, Qian Lin, Niranjan Damera-Venkata, Eamonn O’Brien-Strain, Seungyon Lee, Jian Fan, and Jan P. Allebach. 2012. Automatic design of magazine covers. In IS&T/SPIE Electronic Imaging. International Society for Optics and Photonics, 83020N--83020N.
[11]
Shigenobu Kobayashi and Louella Matsunaga. 1991. Color image scale. Kodansha international Tokyo.
[12]
Alexander Kröner. 1999. The DesignComposer: Context-based automated layout for the internet. In Proceedings of the AAAI Fall Symposium Series: Using Layout for the Generation, Understanding, or Retrieval of Documents.
[13]
Mikko Kuhna, Ida-Maria Kivelä, and Pirkko Oittinen. 2012. Semi-automated Magazine Layout Using Content-based Image Features. In Proceedings of the 20th ACM international conference on Multimedia (MM’12). ACM, ACM, New York, NY, USA, 379--388.
[14]
Lin Liang, Rong Xiao, Fang Wen, and Jian Sun. 2008. Face alignment via component-based discriminative search. In Computer Vision--ECCV 2008 (Lecture Notes in Computer Science), Vol. 5303. Springer Berlin Heidelberg, 72--85.
[15]
Ligang Liu, Renjie Chen, Lior Wolf, and Daniel Cohen-Or. 2010. Optimizing photo composition. In Computer Graphics Forum, Vol. 29. Wiley Online Library, 469--478.
[16]
Simon Lok and Steven Feiner. 2001. A survey of automated layout techniques for information presentations. Proceedings of SmartGraphics 2001 (2001), 61--68.
[17]
Tao Mei, Lusong Li, Xian-Sheng Hua, and Shipeng Li. 2012. ImageSense: Towards contextual image advertising. ACM Transactions on Multimedia Computing, Communications, and Applications 8, 1 (2012), 6.
[18]
Albert Henry Munsell. 1950. Munsell book of color. Munsell Color Company.
[19]
Naila Murray, Luca Marchesotti, and Florent Perronnin. 2012. AVA: A large-scale database for aesthetic visual analysis. In 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 2408--2415.
[20]
Masataka Tokumaru, Noriaki Muranaka, and Shigeru Imanishi. 2002. Color design support system considering color harmony. In Proceedings of the IEEE International Conference on Fuzzy System, 2002 (FUZZ-IEEE’02), Vol. 1. IEEE, 378--383.
[21]
Daniel Vaquero, Matthew Turk, Kari Pulli, Marius Tico, and Natasha Gelfand. 2010. A survey of image retargeting techniques. In Proc. SPIE, Vol. 7798. International Society for Optics and Photonics, 779814--779814--15.
[22]
Wenyuan Yin, Tao Mei, and Chang Wen Chen. 2013. Automatic generation of social media snippets for mobile browsing. In Proceedings of the 21st ACM international conference on Multimedia (MM’13). ACM, New York, NY, USA, 927--936.
[23]
Michelle X. Zhou and Sheng Ma. 1999. Toward applying machine learning to design rule acquisition for automated graphics generation. In Proc. 2000 AAAI Spring Symp. on Smart Graphics. 16--23.

Cited By

View all
  • (2025)Auto-3D-house Design from Structured User RequirementsMachine Intelligence Research10.1007/s11633-024-1498-0Online publication date: 7-Jan-2025
  • (2024)Utilizing Chaotic Logistic Keys for LSB1 and LSB2 Message SteganographyEngineering, Technology & Applied Science Research10.48084/etasr.839914:6(17912-17921)Online publication date: 2-Dec-2024
  • (2024)Generate custom travel magazine layoutsIntelligent Data Analysis10.3233/IDA-23006328:3(825-840)Online publication date: 1-Jan-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Multimedia Computing, Communications, and Applications
ACM Transactions on Multimedia Computing, Communications, and Applications  Volume 12, Issue 2
March 2016
224 pages
ISSN:1551-6857
EISSN:1551-6865
DOI:10.1145/2837041
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 February 2016
Accepted: 01 August 2015
Revised: 01 August 2015
Received: 01 November 2014
Published in TOMM Volume 12, Issue 2

Permissions

Request permissions for this article.

Check for updates

Badges

  • Best Paper

Author Tags

  1. Visual-textual presentation layout
  2. color harmonization
  3. design templates
  4. rich media presentation
  5. typography

Qualifiers

  • Research-article
  • Research
  • Refereed

Funding Sources

  • Microsoft Research Asia

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)125
  • Downloads (Last 6 weeks)9
Reflects downloads up to 28 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2025)Auto-3D-house Design from Structured User RequirementsMachine Intelligence Research10.1007/s11633-024-1498-0Online publication date: 7-Jan-2025
  • (2024)Utilizing Chaotic Logistic Keys for LSB1 and LSB2 Message SteganographyEngineering, Technology & Applied Science Research10.48084/etasr.839914:6(17912-17921)Online publication date: 2-Dec-2024
  • (2024)Generate custom travel magazine layoutsIntelligent Data Analysis10.3233/IDA-23006328:3(825-840)Online publication date: 1-Jan-2024
  • (2024)Advertisement Synthesis Network for Automatic Advertisement Image SynthesisInternational Journal of Antennas and Propagation10.1155/2024/80309072024(1-10)Online publication date: 18-Mar-2024
  • (2024)"It's like Goldilocks:" Bespoke Slides for Fluctuating Audience Access NeedsProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675640(1-15)Online publication date: 27-Oct-2024
  • (2024)Color Transfer for Images: A SurveyACM Transactions on Multimedia Computing, Communications, and Applications10.1145/363515220:8(1-29)Online publication date: 9-Jul-2024
  • (2024)Thinking Outside the Box: Non-Designer Perspectives and Recommendations for Template-Based Graphic Design ToolsExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650967(1-9)Online publication date: 11-May-2024
  • (2024)Desigen: A Pipeline for Controllable Design Template Generation2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52733.2024.01209(12721-12732)Online publication date: 16-Jun-2024
  • (2024)Retrieval-Augmented Layout Transformer for Content-Aware Layout Generation2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52733.2024.00015(67-76)Online publication date: 16-Jun-2024
  • (2024)Intelligent Graphic Layout Generation: Current Status and Future Perspectives2024 27th International Conference on Computer Supported Cooperative Work in Design (CSCWD)10.1109/CSCWD61410.2024.10580676(2632-2637)Online publication date: 8-May-2024
  • Show More Cited By

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media