Skip to main content

Evolutionary Typesetting: An Automatic Approach Towards the Generation of Typographic Posters from Tweets

  • Conference paper
  • First Online:
Interactivity and Game Creation (ArtsIT 2020)

Abstract

The recent developments on Artificial Intelligence are expanding the tools, methods, media, and production processes on Graphic Design. Poster designs are no exception. In this paper, we present a web system that generates letterpress-inspired typographic posters using, as content, tweets posted online. The proposed system employs Natural Language Understanding approaches to recognise the emotions, the sentiments, and the colours associated with the content. Also, the system employs an Evolutionary Computation approach to generate and evolve a population of poster designs. The outputs are evaluated according to their legibility, aesthetics, and semantics, throughout an automatic fitness assignment hybrid scheme that combines a hardwired fitness function part with a multi-objective optimisation approach part. We experimented with the system to perceive its behaviour and its ability to evolve posters from contents with distinct textual purposes and lengths.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Adobe: Adobe typekit web fonts (2020). https://fonts.adobe.com/typekit/

  2. Armstrong, H., Stojmirovic, Z.: Participate: Designing with User-Generated Content. Princeton Architectural Press, New York (2011)

    Google Scholar 

  3. AXA Group Operations Spain S.A.: Nlp.js (2020). https://github.com/axa-group/nlp.js/

  4. Blauvelt, A.: The persistence of posters. In: Blauvelt, A., Lupton, E. (eds.) Graphic Design: Now in Production, chap. 11, pp. 92–111. Walker Art Center, Minneapolis (2011)

    Google Scholar 

  5. Bringhurst, R.: The Elements of Typographic Style, 3rd edn. Hartley & Marks, Vancouver (2005)

    Google Scholar 

  6. Cleveland, P.: Style based automated graphic layouts. Des. Stud. 31(1), 3–25 (2010)

    Article  Google Scholar 

  7. Cooper, M.: Computers and design. Des. Q. 1(142), 1–31 (1989)

    MathSciNet  Google Scholar 

  8. Cunha, J.M., Lourenço, N., Correia, J., Martins, P., Machado, P.: Emojinating: evolving emoji blends. In: Ekárt, A., Liapis, A., Castro Pena, M.L. (eds.) EvoMUSART 2019. LNCS, vol. 11453, pp. 110–126. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-16667-0_8

    Chapter  Google Scholar 

  9. Damera-Venkata, N., Bento, J., O’Brien-Strain, E.: Probabilistic document model for automated document composition. In: Proceedings of the 11th ACM Symposium on Document Engineering, September 2011, pp. 3–12. ACM, Mountain View (2011)

    Google Scholar 

  10. De Bleser, F.: Generative design: the nodebox perpective. Ph.D. thesis, University of Antwerp, Antwerp, Belgium (2016)

    Google Scholar 

  11. Dorris, N., Carnahan, B., Orsini, L., Kuntz, L.A.: Interactive evolutionary design of anthropomorphic symbols. In: Proceedings of the 2004 Congress on Evolutionary Computation, 19–23 June 2004, pp. 433–440. IEEE, Portland (2004)

    Google Scholar 

  12. Eiben, A.E., Smith, J.E.: Introduction to Evolutionary Computing, 2nd edn. Springer, Heidelberg (2015). https://doi.org/10.1007/978-3-662-44874-8

    Book  MATH  Google Scholar 

  13. Frascara, J.: Graphic design: fine art or social science? Des. Issues 5(1), 18–29 (1988)

    Article  Google Scholar 

  14. Gatarski, R.: Breed better banners: design automation through on-line interaction. J. Interact. Mark. 16(1), 2–13 (2002)

    Article  Google Scholar 

  15. Goldenberg, E.: Automatic layout of variable-content print data. Master’s thesis, University of Sussex, Brighton, United Kingdom (2002)

    Google Scholar 

  16. Groß, B., Laub, J.: Diploma - generative systeme posters (2007). https://benedikt-gross.de/projects/diploma-generative-systeme-posters/

  17. Guffey, E.E.: Posters: A Global History. Reaktion Books, London (2014)

    Google Scholar 

  18. Harrington, S.J., Naveda, J.F., Jones, R.P., Roetling, P., Thakkar, N.: Aesthetic measures for automated document layout. In: Proceedings of the 2004 ACM Symposium on Document Engineering, October 2004, pp. 109–111. ACM, Milwaukee (2004)

    Google Scholar 

  19. Hyndman, S.: Why Fonts Matter. Virgin Books, London (2016)

    Google Scholar 

  20. Kitamura, S., Kanoh, H.: Developing support system for making posters with interactive evolutionary computation. In: 2011 Fourth International Symposium on Computational Intelligence and Design, 28–30 October 2011, pp. 48–51. IEEE, Hangzhou (2011)

    Google Scholar 

  21. Klein, D.: Crossing, mixing, mutation (2012). http://www.gutenberg-intermedia.de/wissenschaft-gestaltung/denis-klein-crossing-mixing-mutation/

  22. Koch, B.E.: Emotion in typographic design: an empirical examination. Visible Lang. 46(3), 206–227 (2012)

    Google Scholar 

  23. Leavitt, R.: Artist and Computer. Harmony Books, New York (1976)

    Google Scholar 

  24. LESS: Evolving layout (2016). http://www.evolvinglayout.com/

  25. Levin, G., Feinberg, J., Curtis, C.: Alphabet synthesis machine (2002). http://web.archive.org/web/20080513044335/www.alphabetsynthesis.com/

  26. Lewis, M.: Evolutionary visual art and design. In: Romero, J., Machado, P. (eds.) The Art of Artificial Evolution: A Handbook on Evolutionary Art and Music, pp. 3–37. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-72877-1_1. chap. 1

    Chapter  Google Scholar 

  27. Li, J., Yang, J., Hertzmann, A., Zhang, J., Xu, T.: LayoutGAN: synthesizing graphic layouts with vector-wireframe adversarial networks. IEEE Trans. Pattern Anal. Mach. Intell., 1 (2020). https://doi.org/10.1109/TPAMI.2019.2963663

  28. Lupton, E.: Thinking With Type: A Critical Guide for Designers, Writers, Editors, & Students, 2nd edn. Princeton Architectural Press, New York (2010)

    Google Scholar 

  29. LUST: Graphic design museum: Poster wall for the 21st century (2008). https://lust.nl/#projects-3041/

  30. LUST: Camera postura (2014). http://lust.nl/#projects-5939/

  31. Maeda, J.: Maeda@Media. Thames & Hudson, London (2000)

    Google Scholar 

  32. Martins, T., Correia, J., Costa, E., Machado, P.: Evolving stencils for typefaces: combining machine learning, user’s preferences and novelty. Complexity, 2019 (2019)

    Google Scholar 

  33. McCarthy, L.: Processing Foundation, NYU ITP: P5.js (2020). https://p5js.org/

  34. Meggs, P.B., Purvis, A.W.: Meggs’ History of Graphic Design, 6th edn. Wiley, New York (2016)

    Google Scholar 

  35. Mohammad, S.M.: Colourful language: measuring word-colour associations. In: Proceedings of the Second Workshop on Cognitive Modeling and Computational Linguistics, June 2011, pp. 97–106. ACL, Portland (2011)

    Google Scholar 

  36. Mohammad, S.M., Bravo-Marquez, F.: Emotion intensities in tweets. In: Proceedings of the Sixth Joint Conference on Lexical and Computational Semantics (*Sem), August 2017, pp. 65–77. ACL, Vancouver (2017)

    Google Scholar 

  37. Mohammad, S.M., Turney, P.D.: Crowdsourcing a word-emotion association lexicon. Comput. Intell. 29(3), 436–465 (2012)

    Article  MathSciNet  Google Scholar 

  38. Morcilllo, C.G., Martin, V.J., Fernandez, D.V., Sanchez, J.J.C., Albusac, J.A.: Gaudii: an automated graphic design expert system. In: Proceedings of the Twenty-Second Conference on Innovative Applications of Artificial Intelligence, 11–15 July 2010, pp. 1775–1780. AAAI, Atlanta (2010)

    Google Scholar 

  39. Müller, B.: Poetry on the road 2002–2013 (2002). https://www.esono.com/boris/projects/poetry02/

  40. O’Donovan, P., Agarwala, A., Hertzmann, A.: Learning layouts for single-page graphic designs. IEEE Trans. Vis. Comput. Graph. 20(8), 1200–1213 (2014)

    Article  Google Scholar 

  41. Oliver, A., Monmarché, N., Venturini, G.: Interactive design of web sites with a genetic algorithm. In: Isaías, P. (ed.) Proceedings of the IADIS International Conference WWW/INTERNET, 13–15 November 2002, pp. 355–362. Lisbon, Portugal (2002)

    Google Scholar 

  42. Önduygu, D.C.: Graphagos: evolutionary algorithm as a model for the creative process and as a tool to create graphic design products. Master’s thesis, Sabancı University (2010)

    Google Scholar 

  43. Plutchik, R.: A general psychoevolutionary theory of emotion. In: Plutchik, R., Kellerman, H. (eds.) Theories of Emotion, chap. 1, pp. 3–33. Academic Press, Cambridge (1980)

    Google Scholar 

  44. Purvis, L., Harrington, S., O’Sullivan, B., Freuder, E.C.: Creating personalized documents: an optimization approach. In: Proceedings of the 2003 ACM Symposium on Document Engineering, 29 September–2 October 2003, pp. 68–77. ACM, San Jose (2003)

    Google Scholar 

  45. Quiroz, J.C., Banerjee, A., Louis, S.J., Dascalu, S.M.: Document design with interactive evolution, chap. 29. In: Damiani, E., Jeong, J., Howlett, R.J., Jain, L.C. (eds.) New Directions in Intelligent Interactive Multimedia Systems and Services. Studies in Computational Intelligence, vol. 226, pp. 309–319. Springer, Heidelberg (2009). https://doi.org/10.1007/978-3-642-02937-0_28

    Chapter  Google Scholar 

  46. Rebelo, S., Bicker, J., Machado, P.: Evolutionary experiments in typesetting of letterpress-inspired posters. In: Cardoso, F.A., Machado, P., Veale, T., Cunha, J.M. (eds.) Proceedings of the Eleventh International Conference on Computational Creativity, Coimbra, Portugal, 7–11 September 2020, pp. 110–114 (2020)

    Google Scholar 

  47. Rebelo, S., Fonseca, C.M., Bicker, J., Machado, P.: Evolutionary experiments in the development of typographical posters. In: Rangel, A., Ribas, L., Verdicchio, M., Carvalhais, M. (eds.) 6th Conference on Computation, Communication, Aesthetics & X (xCoAx 2018), pp. 65–75. Universidade do Porto, Madrid (2018)

    Google Scholar 

  48. Rebelo, S., Pires, C., Martins, P., Bicker, J., Machado, P.: Designing posters towards a seamless integration in urban surroundings: a computational approach. In: ARTECH 2019: Proceedings of the Ninth International Conference on Digital and Interactive Arts, Article 54. ACM, Braga (2019)

    Google Scholar 

  49. Reynar, J.C., Ratnaparkhi, A.: A maximum entropy approach to identifying sentence boundaries. In: Proceedings of the Fifth Conference on Applied Natural Language Processing, March 1997, pp. 16–19. ACL, Washington, DC (1997)

    Google Scholar 

  50. Richardson, A.: Data-Driven Graphic Design: Creative Coding for Visual Communication. Bloomsbury Publishing, London (2016)

    Google Scholar 

  51. Rodenbröker, T.: Programming posters (2018). https://timrodenbroeker.de/projects/programming-posters/

  52. Srinivas, N., Deb, K.: Muiltiobjective optimization using nondominated sorting in genetic algorithms. Evol. Comput. 2(3), 221–248 (1994)

    Article  Google Scholar 

  53. Stephan, B., Haag, C.: Bash scripts for generative posters. Libre Graph. Mag. 3(1), 30–34 (2011)

    Google Scholar 

  54. Syswerda, G.: Uniform crossover in genetic algorithms. In: Proceedings of the Third International Conference on Genetic Algorithms, June 1989, pp. 2–9. Morgan Kaufmann Publishers Inc., Fairfax (1989)

    Google Scholar 

  55. Zhang, Y., Hu, K., Ren, P., Yang, C., Xu, W., Hua, X.S.: Layout style modeling for automating banner design. In: Proceedings of the on Thematic Workshops of ACM Multimedia 2017, October 2017, pp. 451–459. ACM, Mountain View (2017)

    Google Scholar 

  56. Zheng, X., Qiao, X., Cao, Y., Lau, R.W.H.: Content-aware generative modeling of graphic design layouts. ACM Trans. Graph. 38(4), Article 133 (2019)

    Google Scholar 

Download references

Acknowledgments

This work is partially supported by national funds through the Foundation for Science and Technology (FCT), Portugal, within the scope of the project UID/CEC/00326/2019. The first author is funded by FCT under the grant SFRH/BD/132728/2017.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Sérgio M. Rebelo .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Rebelo, S.M., Bicker, J., Machado, P. (2021). Evolutionary Typesetting: An Automatic Approach Towards the Generation of Typographic Posters from Tweets. In: Brooks, A., Brooks, E.I., Jonathan, D. (eds) Interactivity and Game Creation. ArtsIT 2020. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 367. Springer, Cham. https://doi.org/10.1007/978-3-030-73426-8_21

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-73426-8_21

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-73425-1

  • Online ISBN: 978-3-030-73426-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics