Skip to main content
SpringerLink
Log in
Book cover

International Conference on Computational Linguistics and Intelligent Text Processing

CICLing 2019: Computational Linguistics and Intelligent Text Processing pp 3–16Cite as

Visual Aids to the Rescue: Predicting Creativity in Multimodal Artwork

  • Conference paper
  • First Online:

  • 347 Accesses

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 13451))

Abstract

Creativity is the key factor in successful advertising where catchy and memorable media is produced to persuade the audience. Considering not only advertising slogans but also the visual design of the same advertisements would provide a perceptual grounding for the overall creativity, consequently the overall message of the advertisement. In this study, we propose the exploitation of visual modality in creativity assessment of naturally multimodal design. To the best of our knowledge, this is the first study focusing on the computational detection of multimodal creative work. To achieve our goal, we employ several linguistic creativity detection features in combination with bag of visual words model and observable artistic visual features. The results of the creativity detection experiment show that combining linguistic and visual features significantly improves the unimodal creativity detection performances.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    http://adsoftheworld.com/.

  2. 2.

    http://adcglobal.org/awards/.

  3. 3.

    http://www.canneslions.com/.

  4. 4.

    http://www.cs.cmu.edu/~biglou/resources/.

  5. 5.

    http://www.ldc.upenn.edu/Catalog/catalogEntry.jsp?catalogId=LDC2011T07.

  6. 6.

    https://hlt-nlp.fbk.eu/technologies/sensicon.

  7. 7.

    https://hlt-nlp.fbk.eu/technologies/hlt-phonetic-scorer.

  8. 8.

    https://adsoftheworld.com/media/print/eco_lamp?size=original.

References

  1. Ang, S.H., Low, S.Y.: Exploring the dimensions of ad creativity. Psychol. Mark. 17(10), 835–854 (2000)

    Article  Google Scholar 

  2. Boden, M.A.: Dimensions of Creativity. MIT Press, Cambridge (1996)

    Google Scholar 

  3. Bruni, E., Boleda, G., Baroni, M., Tran, N.K.: Distributional semantics in technicolor. In: Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics: Long Papers-Volume 1, pp. 136–145. Association for Computational Linguistics (2012)

    Google Scholar 

  4. Bruni, E., Tran, G.B., Baroni, M.: Distributional semantics from text and images. In: Proceedings of the GEMS 2011 Workshop on Geometrical Models of Natural Language Semantics, pp. 22–32. Association for Computational Linguistics (2011)

    Google Scholar 

  5. Bruni, E., Tran, N.K., Baroni, M.: Multimodal distributional semantics. J. Artif. Intell. Res. (JAIR) 49, 1–47 (2014)

    Article  MathSciNet  MATH  Google Scholar 

  6. Danescu-Niculescu-Mizil, C., Cheng, J., Kleinberg, J., Lee, L.: You had me at hello: how phrasing affects memorability. In: Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics: Long Papers-Volume 1, pp. 892–901. Association for Computational Linguistics (2012)

    Google Scholar 

  7. Duda, R.O., Hart, P.E.: Use of the hough transformation to detect lines and curves in pictures. Commun. ACM 15(1), 11–15 (1972)

    Article  MATH  Google Scholar 

  8. Elgammal, A., Saleh, B.: Quantifying creativity in art networks. In: Proceedings of the 6th International Conference on Computational Creativity, p. 39 (2015)

    Google Scholar 

  9. Feng, Y., Lapata, M.: Visual information in semantic representation. In: Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics, pp. 91–99. Association for Computational Linguistics (2010)

    Google Scholar 

  10. Fichner-Rathus, L.: Foundations of Art and Design: An Enhanced, Media Cengage Learning, Boston (2011)

    Google Scholar 

  11. Guerini, M., Özbal, G., Strapparava, C.: Echoes of persuasion: the effect of euphony in persuasive communication. In: Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics (NAACL-2015), pp. 1483–1493. Denver, Colorado (2015)

    Google Scholar 

  12. Jarvie, I.: The rationality of creativity. In: Dutton, D., Krausz, M. (eds.) Thinking About Society: Theory and Practice, pp. 282–301. Springer, Dordrecht (1981)

    Chapter  Google Scholar 

  13. Kiela, D., Clark, S.: Multi-and cross-modal semantics beyond vision: grounding in auditory perception. In: Proceedings of the EMNLP (2015)

    Google Scholar 

  14. Kuznetsova, P., Chen, J., Choi, Y.: Understanding and quantifying creativity in lexical composition. In: EMNLP, pp. 1246–1258 (2013)

    Google Scholar 

  15. Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vision 60(2), 91–110 (2004). https://doi.org/10.1023/B:VISI.0000029664.99615.94

    Article  Google Scholar 

  16. McNemar, Q.: Note on the sampling error of the difference between correlated proportions or percentages. Psychometrika 12(2), 153–157 (1947). https://doi.org/10.1007/BF02295996

    Article  Google Scholar 

  17. Mohammad, S.M., Turney, P.D.: Emotions evoked by common words and phrases: Using mechanical turk to create an emotion lexicon. In: Proceedings of the NAACL HLT 2010 Workshop on Computational Approaches to Analysis and Generation of Emotion in Text, pp. 26–34. Association for Computational Linguistics (2010)

    Google Scholar 

  18. Özbal, G., Pighin, D., Strapparava, C.: Brainsup: Brainstorming support for creative sentence generation. In: ACL, vol. 1, pp. 1446–1455 (2013)

    Google Scholar 

  19. Özbal, G., Pighin, D., Strapparava, C.: BrainSup: Brainstorming support for creative sentence generation. In: Proceedings of ACL’13 (Volume 1: Long Papers), pp. 1446–1455. Association for Computational Linguistics (2013). http://aclweb.org/anthology/P13-1142

  20. Özbal, G., Strapparava, C., Guerini, M.: Brand pitt: a corpus to explore the art of naming. In: Proceedings of the LREC, pp. 1822–1828. Citeseer (2012)

    Google Scholar 

  21. Pedregosa, F., et al.: Scikit-learn: machine learning in Python. J. Mach. Learn. Res. 12, 2825–2830 (2011)

    MathSciNet  MATH  Google Scholar 

  22. Pricken, M.: Creative Advertising Ideas and Techniques from the World’s Best Campaigns. Thames & Hudson, 2\(^{nd}\) edn. (2008)

    Google Scholar 

  23. Sartori, A., Yan, Y., Ozbal, G., Salah, A., Salah, A., Sebe, N.: Looking at mondrian’s victory boogie-woogie: what do i feel? In: International Joint Conferences on Artificial Intelligence (IJCAI) (2015)

    Google Scholar 

  24. Shutova, E., Kiela, D., Maillard, J.: Black holes and white rabbits: metaphor identification with visual features (2016)

    Google Scholar 

  25. Silberer, C., Lapata, M.: Learning grounded meaning representations with autoencoders. In: ACL, vol. 1, pp. 721–732 (2014)

    Google Scholar 

  26. Smith, R.E., MacKenzie, S.B., Yang, X., Buchholz, L.M., Darley, W.K.: Modeling the determinants and effects of creativity in advertising. Mark. Sci. 26(6), 819–833 (2007)

    Article  Google Scholar 

  27. Tekiroglu, S.S., Özbal, G., Strapparava, C.: Sensicon: an automatically constructed sensorial lexicon. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 1511–1521. Association for Computational Linguistics, Doha, Qatar (2014). http://www.aclweb.org/anthology/D14-1160

  28. Vedaldi, A., Fulkerson, B.: VLFeat: an open and portable library of computer vision algorithms (2008). http://www.vlfeat.org/

  29. Yang, J., Jiang, Y.G., Hauptmann, A.G., Ngo, C.W.: Evaluating bag-of-visual-words representations in scene classification. In: Proceedings of the International Workshop on Workshop on Multimedia Information Retrieval, pp. 197–206. ACM (2007)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. FBK-irst, Trento, Italy

    Carlo Strapparava, Serra Sinem Tekiroglu & Gözde Özbal

Authors
  1. Carlo Strapparava
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Serra Sinem Tekiroglu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Gözde Özbal
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Carlo Strapparava .

Editor information

Editors and Affiliations

  1. Instituto Politécnico Nacional, Mexico City, Mexico

    Alexander Gelbukh

Rights and permissions

Reprints and permissions

Copyright information

© 2023 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Strapparava, C., Tekiroglu, S.S., Özbal, G. (2023). Visual Aids to the Rescue: Predicting Creativity in Multimodal Artwork. In: Gelbukh, A. (eds) Computational Linguistics and Intelligent Text Processing. CICLing 2019. Lecture Notes in Computer Science, vol 13451. Springer, Cham. https://doi.org/10.1007/978-3-031-24337-0_1

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-24337-0_1

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-24336-3

  • Online ISBN: 978-3-031-24337-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation