Skip to main content

Transformation of Plants into Polka Dot Arts: Kusama Yayoi as an Inspiration for Deep Learning

  • Conference paper
  • First Online:
Universal Access in Human-Computer Interaction. Novel Design Approaches and Technologies (HCII 2022)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 13308))

Included in the following conference series:

  • 1200 Accesses

Abstract

Museums and galleries are places that stimulate the imagination and creativity of people. However, against the backdrop of the COVID-19 pandemic, many museums have been forced to close. As a result, more visitors have had to start visiting online exhibitions. Under this trend, the quality of the online exhibition experience is facing unprecedented challenges, and visitors need to be provided with a high-quality online experience. With the rapid development of emerging technologies, museums and galleries have started to use technology to create “digitalization” experiences, such as 3D virtual exhibitions and VR interactive experiences. The current online exhibition format focuses more on improving the visitor’s experience of viewing and browsing works and related information and less on how visitors create their artworks. In order to remedy the experience of visitors actively creating artworks, this study uses Yayoi Kusama’s works as a case study to help form an utterly interactive process between visitors and artworks. We propose a Polka Dot Arts Transfer Network (PDAT-net), mixing realistic-looking and Polka Dot Art-style reference images. The output image looks like an actual natural image “drawn” in the polka dot art style. The PDAT-net is trained to compose an image in the style of Polka Dot Arts, based on neural style transfer. Convolutional networks implemented the training. Plant images performed the final test. The results showed that the generated polka dot images have similar styles to the style images, proving that our PDAT-network has good transfer performance of Polka Dot Arts.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 109.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 139.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. United Nations Educational, Scientific and Cultural Organisation: UNESCO Report: Museums around the world in the face of COVID-19. UNESCO (2021). https://unesdoc.unesco.org/ark:/48223/pf0000376729_eng/PDF/376729eng.pdf.multi

  2. International Council of Museums: ICOM Report: Museums, museum profes-sionals and Covid-19: third survey. ICOM (2021). https://icom.museum/wp-content/uploads/2021/07/Museums-and-Covid-19_third-ICOM-report.pdf

  3. Hassenzahl, M., Tractinsky, N.: User experience-a research agenda. Behav. Inform. Technol. 25(2), 91–97 (2006)

    Article  Google Scholar 

  4. Holbrook, M.B.: The millennial consumer in the texts of our times: experience and entertainment. J. Macromark. 20(2), 178–192 (2000)

    Article  Google Scholar 

  5. Pine, B.J., Pine, J., Gilmore, J.H.: The Experience Economy: Work is Theatre & Every Business a Stage. Harvard Business Press, Boston (1999)

    Google Scholar 

  6. Kusama, Y.: Infinity Net: The Autobiography of Yayoi Kusama. Tate Enterprises Ltd., New York (2021)

    Google Scholar 

  7. Clavez, B.: Yayoi Kusama. Manhattan Suicide Addict. Critique d’art. Actualité internationale de la littérature critique sur l’art contemporain (26) (2005)

    Google Scholar 

  8. Darragon, E.: Pégase à Fernando. A propos de «Cirque» et du réalisme de Seurat en 1891. Revue de l'Art 86(1), 44–57 (1989)

    Google Scholar 

  9. Seurat, G., Morris, J.: A Sunday afternoon on the island of La Grande Jatte. Delta Image (1991)

    Google Scholar 

  10. Markowitz, S.: A Taste for Pop: Pop Art, Gender, and Consumer Culture (1999)

    Google Scholar 

  11. Summers, S.: Adapting a Retro Comic Aesthetic with Spider-Man: Into the Spider-Verse (2019)

    Google Scholar 

  12. Dell’Aria, A.: Yayoi Kusama: Infinity Mirrors (2017)

    Google Scholar 

  13. de la Calleja, E., Zenit, R.: Fractal dimension and topological invariants as methods to quantify complexity in Yayoi Kusama’s paintings. arXiv preprint arXiv:2012.06108 (2020)

  14. Galenson, D.: Artists and the market: from Leonardo and Titian to Andy Warhol and Damien Hirst (2007)

    Google Scholar 

  15. Blanche, U.: Reflections of consumerism in Damien Hirst’s Spot Paintings (2011)

    Google Scholar 

  16. Yu, L., Cao, J., Chen, Z.: A feature-aware method for dot painting on images. J. Comput.-Aid. Des. Comput. Graph. 32(1), 130–139 (2011)

    Google Scholar 

  17. Mondloch, K.: From Point to Pixel: A Genealogy of Digital Aesthetics, by Meredith Hoy. Dartmouth College Press, Hanover (2018). 2017. 270 pp.; 26 b/w ills. $40.00

    Google Scholar 

  18. WIKIPEDIA: Neural Style Transfer (NST) Page. https://en.wikipedia.org/wiki/Neural_style_transfer

  19. Hertzmann, A., Jacobs, C.E., Oliver, N., Curless, B., Salesin, D.H.: Image analogies. In: Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, pp. 327–340, August 2001

    Google Scholar 

  20. Efros, A.A., Freeman, W.T.: Image quilting for texture synthesis and transfer. In: Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, pp. 341–346, August 2001

    Google Scholar 

  21. Singh, A., Jaiswal, V., Joshi, G., Sanjeeve, A., Gite, S., Kotecha, K.: Neural Style Transfer: A Critical Review. IEEE Access (2021)

    Google Scholar 

Download references

Acknowledgments

This work was supported by JST SPRING (grant number JPMJSP2124), and CREST (grant number JPMJCR19F2).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jingjing Li .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Li, J., Zheng, X., Lu, JL., Xanat, V.M., Ochiai, Y. (2022). Transformation of Plants into Polka Dot Arts: Kusama Yayoi as an Inspiration for Deep Learning. In: Antona, M., Stephanidis, C. (eds) Universal Access in Human-Computer Interaction. Novel Design Approaches and Technologies. HCII 2022. Lecture Notes in Computer Science, vol 13308. Springer, Cham. https://doi.org/10.1007/978-3-031-05028-2_18

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-05028-2_18

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-05027-5

  • Online ISBN: 978-3-031-05028-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics