skip to main content
short-paper

Three Stage Drawing Transfer: Collaborative Drawing Between a Generative Adversarial Network, Co-robotic Arm, and Five-Year-Old Child

Published: 07 September 2022 Publication History

Abstract

This project creates a visual-mental-physical circuit between a Generative Adversarial Network (GAN), a co-robotic arm, and a five-year-old child. From training images to the latent space of a GAN, through pen on paper to a live human collaborator, it establishes a series of translational stages between humans and non-humans played out through the medium of drawing. Trained on a subset of the Rhoda Kellogg Child Art Collection, the neural network at the center of this piece learns its own representations of these images. The generated results, synthetic children's drawings, are of interest both for being outside of adult conventions and learned expression-like Dubuffet's art brut or Surrealist automatism-and for how they align machine learning with the human act of learning to draw.
The project layers many kinds of agency and embodiment: from the thousands of anonymous children who produced the original artwork used as training data, through the co-robot drawing from GAN-generated imagery, to the human child's active perception and graphic response to the robot. These questions of where we search for the other; when we attribute autonomy and intelligence; and why we might wish to escape our human subjectivities speak to core issues in the design and use of AI systems. This project is one attempt to think through those questions in an embodied way.

Supplementary Material

twomey (twomey.zip)
Supplemental movie, appendix, image and software files for, Three Stage Drawing Transfer: Collaborative Drawing Between a Generative Adversarial Network, Co-robotic Arm, and Five-Year-Old Child
MP4 File (3533614.mp4)
presentation video

References

[1]
Tero Karras, Samuli Laine, Miika Aittala, Janne Hellsten, Jaakko Lehtinen, and Timo Aila. 2020. Analyzing and Improving the Image Quality of Stylegan. Proceedings of IEEE / CVF Computer Vision and Pattern Recognition. https://doi.org/10.48550/arXiv.1912.04958
[2]
Rhoda Kellogg. 1969. Analyzing children's art. National Press Books, Palo Alto, Calif.
[3]
Rhoda Kellogg. n.d. Rhoda Kellogg Child Art Collection. Retrieved January 21, 2022 from https://www.early-pictures.ch/kellogg/archive/en/.
[4]
Tzu-Mao Li. 2022. diffvg. Retrieved April 25, 2022 from https://github.com/BachiLi/diffvg.
[5]
Dennis Oppenheim. 1971. 2-Stage Transfer Drawing. Retrieved January 21, 2022 from https://www.dennisaoppenheim.org/copy-of-new-page.
[6]
Tate Gallery. 2022. Art brut. Tate Gallery Glossary of Art Terms. Retrieved January 21, 2022 from https://www.tate.org.uk/art/art- terms/a/art-brut.
[7]
Robert Twomey. 2022. Communion and Cohabitation. In Welcome a New Neighbor, Creative Machine. Retrieved January 21, 2022 from https://roberttwomey.com/writing/.
[8]
UFACTORY. 2022. UFACTORY xArm7 co-robotic arm with 7 DOF. Retrieved January 21, 2022 from https://www.ufactory.cc/products/xarm-7-2020.

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Computer Graphics and Interactive Techniques
Proceedings of the ACM on Computer Graphics and Interactive Techniques  Volume 5, Issue 4
September 2022
145 pages
EISSN:2577-6193
DOI:10.1145/3563103
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 September 2022
Published in PACMCGIT Volume 5, Issue 4

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. children's art
  2. creative AI
  3. embodiment
  4. human-robot interaction

Qualifiers

  • Short-paper
  • Research
  • Refereed

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 272
    Total Downloads
  • Downloads (Last 12 months)81
  • Downloads (Last 6 weeks)5
Reflects downloads up to 18 Feb 2025

Other Metrics

Citations

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media