Jingyi Li
ABSTRACT
Programming and computation are powerful tools for manipulating visual forms, but working with these abstractions is challenging for artists who are accustomed to direct manipulation and manual control. The goal of my research is to develop visual art tools that extend programmatic capabilities with manual craft. I do so by exposing computational abstractions as transparent materials that artists may directly manipulate and observe in a process that accommodates their non-linear workflows. Specifically, I conduct empirical research to identify challenges professional artists face when using existing software tools—as well as programming their own—to make art. I apply principles derived from these findings in two projects: an interactive programming environment that links code, numerical information, and program state to artists’ ongoing artworks, and an algorithm that automates the rigging of character clothing to bodies to allow for more flexible and customizable 2D character illustrations. Evaluating these interactions, my research promotes authoring tools that support arbitrary execution by adapting to the existing workflows of artists.
- Edwin L Hutchins, James D Hollan, and Donald A Norman. 1985. Direct manipulation interfaces. Human–computer interaction 1, 4 (1985), 311–338.Google Scholar
Digital Library
- Ivan Illich and Anne Lang. 1973. Tools for conviviality. (1973).Google Scholar
- Tim Ingold. 2010. The textility of making. Cambridge Journal of Economics 34, 1 (2010), 91–102.Google ScholarCross Ref
- Jennifer Jacobs, Joel Brandt, Radomír Mech, and Mitchel Resnick. 2018. Extending Manual Drawing Practices with Artist-Centric Programming Tools. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3173574.3174164Google ScholarDigital Library
- Alec Jacobson, Ilya Baran, Jovan Popović, and Olga Sorkine. 2011. Bounded Biharmonic Weights for Real-Time Deformation. ACM Trans. Graph. 30, 4, Article 78 (July 2011), 8 pages. https://doi.org/10.1145/2010324.1964973Google ScholarDigital Library
- Jingyi Li, Joel Brandt, Radomír Mech, Maneesh Agrawala, and Jennifer Jacobs. 2020. Supporting Visual Artists in Programming through Direct Inspection and Control of Program Execution. Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3313831.3376765Google ScholarDigital Library
- Jingyi Li, Son Kim, Joshua A. Miele, Maneesh Agrawala, and Sean Follmer. 2019. Editing Spatial Layouts through Tactile Templates for People with Visual Impairments. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–11. https://doi.org/10.1145/3290605.3300436Google ScholarDigital Library
- Jingyi Li, Wilmot Li, Sean Follmer, and Maneesh Agrawala. 2021. Automated Accessory Rigs for Layered 2D Character Illustrations. In The 34th Annual ACM Symposium on User Interface Software and Technology (Virtual Event, USA) (UIST ’21). Association for Computing Machinery, New York, NY, USA, 1100–1108. https://doi.org/10.1145/3472749.3474809Google ScholarDigital Library
- Jingyi Li, Wilmot Li, Sean Follmer, and Maneesh Agrawala. 2021. Automated Accessory Rigs for Layered 2D Character Illustrations. In The 34th Annual ACM Symposium on User Interface Software and Technology (Virtual Event, USA) (UIST ’21). Association for Computing Machinery, New York, NY, USA, 1100–1108. https://doi.org/10.1145/3472749.3474809Google ScholarDigital Library
- Pablo Stanley. 2020. Open Peeps. https://www.openpeeps.com/Google Scholar
- Aditya Ramesh, Prafulla Dhariwal, Alex Nichol, Casey Chu, and Mark Chen. 2022. Hierarchical text-conditional image generation with clip latents. arXiv preprint arXiv:2204.06125(2022).Google Scholar
- C. Reas and B. Fry. 2004. Processing. http://processing.org.Google Scholar
- Donald A Schon. 1968. The reflective practitioner. New York (1968).Google Scholar
- Snap Inc.2021. Bitmoji. https://www.bitmoji.com/Google Scholar
- Bret Victor. 2011. Dynamic Pictures. http://worrydream.com/DynamicPicturesMotivation.Google Scholar
Index Terms
- Extending Computational Abstractions with Manual Craft for Visual Art Tools
Recommendations
Extending Manual Drawing Practices with Artist-Centric Programming Tools
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing SystemsProcedural art, or art made with programming, suggests opportunities to extend traditional arts like painting and drawing; however, this potential is limited by tools that conflict with manual practices. Programming languages present learning barriers ...
Celebrating Art, Craft and Computation
FabLearn Europe'18: Proceedings of the Conference on Creativity and Making in EducationWe often treat art as a fun but ultimately frivolous endeavor. We leverage it to entice kids to learn about the important things--math, science, or computing. But, art plays a uniquely powerful role in the formation of young people's identity, both ...
Reflections on craft: probing the creative process of everyday knitters
C&C '09: Proceedings of the seventh ACM conference on Creativity and cognitionCrafters today blend age-old techniques such as weaving and pottery with new information and communication technologies such as podcasts, online instructions, and blogs. This intersection of tradition and modernity provides an interesting site for ...
Comments