ABSTRACT
Sketching is a widely used activity in creative processes. One can argue that we now have Artificial Intelligence (AI) capable of making better drawings and sketches than humans. Some computational drawing applications build upon human input, be it text, an input image, or even a hand-drawn path using the cursor. However, drawing along a present-day computer yields a very different experience from drawing collaboratively with another person. For one, the shared canvas is likely not a physical sheet of paper but rather a screen of some sort. Even with paper-like computer interfaces, the computer mainly draws back virtually, needing no material embodiment to make a drawing. My research investigates human collaboration with computers that draw, specifically focused on the act of sketching. I build exploratory physical systems that allow people to draw and sketch together with a computer. Through my studies, I investigate interaction design to allow for human-computer collaborative sketching. My initial studies with a first experimental platform show that the computers are social actors (CASA) paradigm also applies to non-anthropomorphic pen plotters when performing a Tic-Tac-Toe playing task.
- Flora Bowden, Dan Lockton, Rama Gheerawo, and Clare Brass. 2015. Drawing energy: Exploring perceptions of the invisible. (2015).Google Scholar
- Alexandra Bremers, Natalie Friedman, Sam Lee, Tong Wu, Eric Laurier, Malte Jung, Jorge Ortiz, and Wendy Ju. 2022. Discomfort in Cars: an Interdisciplinary Perspective. In CSCW’22 (under review).Google Scholar
- Alexandra WD Bremers, Ali Özgür Yöntem, Kun Li, Daping Chu, Valerian Meijering, and Christian P Janssen. 2021. Perception of perspective in augmented reality head-up displays. International Journal of Human-Computer Studies 155 (2021), 102693.Google ScholarDigital Library
- Sougwen Chung. 2022. Sougwen Chung. https://sougwen.com/. Accessed: 2022-05-07.Google Scholar
- Nils Dahlbäck, Arne Jönsson, and Lars Ahrenberg. 1993. Wizard of Oz studies—why and how. Knowledge-based systems 6, 4 (1993), 258–266.Google Scholar
- Avital Dell’Ariccia, Alexandra Bremers, Johan Michalove, and Wendy Ju. 2022. How to Make People Think You’re Thinking if You’re a Drawing Robot: Expressing Emotions Through the Motions of Writing. In Proceedings of the 2022 ACM/IEEE International Conference on Human-Robot Interaction. 1190–1191.Google Scholar
- Avital Dell’Ariccia, Alexandra WD Bremers, Wen-Ying Lee, and Wendy Ju. 2022. ” Ah! he wants to win!”: Social responses to playing Tic-Tac-Toe against a physical drawing robot. In Sixteenth International Conference on Tangible, Embedded, and Embodied Interaction. 1–6.Google ScholarDigital Library
- David Goedicke, Alexandra Bremers, Sam Lee, Frank Bu, and Wendy Ju. 2022. XR-OOM: MiXed Reality driving simulation with real cars for research and design.. In CHI’22 (forthcoming).Google Scholar
- Shiqing He and Eytan Adar. 2020. Plotting with Thread: Fabricating Delicate Punch Needle Embroidery with XY Plotters. In Proceedings of the 2020 ACM Designing Interactive Systems Conference. 1047–1057.Google ScholarDigital Library
- Aaron Hertzmann. 2020. Why do line drawings work? A realism hypothesis. Perception 49, 4 (2020), 439–451.Google ScholarCross Ref
- Brigitte Jordan and Austin Henderson. 1995. Interaction analysis: Foundations and practice. The journal of the learning sciences 4, 1 (1995), 39–103.Google Scholar
- Makayla Lewis, Miriam Sturdee, Jason Alexander, Jelle Van Dijk, Majken Kirkegård Rasmussen, and Thuong Hoang. 2017. SketchingDIS: Hand-Drawn Sketching in HCI. In Proceedings of the 2017 ACM Conference Companion Publication on Designing Interactive Systems (Edinburgh, United Kingdom) (DIS ’17 Companion). Association for Computing Machinery, New York, NY, USA, 356–359. https://doi.org/10.1145/3064857.3064863Google ScholarDigital Library
- Clifford Nass, Jonathan Steuer, and Ellen R Tauber. 1994. Computers are social actors. In Proceedings of the SIGCHI conference on Human factors in computing systems. 72–78.Google ScholarDigital Library
- OpenAI. 2015. Why Google’s Deep Dream A.I. Hallucinates In Dog Faces. https://www.fastcompany.com/3048941/why-googles-deep-dream-ai-hallucinates-in-dog-faces. Accessed: 2022-05-07.Google Scholar
- OpenAI. 2022. DALL-E: Creating Images from Text. https://openai.com/blog/dall-e/. Accessed: 2022-05-07.Google Scholar
- OpenAI. 2022. DALL·E 2 is a new AI system that can create realistic images and art from a description in natural language.https://openai.com/dall-e-2/. Accessed: 2022-05-07.Google Scholar
- Gaurav Patekar, Karan Dudeja, Himanshu Bablani, and Debanshu Bhaumik. 2018. Data Jalebi Bot. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems. 1–4.Google Scholar
- Evil Mad Scientist. 2022. AxiDraw V3. https://shop.evilmadscientist.com/.Google Scholar
- Miriam Sturdee and Joseph Lindley. 2019. Sketching & Drawing as Future Inquiry in HCI. In Proceedings of the Halfway to the Future Symposium 2019 (Nottingham, United Kingdom) (HTTF 2019). Association for Computing Machinery, New York, NY, USA, Article 18, 10 pages. https://doi.org/10.1145/3363384.3363402Google ScholarDigital Library
- Miriam Sturdee, Lauren Thornton, Bhagya Wimalasiri, and Sameer Patil. 2021. A Visual Exploration of Cybersecurity Concepts. In Creativity and Cognition. 1–10.Google Scholar
- Hannah Twigg-Smith, Jasper Tran O’Leary, and Nadya Peek. 2021. Tools, Tricks, and Hacks: Exploring Novel Digital Fabrication Workflows on #PlotterTwitter. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 594, 15 pages. https://doi.org/10.1145/3411764.3445653Google ScholarDigital Library
- Bill Verplank. 2015. What to Study in HCI? Interaction Design!(2015).Google Scholar
- Paulina Yurman. 2021. Fluid Speculations: Drawing Artefacts in Watercolour as Experimentation in Research Through Design. In Creativity and Cognition (Virtual Event, Italy) (C&C ’21). Association for Computing Machinery, New York, NY, USA, Article 38, 1 pages. https://doi.org/10.1145/3450741.3466777Google ScholarDigital Library
Recommendations
SketchTivity: Improving Creativity by Learning Sketching with an Intelligent Tutoring System
C&C '17: Proceedings of the 2017 ACM SIGCHI Conference on Creativity and CognitionSketching is a skill closely tied to creativity and a powerful tool for exploring and expressing ideas and becoming a more well-rounded communicator. Conventional sketching instruction employs traditional mediums such as pen and paper in studio ...
The influence of sketch quality on perception of product-idea creativity
This paper explores the relationship between the quality of a sketch and how others perceive the creativity of the idea portrayed by the sketch. In this study, sketch quality is characterized through its line work, perspective, and proportions. Four ...
Sketching interactive systems with sketchify
INTERACT'11: Proceedings of the 13th IFIP TC 13 international conference on Human-computer interaction - Volume Part IVSketching is at the heart of design and creativity, an omnipresent element of any disciplined activity of design. In this tutorial we will summarize many of the existing studies of sketching, and emphasize its role in supporting creativity. We will look ...
Comments