John Joon Young Chung
ABSTRACT
When commissioning visual art, clients and artists communicate to agree on what is to be created. This often requires bridging a language gap in how they conceive art. To arrive at a mutual understanding, they leverage boundary objects—organized language and artifact instances. However, building and working with such objects is hard due to their innate subjectivity and ambiguity. Moreover, acquiring artifact instances, such as references and sketches, requires effort. We introduce Artinter, an AI-powered commission-support system for sharing, concretizing, and expanding boundary objects. Artinter helps artists and clients develop a mutually understood ‘language’ by allowing them to define concepts with artifacts (e.g., what they mean by ‘happy’). The system provides two AI-powered approaches for expanding commission boundary objects: 1) guided search with user-defined concepts and 2) instance generation by mixing concepts and artifacts. Our studies identify how AI features can support commissions and reveal future directions for AI-powered collaborative art-making.
Supplemental Material
Available for Download
- Andrea Agostinelli, Timo I. Denk, Zalán Borsos, Jesse Engel, Mauro Verzetti, Antoine Caillon, Qingqing Huang, Aren Jansen, Adam Roberts, Marco Tagliasacchi, Matt Sharifi, Neil Zeghidour, and Christian Frank. 2023. MusicLM: Generating Music From Text. https://doi.org/10.48550/ARXIV.2301.11325Google Scholar
Cross Ref
- Saleema Amershi, Maya Cakmak, William Bradley Knox, and Todd Kulesza. 2014. Power to the People: The Role of Humans in Interactive Machine Learning. AI Magazine 35, 4 (Dec. 2014), 105–120. https://doi.org/10.1609/aimag.v35i4.2513Google ScholarDigital Library
- Saleema Amershi, James Fogarty, and Daniel Weld. 2012. Regroup: Interactive Machine Learning for on-Demand Group Creation in Social Networks. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Austin, Texas, USA) (CHI ’12). Association for Computing Machinery, New York, NY, USA, 21–30. https://doi.org/10.1145/2207676.2207680Google ScholarDigital Library
- Saleema Amershi and Meredith Ringel Morris. 2008. CoSearch: A System for Co-Located Collaborative Web Search. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Florence, Italy) (CHI ’08). Association for Computing Machinery, New York, NY, USA, 1647–1656. https://doi.org/10.1145/1357054.1357311Google ScholarDigital Library
- Howard S. Becker. 1984. Art Worlds. University of California Press. https://books.google.com/books?id=jXDyRK2EL5YCGoogle Scholar
- Luca Benedetti, Holger Winnemöller, Massimiliano Corsini, and Roberto Scopigno. 2014. Painting with Bob: Assisted Creativity for Novices. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (Honolulu, Hawaii, USA) (UIST ’14). Association for Computing Machinery, New York, NY, USA, 419–428. https://doi.org/10.1145/2642918.2647415Google ScholarDigital Library
- Lennart Björneborn. 2017. Three key affordances for serendipity. Journal of Documentation (2017).Google Scholar
- R. Brecknock. 1996. A New Renaissance: Contemporary Art Commissioning. Rosenthal Publishing. https://books.google.com/books?id=D8xzAAAACAAJGoogle Scholar
- Tom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel M. Ziegler, Jeffrey Wu, Clemens Winter, Christopher Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei. 2020. Language Models are Few-Shot Learners. arxiv:2005.14165 [cs.CL]Google Scholar
- Carrie J. Cai, Emily Reif, Narayan Hegde, Jason Hipp, Been Kim, Daniel Smilkov, Martin Wattenberg, Fernanda Viegas, Greg S. Corrado, Martin C. Stumpe, and Michael Terry. 2019. Human-Centered Tools for Coping with Imperfect Algorithms During Medical Decision-Making. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3290605.3300234Google ScholarDigital Library
- Siddhartha Chaudhuri, Evangelos Kalogerakis, Stephen Giguere, and Thomas Funkhouser. 2013. Attribit: Content Creation with Semantic Attributes. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (St. Andrews, Scotland, United Kingdom) (UIST ’13). Association for Computing Machinery, New York, NY, USA, 193–202. https://doi.org/10.1145/2501988.2502008Google ScholarDigital Library
- Erin Cherry and Celine Latulipe. 2014. Quantifying the Creativity Support of Digital Tools through the Creativity Support Index. ACM Trans. Comput.-Hum. Interact. 21, 4, Article 21 (jun 2014), 25 pages. https://doi.org/10.1145/2617588Google ScholarDigital Library
- Mao-Lin Chiu. 2002. An organizational view of design communication in design collaboration. Design Studies 23, 2 (2002), 187 – 210. https://doi.org/10.1016/S0142-694X(01)00019-9Google ScholarCross Ref
- John Joon Young Chung, Shiqing He, and Eytan Adar. 2022. Artist Support Networks: Implications for Future Creativity Support Tools. In Designing Interactive Systems Conference (Virtual Event, Australia) (DIS ’22). Association for Computing Machinery, New York, NY, USA, 232–246. https://doi.org/10.1145/3532106.3533505Google ScholarDigital Library
- John Joon Young Chung, Wooseok Kim, Kang Min Yoo, Hwaran Lee, Eytan Adar, and Minsuk Chang. 2022. TaleBrush: Sketching Stories with Generative Pretrained Language Models. Association for Computing Machinery, New York, NY, USA.Google Scholar
- Elizabeth Clark, Anne Spencer Ross, Chenhao Tan, Yangfeng Ji, and Noah A. Smith. 2018. Creative Writing with a Machine in the Loop: Case Studies on Slogans and Stories. In 23rd International Conference on Intelligent User Interfaces (Tokyo, Japan) (IUI ’18). Association for Computing Machinery, New York, NY, USA, 329–340. https://doi.org/10.1145/3172944.3172983Google ScholarDigital Library
- Ruta Desai, Fraser Anderson, Justin Matejka, Stelian Coros, James McCann, George Fitzmaurice, and Tovi Grossman. 2019. Geppetto: Enabling Semantic Design of Expressive Robot Behaviors. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3290605.3300599Google ScholarDigital Library
- Claudia M Eckert, Nigel Cross, and Jeffrey H Johnson. 2000. Intelligent support for communication in design teams: garment shape specifications in the knitwear industry. Design Studies 21, 1 (2000), 99 – 112. https://doi.org/10.1016/S0142-694X(99)00006-XGoogle ScholarCross Ref
- Nada Endrissat, Gazi Islam, and Claus Noppeney. 2016. Visual organizing: Balancing coordination and creative freedom via mood boards. Journal of Business Research 69, 7 (2016), 2353 – 2362. https://doi.org/10.1016/j.jbusres.2015.10.004Google ScholarCross Ref
- Sandra Erdelez. 1999. Information Encountering: It’s More Than Just Bumping into Information. Bulletin of the American Society for Information Science and Technology 25, 3 (1999), 26–29. https://doi.org/10.1002/bult.118 arXiv:https://asistdl.onlinelibrary.wiley.com/doi/pdf/10.1002/bult.118Google ScholarCross Ref
- Jerry Alan Fails and Dan R. Olsen. 2003. Interactive Machine Learning. In Proceedings of the 8th International Conference on Intelligent User Interfaces (Miami, Florida, USA) (IUI ’03). Association for Computing Machinery, New York, NY, USA, 39–45. https://doi.org/10.1145/604045.604056Google ScholarDigital Library
- Adam M. Fass, Eric A. Bier, and Eytan Adar. 2000. PicturePiper: Using a Re-Configurable Pipeline to Find Images on the Web. In Proceedings of the 13th Annual ACM Symposium on User Interface Software and Technology (San Diego, California, USA) (UIST ’00). Association for Computing Machinery, New York, NY, USA, 51–62. https://doi.org/10.1145/354401.354411Google ScholarDigital Library
- Jennifer Fernquist, Tovi Grossman, and George Fitzmaurice. 2011. Sketch-Sketch Revolution: An Engaging Tutorial System for Guided Sketching and Application Learning. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (Santa Barbara, California, USA) (UIST ’11). Association for Computing Machinery, New York, NY, USA, 373–382. https://doi.org/10.1145/2047196.2047245Google ScholarDigital Library
- James Fogarty, Desney Tan, Ashish Kapoor, and Simon Winder. 2008. CueFlik: Interactive Concept Learning in Image Search. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Florence, Italy) (CHI ’08). Association for Computing Machinery, New York, NY, USA, 29–38. https://doi.org/10.1145/1357054.1357061Google ScholarDigital Library
- Allen Foster and Nigel Ford. 2003. Serendipity and information seeking: an empirical study. Journal of documentation (2003).Google Scholar
- Rinon Gal, Yuval Alaluf, Yuval Atzmon, Or Patashnik, Amit H. Bermano, Gal Chechik, and Daniel Cohen-Or. 2022. An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversion. https://doi.org/10.48550/ARXIV.2208.01618Google ScholarCross Ref
- Dario Gamboni. 2002. Visual Ambiguity and Interpretation. RES: Anthropology and Aesthetics41 (2002), 5–15. http://www.jstor.org/stable/20167553Google Scholar
- L. A. Gatys, A. S. Ecker, and M. Bethge. 2016. Image Style Transfer Using Convolutional Neural Networks. In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2414–2423. https://doi.org/10.1109/CVPR.2016.265Google ScholarCross Ref
- Florian Geyer, Jochen Budzinski, and Harald Reiterer. 2012. IdeaVis: A Hybrid Workspace and Interactive Visualization for Paper-Based Collaborative Sketching Sessions. In Proceedings of the 7th Nordic Conference on Human-Computer Interaction: Making Sense Through Design (Copenhagen, Denmark) (NordiCHI ’12). Association for Computing Machinery, New York, NY, USA, 331–340. https://doi.org/10.1145/2399016.2399069Google ScholarDigital Library
- E.H. Gombrich. 1995. The Story of Art - 16th Edition. Phaidon Press. https://books.google.com/books?id=CECSU2MRH4QCGoogle Scholar
- Anhong Guo, Anuraag Jain, Shomiron Ghose, Gierad Laput, Chris Harrison, and Jeffrey P. Bigham. 2018. Crowd-AI Camera Sensing in the Real World. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 2, 3, Article 111 (Sept. 2018), 20 pages. https://doi.org/10.1145/3264921Google ScholarDigital Library
- Joshua Hailpern, Erik Hinterbichler, Caryn Leppert, Damon Cook, and Brian P. Bailey. 2007. TEAM STORM: Demonstrating an Interaction Model for Working with Multiple Ideas during Creative Group Work. In Proceedings of the 6th ACM SIGCHI Conference on Creativity & Cognition (Washington, DC, USA) (C&C ’07). Association for Computing Machinery, New York, NY, USA, 193–202. https://doi.org/10.1145/1254960.1254987Google ScholarDigital Library
- Shiqing He and Eytan Adar. 2020. Plotting with Thread: Fabricating Delicate Punch Needle Embroidery with X-Y Plotters. In Proceedings of the 2020 ACM Designing Interactive Systems Conference (Eindhoven, Netherlands) (DIS ’20). Association for Computing Machinery, New York, NY, USA, 1047–1057. https://doi.org/10.1145/3357236.3395540Google ScholarDigital Library
- Forrest Huang and John F. Canny. 2019. Sketchforme: Composing Sketched Scenes from Text Descriptions for Interactive Applications. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (New Orleans, LA, USA) (UIST ’19). Association for Computing Machinery, New York, NY, USA, 209–220. https://doi.org/10.1145/3332165.3347878Google ScholarDigital Library
- Forrest Huang, Eldon Schoop, David Ha, and John Canny. 2020. Scones: Towards Conversational Authoring of Sketches. In Proceedings of the 25th International Conference on Intelligent User Interfaces (Cagliari, Italy) (IUI ’20). Association for Computing Machinery, New York, NY, USA, 313–323. https://doi.org/10.1145/3377325.3377485Google ScholarDigital Library
- Emmanuel Iarussi, Adrien Bousseau, and Theophanis Tsandilas. 2013. The Drawing Assistant: Automated Drawing Guidance and Feedback from Photographs. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (St. Andrews, Scotland, United Kingdom) (UIST ’13). Association for Computing Machinery, New York, NY, USA, 183–192. https://doi.org/10.1145/2501988.2501997Google ScholarDigital Library
- V. John-Steiner. 2000. Creative Collaboration. Oxford University Press. https://books.google.com/books?id=E5KgFtbiMrUCGoogle Scholar
- Been Kim, Martin Wattenberg, Justin Gilmer, Carrie Cai, James Wexler, Fernanda Viegas, and Rory sayres. 2018. Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV). In Proceedings of the 35th International Conference on Machine Learning(Proceedings of Machine Learning Research, Vol. 80), Jennifer Dy and Andreas Krause (Eds.). PMLR, Stockholmsmässan, Stockholm Sweden, 2668–2677. http://proceedings.mlr.press/v80/kim18d.htmlGoogle Scholar
- Hyung-Kwon Ko, Subin An, Gwanmo Park, Seung Kwon Kim, Daesik Kim, Bohyoung Kim, Jaemin Jo, and Jinwook Seo. 2022. We-Toon: A Communication Support System between Writers and Artists in Collaborative Webtoon Sketch Revision. In Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology (Bend, OR, USA) (UIST ’22). Association for Computing Machinery, New York, NY, USA, Article 76, 14 pages. https://doi.org/10.1145/3526113.3545612Google ScholarDigital Library
- Hyung-Kwon Ko, Gwanmo Park, Hyeon Jeon, Jaemin Jo, Juho Kim, and Jinwook Seo. 2023. Large-Scale Text-to-Image Generation Models for Visual Artists’ Creative Works. In Proceedings of the 28th International Conference on Intelligent User Interfaces (Sydney, NSW, Australia) (IUI ’23). Association for Computing Machinery, New York, NY, USA, 919–933. https://doi.org/10.1145/3581641.3584078Google ScholarDigital Library
- Janin Koch, Andrés Lucero, Lena Hegemann, and Antti Oulasvirta. 2019. May AI? Design Ideation with Cooperative Contextual Bandits. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3290605.3300863Google ScholarDigital Library
- Janin Koch, Nicolas Taffin, Michel Beaudouin-Lafon, Markku Laine, Andrés Lucero, and Wendy E. Mackay. 2020. ImageSense: An Intelligent Collaborative Ideation Tool to Support Diverse Human-Computer Partnerships. Proc. ACM Hum.-Comput. Interact. 4, CSCW1, Article 045 (May 2020), 27 pages. https://doi.org/10.1145/3392850Google ScholarDigital Library
- Janin Koch, Nicolas Taffin, Andrés Lucero, and Wendy E. Mackay. 2020. SemanticCollage: Enriching Digital Mood Board Design with Semantic Labels. Association for Computing Machinery, New York, NY, USA, 407–418. https://doi.org/10.1145/3357236.3395494Google ScholarDigital Library
- Yuki Koyama, Daisuke Sakamoto, and Takeo Igarashi. 2014. Crowd-Powered Parameter Analysis for Visual Design Exploration. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (Honolulu, Hawaii, USA) (UIST ’14). Association for Computing Machinery, New York, NY, USA, 65–74. https://doi.org/10.1145/2642918.2647386Google ScholarDigital Library
- Pierre-Yves Laffont, Zhile Ren, Xiaofeng Tao, Chao Qian, and James Hays. 2014. Transient Attributes for High-Level Understanding and Editing of Outdoor Scenes. ACM Trans. Graph. 33, 4, Article 149 (July 2014), 11 pages. https://doi.org/10.1145/2601097.2601101Google ScholarDigital Library
- Brian Lee, Savil Srivastava, Ranjitha Kumar, Ronen Brafman, and Scott R. Klemmer. 2010. Designing with Interactive Example Galleries. Association for Computing Machinery, New York, NY, USA, 2257–2266. https://doi.org/10.1145/1753326.1753667Google ScholarDigital Library
- Charlotte P. Lee. 2007. Boundary Negotiating Artifacts: Unbinding the Routine of Boundary Objects and Embracing Chaos in Collaborative Work. Comput. Supported Coop. Work 16, 3 (June 2007), 307–339. https://doi.org/10.1007/s10606-007-9044-5Google ScholarDigital Library
- Alex Limpaecher, Nicolas Feltman, Adrien Treuille, and Michael Cohen. 2013. Real-Time Drawing Assistance through Crowdsourcing. ACM Trans. Graph. 32, 4, Article 54 (July 2013), 8 pages. https://doi.org/10.1145/2461912.2462016Google ScholarDigital Library
- Vivian Liu, Han Qiao, and Lydia Chilton. 2022. Opal: Multimodal Image Generation for News Illustration. In Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology (Bend, OR, USA) (UIST ’22). Association for Computing Machinery, New York, NY, USA, Article 73, 17 pages. https://doi.org/10.1145/3526113.3545621Google ScholarDigital Library
- Andrés Lucero. 2012. Framing, Aligning, Paradoxing, Abstracting, and Directing: How Design Mood Boards Work. In Proceedings of the Designing Interactive Systems Conference (Newcastle Upon Tyne, United Kingdom) (DIS ’12). Association for Computing Machinery, New York, NY, USA, 438–447. https://doi.org/10.1145/2317956.2318021Google ScholarDigital Library
- A. Lucero, D. Aliakseyeu, and J. Martens. 2007. Augmenting Mood Boards: Flexible and Intuitive Interaction in the Context of the Design Studio. In Second Annual IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP’07). 147–154. https://doi.org/10.1109/TABLETOP.2007.17Google ScholarCross Ref
- Andrés Lucero and Kirsikka Vaajakallio. 2008. Co-Designing Mood Boards: Creating Dialogue with People. In Proceedings of the Third IASTED International Conference on Human Computer Interaction (Innsbruck, Austria) (HCI ’08). ACTA Press, USA, 254–260.Google Scholar
- Kurt Luther, Kelly Caine, Kevin Ziegler, and Amy Bruckman. 2010. Why It Works (When It Works): Success Factors in Online Creative Collaboration. In Proceedings of the 16th ACM International Conference on Supporting Group Work (Sanibel Island, Florida, USA) (GROUP ’10). Association for Computing Machinery, New York, NY, USA, 1–10. https://doi.org/10.1145/1880071.1880073Google ScholarDigital Library
- Kurt Luther, Casey Fiesler, and Amy Bruckman. 2013. Redistributing Leadership in Online Creative Collaboration. In Proceedings of the 2013 Conference on Computer Supported Cooperative Work (San Antonio, Texas, USA) (CSCW ’13). Association for Computing Machinery, New York, NY, USA, 1007–1022. https://doi.org/10.1145/2441776.2441891Google ScholarDigital Library
- N. Mahyar and M. Tory. 2014. Supporting Communication and Coordination in Collaborative Sensemaking. IEEE Transactions on Visualization and Computer Graphics 20, 12 (2014), 1633–1642. https://doi.org/10.1109/TVCG.2014.2346573Google ScholarCross Ref
- Lena Mamykina, Linda Candy, and Ernest Edmonds. 2002. Collaborative Creativity. Commun. ACM 45, 10 (Oct. 2002), 96–99. https://doi.org/10.1145/570907.570940Google ScholarDigital Library
- Justin Matejka, Michael Glueck, Erin Bradner, Ali Hashemi, Tovi Grossman, and George Fitzmaurice. 2018. Dream Lens: Exploration and Visualization of Large-Scale Generative Design Datasets. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3173574.3173943Google ScholarDigital Library
- Deana Mcdonagh and Ian Storer. 2004. Mood Boards as a Design Catalyst and Resource: Researching an Under-Researched Area. The Design Journal 7, 3 (2004), 16–31. https://doi.org/10.2752/146069204789338424 arXiv:https://doi.org/10.2752/146069204789338424Google ScholarCross Ref
- Meredith Ringel Morris. 2008. A Survey of Collaborative Web Search Practices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Florence, Italy) (CHI ’08). Association for Computing Machinery, New York, NY, USA, 1657–1660. https://doi.org/10.1145/1357054.1357312Google ScholarDigital Library
- Meredith Ringel Morris and Eric Horvitz. 2007. SearchTogether: An Interface for Collaborative Web Search. In Proceedings of the 20th Annual ACM Symposium on User Interface Software and Technology (Newport, Rhode Island, USA) (UIST ’07). Association for Computing Machinery, New York, NY, USA, 3–12. https://doi.org/10.1145/1294211.1294215Google ScholarDigital Library
- Meredith Ringel Morris, Jarrod Lombardo, and Daniel Wigdor. 2010. WeSearch: Supporting Collaborative Search and Sensemaking on a Tabletop Display. In Proceedings of the 2010 ACM Conference on Computer Supported Cooperative Work (Savannah, Georgia, USA) (CSCW ’10). Association for Computing Machinery, New York, NY, USA, 401–410. https://doi.org/10.1145/1718918.1718987Google ScholarDigital Library
- M. R. Morris, A. Paepcke, and T. Winograd. 2006. TeamSearch: comparing techniques for co-present collaborative search of digital media. In First IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP ’06). 8 pp.–. https://doi.org/10.1109/TABLETOP.2006.32Google ScholarDigital Library
- Alex Nichol, Prafulla Dhariwal, Aditya Ramesh, Pranav Shyam, Pamela Mishkin, Bob McGrew, Ilya Sutskever, and Mark Chen. 2021. GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models. https://doi.org/10.48550/ARXIV.2112.10741Google ScholarCross Ref
- Peter O’Donovan, Jundefinednis Lundefinedbeks, Aseem Agarwala, and Aaron Hertzmann. 2014. Exploratory Font Selection Using Crowdsourced Attributes. ACM Trans. Graph. 33, 4, Article 92 (July 2014), 9 pages. https://doi.org/10.1145/2601097.2601110Google ScholarDigital Library
- Changhoon Oh, Jungwoo Song, Jinhan Choi, Seonghyeon Kim, Sungwoo Lee, and Bongwon Suh. 2018. I Lead, You Help but Only with Enough Details: Understanding User Experience of Co-Creation with Artificial Intelligence. Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3173574.3174223Google ScholarDigital Library
- Ville Paananen, Jonas Oppenlaender, and Aku Visuri. 2023. Using Text-to-Image Generation for Architectural Design Ideation. arxiv:2304.10182 [cs.HC]Google Scholar
- D. Y. Park and K. H. Lee. 2019. Arbitrary Style Transfer With Style-Attentional Networks. In 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 5873–5881. https://doi.org/10.1109/CVPR.2019.00603Google ScholarCross Ref
- Taesung Park, Ming-Yu Liu, Ting-Chun Wang, and Jun-Yan Zhu. 2019. Semantic Image Synthesis with Spatially-Adaptive Normalization. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.Google ScholarCross Ref
- Taesung Park, Jun-Yan Zhu, Oliver Wang, Jingwan Lu, Eli Shechtman, Alexei A. Efros, and Richard Zhang. 2020. Swapping Autoencoder for Deep Image Manipulation. In Advances in Neural Information Processing Systems.Google Scholar
- Bec Paton and Kees Dorst. 2011. Briefing and reframing: A situated practice. Design Studies 32, 6 (2011), 573 – 587. https://doi.org/10.1016/j.destud.2011.07.002 Interpreting Design Thinking.Google ScholarCross Ref
- Sharoda A. Paul and Meredith Ringel Morris. 2009. CoSense: Enhancing Sensemaking for Collaborative Web Search. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Boston, MA, USA) (CHI ’09). Association for Computing Machinery, New York, NY, USA, 1771–1780. https://doi.org/10.1145/1518701.1518974Google ScholarDigital Library
- Cecil Piya, Vinayak, Senthil Chandrasegaran, Niklas Elmqvist, and Karthik Ramani. 2017. Co-3Deator: A Team-First Collaborative 3D Design Ideation Tool. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 6581–6592. https://doi.org/10.1145/3025453.3025825Google ScholarDigital Library
- Ben Poole, Ajay Jain, Jonathan T. Barron, and Ben Mildenhall. 2022. DreamFusion: Text-to-3D using 2D Diffusion. arXiv (2022).Google Scholar
- Alec Radford, Jeff Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. 2019. Language Models are Unsupervised Multitask Learners. (2019).Google Scholar
- Aditya Ramesh, Prafulla Dhariwal, Alex Nichol, Casey Chu, and Mark Chen. 2022. Hierarchical Text-Conditional Image Generation with CLIP Latents. https://doi.org/10.48550/ARXIV.2204.06125Google ScholarCross Ref
- Laria Reynolds and Kyle McDonell. 2021. Prompt Programming for Large Language Models: Beyond the Few-Shot Paradigm. Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3411763.3451760Google ScholarDigital Library
- Daniel Ritchie, Ankita Arvind Kejriwal, and Scott R. Klemmer. 2011. D.Tour: Style-Based Exploration of Design Example Galleries. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (Santa Barbara, California, USA) (UIST ’11). Association for Computing Machinery, New York, NY, USA, 165–174. https://doi.org/10.1145/2047196.2047216Google ScholarDigital Library
- Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Björn Ommer. 2022. High-Resolution Image Synthesis With Latent Diffusion Models. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 10684–10695.Google ScholarCross Ref
- Nataniel Ruiz, Yuanzhen Li, Varun Jampani, Yael Pritch, Michael Rubinstein, and Kfir Aberman. 2022. DreamBooth: Fine Tuning Text-to-image Diffusion Models for Subject-Driven Generation. (2022).Google Scholar
- Chitwan Saharia, William Chan, Saurabh Saxena, Lala Li, Jay Whang, Emily Denton, Seyed Kamyar Seyed Ghasemipour, Burcu Karagol Ayan, S. Sara Mahdavi, Rapha Gontijo Lopes, Tim Salimans, Jonathan Ho, David J Fleet, and Mohammad Norouzi. 2022. Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding. https://doi.org/10.48550/ARXIV.2205.11487Google ScholarCross Ref
- Ugo Braga Sangiorgi, François Beuvens, and Jean Vanderdonckt. 2012. User Interface Design by Collaborative Sketching. In Proceedings of the Designing Interactive Systems Conference (Newcastle Upon Tyne, United Kingdom) (DIS ’12). Association for Computing Machinery, New York, NY, USA, 378–387. https://doi.org/10.1145/2317956.2318013Google ScholarDigital Library
- R.K. Sawyer. 2012. Explaining Creativity: The Science of Human Innovation. Oxford University Press, USA. https://books.google.com/books?id=QyJjyZ_YBAkCGoogle Scholar
- Donald A. Schön. 1988. Designing: Rules, types and worlds. Design Studies 9, 3 (1988), 181 – 190. https://doi.org/10.1016/0142-694X(88)90047-6Google ScholarCross Ref
- Evan Shimizu, Matthew Fisher, Sylvain Paris, James McCann, and Kayvon Fatahalian. 2020. Design Adjectives: A Framework for Interactive Model-Guided Exploration of Parameterized Design Spaces. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology (Virtual Event, USA) (UIST ’20). Association for Computing Machinery, New York, NY, USA, 261–278. https://doi.org/10.1145/3379337.3415866Google ScholarDigital Library
- Leonid Sigal, Moshe Mahler, Spencer Diaz, Kyna McIntosh, Elizabeth Carter, Timothy Richards, and Jessica Hodgins. 2015. A Perceptual Control Space for Garment Simulation. ACM Trans. Graph. 34, 4, Article 117 (July 2015), 10 pages. https://doi.org/10.1145/2766971Google ScholarDigital Library
- Karen Simonyan and Andrew Zisserman. 2015. Very Deep Convolutional Networks for Large-Scale Image Recognition. In 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7-9, 2015, Conference Track Proceedings, Yoshua Bengio and Yann LeCun (Eds.). http://arxiv.org/abs/1409.1556Google Scholar
- Uriel Singer, Adam Polyak, Thomas Hayes, Xi Yin, Jie An, Songyang Zhang, Qiyuan Hu, Harry Yang, Oron Ashual, Oran Gafni, Devi Parikh, Sonal Gupta, and Yaniv Taigman. 2022. Make-A-Video: Text-to-Video Generation without Text-Video Data. https://doi.org/10.48550/ARXIV.2209.14792Google ScholarCross Ref
- Donna Spencer. 2009. Card sorting: Designing usable categories. Rosenfeld Media.Google Scholar
- Susan Leigh Star. 1989. Chapter 2 - The Structure of Ill-Structured Solutions: Boundary Objects and Heterogeneous Distributed Problem Solving. In Distributed Artificial Intelligence, Les Gasser and Michael N. Huhns (Eds.). Morgan Kaufmann, San Francisco (CA), 37–54. https://doi.org/10.1016/B978-1-55860-092-8.50006-XGoogle ScholarCross Ref
- Susan Leigh Star. 2010. This is Not a Boundary Object: Reflections on the Origin of a Concept. Science, Technology, & Human Values 35, 5 (2010), 601–617. https://doi.org/10.1177/0162243910377624 arXiv:https://doi.org/10.1177/0162243910377624Google ScholarCross Ref
- Qingkun Su, Wing Ho Andy Li, Jue Wang, and Hongbo Fu. 2014. EZ-Sketching: Three-Level Optimization for Error-Tolerant Image Tracing. ACM Trans. Graph. 33, 4, Article 54 (July 2014), 9 pages. https://doi.org/10.1145/2601097.2601202Google ScholarDigital Library
- Minhyang (Mia) Suh, Emily Youngblom, Michael Terry, and Carrie J Cai. 2021. AI as Social Glue: Uncovering the Roles of Deep Generative AI during Social Music Composition. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 582, 11 pages. https://doi.org/10.1145/3411764.3445219Google ScholarDigital Library
- Patricia Tzortzopoulos, Rachel Cooper, Paul Chan, and Mike Kagioglou. 2006. Clients’ activities at the design front-end. Design Studies 27, 6 (2006), 657 – 683. https://doi.org/10.1016/j.destud.2006.04.002Google ScholarCross Ref
- James R. Wallace, Stacey D. Scott, and Carolyn G. MacGregor. 2013. Collaborative Sensemaking on a Digital Tabletop and Personal Tablets: Prioritization, Comparisons, and Tableaux. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Paris, France) (CHI ’13). Association for Computing Machinery, New York, NY, USA, 3345–3354. https://doi.org/10.1145/2470654.2466458Google ScholarDigital Library
- WikiArt. 2021. WikiArt Dataset. https://github.com/cs-chan/ArtGAN/tree/master/WikiArt%20Dataset Accessed: March, 2021.Google Scholar
- Blake Williford, Abhay Doke, Michel Pahud, Ken Hinckley, and Tracy Hammond. 2019. DrawMyPhoto: Assisting Novices in Drawing from Photographs. In Proceedings of the 2019 on Creativity and Cognition (San Diego, CA, USA) (C&C ’19). Association for Computing Machinery, New York, NY, USA, 198–209. https://doi.org/10.1145/3325480.3325507Google ScholarDigital Library
- Jun Xie, Aaron Hertzmann, Wilmot Li, and Holger Winnemöller. 2014. PortraitSketch: Face Sketching Assistance for Novices. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (Honolulu, Hawaii, USA) (UIST ’14). Association for Computing Machinery, New York, NY, USA, 407–417. https://doi.org/10.1145/2642918.2647399Google ScholarDigital Library
- Chuan Yan, John Joon Young Chung, Kiheon Yoon, Yotam Gingold, Eytan Adar, and Sungsoo Ray Hong. 2022. FlatMagic: Improving Flat Colorization through AI-driven Design for DigitalComic Professionals. Association for Computing Machinery, New York, NY, USA.Google Scholar
- Mehmet Ersin Yumer, Siddhartha Chaudhuri, Jessica K. Hodgins, and Levent Burak Kara. 2015. Semantic Shape Editing Using Deformation Handles. ACM Trans. Graph. 34, 4, Article 86 (July 2015), 12 pages. https://doi.org/10.1145/2766908Google ScholarDigital Library
- Zhenpeng Zhao, Sriram Karthik Badam, Senthil Chandrasegaran, Deok Gun Park, Niklas L.E. Elmqvist, Lorraine Kisselburgh, and Karthik Ramani. 2014. SkWiki: A Multimedia Sketching System for Collaborative Creativity. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Toronto, Ontario, Canada) (CHI ’14). Association for Computing Machinery, New York, NY, USA, 1235–1244. https://doi.org/10.1145/2556288.2557394Google ScholarDigital Library
Index Terms
- Artinter: AI-powered Boundary Objects for Commissioning Visual Arts
Recommendations
Quality improvement path and countermeasures of visual arts for future metaverse: Based on G1-entropy value method
As the most popular art category in the contemporary art field, visual art is no longer limited to traditional art categories such as painting, sculpture and photography, but develops into more diverse forms of expression with the continuous iteration of ...
Understanding Visual Arts Experiences of Blind People
CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing SystemsVisual arts play an important role in cultural life and provide access to social heritage and self-enrichment, but most visual arts are inaccessible to blind people. Researchers have explored different ways to enhance blind people’s access to visual ...
Too Late to be Creative? AI-Empowered Tools in Creative Processes
CHI EA '22: Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing SystemsThe present case study examines the product landscape of current AI-empowered co-creative tools. Specifically, I review literature in both creativity and HCI research and investigate how these tools support different stages in humans’ creative ...
Comments