Laewoo (Leo) Kang
Steven J. Jackson
Phoebe Sengers
ABSTRACT
This paper integrates theory, ethnography, and collaborative artwork to explore improvisational activity as both topic and tool of multidisciplinary HCI inquiry. Building on theories of improvisation drawn from art, music, HCI and social science, and two ethnographic studies based on interviews, participant observation and collaborative art practice, we seek to elucidate the improvisational nature of practice in both art and ordinary action, including human-computer interaction. We identify five key features of improvisational action -- reflexivity, transgression, tension, listening, and interdependence -- and show how these can deepen and extend both linear and open-ended methodologies in HCI and design. We conclude by highlighting collaborative engagement based on 'intermodulation' as a tool of multidisciplinary inquiry for HCI research and design.
Supplemental Material
- Philip E Agre, and David Chapman. 1987. Pengi: lementation of a Theory of Activity. aaai.org. Google Scholar
Digital Library
- Philip E Agre. 1997. Computation and Human Experience. Google ScholarDigital Library
- Jeffrey Bardzell, Shaowen Bardzell, Peter Dalsgaard, Shad Gross, and Kim Halskov. 2016. Documenting the Research Through Design Process. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems - DIS '16, 96--107. Google ScholarDigital Library
- Jeffrey Bardzell, Shaowen Bardzell, and Lone Koefoed Hansen. 2015. Immodest Proposals. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems - CHI '15, 2093--2102. Google ScholarDigital Library
- Estelle Barrett and Barbara Bolt. 2007. Practice as research: approaches to creative arts enquiry.Google Scholar
- Steve Benford, Chris Greenhalgh, Andy Crabtree, Martin Flintham, Brendan Walker, Joe Marshall, Boriana Koleva, Stefan Rennick Egglestone, Gabriella Giannachi, Matt Adams, Nick Tandavanitj, and Ju Row Farr. 2013. Performance-Led Research in the Wild. ACM Transactions on Computer-Human Interaction 20, 3: 14:1--14:22. Google ScholarDigital Library
- Paul Berliner. 1994. Thinking in Jazz: The Infinite Art of Improvisation.Google Scholar
- Wiebe E Bijker, Thomas P Hughes, Trevor Pinch, and Deborah G Douglas. 2012. The social construction of technological systems: New directions in the sociology and history of technology. MIT press.Google Scholar
- J Bowers. 2002. Improvising machines: Ethnographically informed design for improvised electro-acoustic music. ARiADATexts (4).Google Scholar
- John Bowers, Robyn Taylor, Jonathan Hook, Dustin Freeman, Charlie Bramley, and Christopher Newell. 2014. HCI: human-computer improvisation. In Proceedings of the 2014 companion publication on Designing interactive systems, 203--206. Google ScholarDigital Library
- 1John Cage. 1952. 4'33''(Four thirty-three).Google Scholar
- John Cage and David Tudor. 1959. Indeterminacy: New Aspect of Form in Instrumental and Electronic Music: Reading. Folkways Records.Google Scholar
- Kathy Charmaz and Linda Liska Belgrave. 2007. Grounded theory. Wiley Online Library.Google Scholar
- Taylan Cihan. 2013. Blister. https://vimeo.com/56305601Google Scholar
- Peter Dalsgaard and Peter. 2016. Experimental Systems in Research through Design. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems - CHI '16, 4991--4996. Google ScholarDigital Library
- Paul Dourish, Annette Adler, and Brian Cantwell Smith. 1996. Organising User Interfaces Around Reflective Accounts. In Reflection'96, 235--244.Google Scholar
- Ernest A. Edmonds, Alastair Weakley, Linda Candy, Mark Fell, Roger Knott, and Sandra Pauletto. 2005. The studio as laboratory: Combining creative practice and digital technology research. International Journal of Human Computer Studies 63, 4--5 SPEC. ISS.: 452--481. Google ScholarDigital Library
- Ernest Edmonds and Linda Candy. 2002. Creativity, art practice, and knowledge. Communications of the ACM 45, 10: 91--95. Google ScholarDigital Library
- Bill Evans. 1957. Improvisation in Jazz. Kind of Blue.Google Scholar
- Bill Evans and Jim Hall. 1966. Intermodulation.Google Scholar
- 2SM Feisst. 2009. John Cage and improvisation: an unresolved relationship. Musical improvisation: Art, education, and society.Google Scholar
- 2Bill Gaver and John Bowers. 2012. Annotated portfolios. interactions 19, 4: 40. Google ScholarDigital Library
- William Gaver and William. 2012. What should we expect from research through design? In Proceedings of the 2012 ACM annual conference on Human Factors in Computing Systems - CHI '12, 937. Google ScholarDigital Library
- Elizabeth Gerber and Elizabeth. 2007. Improvisation principles and techniques for design. In Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '07, 1069. Google ScholarDigital Library
- Elisa Giaccardi and Gerhard Fischer. 2008. Creativity and evolution: a metadesign perspective. Digital Creativity 19, March 2015: 19--32.Google Scholar
- Hermann Gottschewski. 2007. The Provisum and the Improvisum in Musical Performance. Yonsei Music Research 14: 13--22.Google Scholar
- Guy Hoffman and Gil Weinberg. 2010. Gesture-based human-robot jazz improvisation. In Robotics and Automation (ICRA), 2010 IEEE International Conference on, 582--587.Google ScholarCross Ref
- Hrönn Brynjarsdóttir Holmer, Carl Disalvo, Phoebe Sengers, and Thomas Lodato. 2015. Constructing and constraining participation in participatory arts and HCI. International Journal of Human Computer Studies 74: 107--123. Google ScholarDigital Library
- Jonathan Hook, Guy Schofield, Robyn Taylor, Tom Bartindale, John McCarthy, and Peter Wright. 2012. Exploring HCI's relationship with liveness. In Proceedings of the 2012 ACM annual conference extended abstracts on Human Factors in Computing Systems Extended Abstracts - CHI EA '12, 2771. Google ScholarDigital Library
- Kristina Höök, Peter Dalsgaard, Stuart Reeves, Jeffrey Bardzell, Jonas Löwgren, Erik Stolterman, and Yvonne Rogers. 2015. Knowledge Production in Interaction Design. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems - CHI EA '15, 2429--2432. Google ScholarDigital Library
- 3Steven J. Jackson and Laewoo Kang. 2014. Breakdown, obsolescence and reuse. In Proceedings of the 32nd annual ACM conference on Human factors in computing systems - CHI '14, 449--458. Google ScholarDigital Library
- 3Giulio Jacucci, Mira Wagner, Ina Wagner, Elisa Giaccardi, Mauro Annunziato, Nell Breyer, Jonas Hansen, Kazuhiro Jo, Stijn Ossevoort, Alessandro Perini, Natacha Roussel, and Susanne Schuricht. 2010. ParticipArt: Exploring participation in interactive art installations. In 9th IEEE International Symposium on Mixed and Augmented Reality 2010: Arts, Media, and Humanities, ISMAR-AMH 2010 - Proceedings, 3--10.Google ScholarCross Ref
- 3P.a Jennings, E.b Giaccardi, and M.c Wesolkowska. 2006. About face interface: Creative engagement in the new media arts and HCI. Conference on Human Factors in Computing Systems - Proceedings: 1663--1666. Google ScholarDigital Library
- Laewoo (Leo) Kang. 2016. Breaking AndyWall: Transgressive and Playful Exploration on the Dynamic Role of Users in Art and Design. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '16), 3855--3858. Google ScholarDigital Library
- Laewoo (Leo) Kang. 2018. Intermodulator: interactive audio-visual system for collaborative improvisation. In Proceedings of the 2018 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '18). Google ScholarDigital Library
- Laewoo (Leo) Kang. 2017. Echo (): Listening to the Reflection of Obsolete Technology. In Proceedings of the 2016 ACM Conference Companion Publication on Designing Interactive Systems, 305--308. Google ScholarDigital Library
- 3Scott Barry Kaufman and Carolyn Gregoire. 2016. Wired to create: Unraveling the mysteries of the creative mind. Penguin.Google Scholar
- 3Nathaniel Klemp, Ray Mcdermott, and Jason Raley. 2008. Plans, Takes, and Mistakes. Critical Social Studies, 1: 4--21.Google Scholar
- 3Don Koberg. 1981. The all new universal traveler: A soft-systems guide to creativity, problem-solving, and the process of reaching goals. William Kaufmann Inc.Google Scholar
- A. Baki Kocaballi and Yeliz Yorulmaz. 2016. Performative Photography as an Ideation Method. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems - DIS '16, 1083--1095. Google ScholarDigital Library
- 4Patricia Leavy. 2010. Method meets art: Arts-based research practice. Counselling and Psychotherapy Research 10, 1: 76--77.Google ScholarCross Ref
- 4George E. Lewis and Benjamin Piekut. 2016. The Oxford Handbook of Critical Improvisation Studies, Volume 1.Google Scholar
- 4John McCarthy and Peter Wright. 2004. Technology as experience. interactions 11, 5: 42. Google ScholarDigital Library
- 4Timothy J. (Timothy James) McGee. 2003. Improvisation in the arts of the Middle Ages and Renaissance. Medieval Institute Publications, Western Michigan University.Google Scholar
- 4Don Norman. 2013. The design of everyday things: Revised and expanded edition. Basic Books (AZ).Google ScholarDigital Library
- 4T Nunn. 1998. Wisdom of the Impulse On the Nature of Musical Free Improvisation Part 2. Pdf julkaisu International Improvised Music Archive.Google Scholar
- 4William Odom, Ron Wakkary, Youn-kyung Lim, Audrey Desjardins, Bart Hengeveld, and Richard Banks. 2016. From Research Prototype to Research Product. Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems - CHI '16. Google ScholarDigital Library
- 4Nam June Paik. 1965. Zen for Film.Google Scholar
- 4Nam June Paik. 1969. Participation TV.Google Scholar
- J Pressing. 1988. Improvisation: methods and models. John A. Sloboda (Hg.): Generative processes in.Google Scholar
- 5Geber Ramalho and Jean-Gabriel Ganascia. 1994. Simulating creativity in jazz performance. In AAAI, 108--113. Google ScholarDigital Library
- 5Matt Ratto. 2011. Critical Making: Conceptual and Material Studies in Technology and Social Life. The Information Society 27, 4: 252--260. Google ScholarDigital Library
- 5Horst W J Rittel and Melvin M Webber. 1973. Dilemmas in a general theory of planning. Policy sciences 4, 2: 155--169.Google Scholar
- 5Francis. Rumsey and Tim. McCormick. 2006. Sound and recording: an introduction. Focal Press.Google Scholar
- 5R. K. Sawyer. 2006. Group creativity: musical performance and collaboration. Psychology of Music 34, 2: 148--165.Google ScholarCross Ref
- 5R. Keith Sawyer. 2000. Improvisation and the Creative Process: Dewey, Collingwood, and the Aesthetics of Spontaneity. The Journal of Aesthetics and Art Criticism 58, 2: 149.Google ScholarCross Ref
- 5R. Keith (Robert Keith) Sawyer. 2011. Structure and improvisation in creative teaching. Cambridge University Press.Google Scholar
- 5Lucy Suchman. 1987. Plans and Situated Actions. Cambridge University Press: 224.Google ScholarDigital Library
- 5John Zimmerman, Jodi Forlizzi, and Shelley Evenson. 2007. Research through design as a method for interaction design research in HCI. In Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '07, Paper 41. Google ScholarDigital Library
- John Zimmerman, Erik Stolterman, and Jodi Forlizzi. 2010. An analysis and critique of Research through Design. In Proceedings of the 8th ACM Conference on Designing Interactive Systems - DIS '10, 310. Google ScholarDigital Library
- 6Adversarial Design. Retrieved September 17, 2017 from http://dl.acm.org/citation.cfm?id=2341007Google Scholar
- 6Festival de Cannes: The Mystery of Picasso (In Competition). festival-cannes.com.Google Scholar
- 6Critical Studies in Improvisation. http://www.criticalimprov.com/Google Scholar
- 6The Electric Golem. http://levelgreen.com/electricgolem/Google Scholar
- 6Annie Lewandowski (Powerdove). http://www.annielewandowski.com/Google Scholar
Index Terms
- Intermodulation: Improvisation and Collaborative Art Practice for HCI
Recommendations
Using empathy to research creativity: collaborative investigations into distributed digital textile art and design practice
C&C '07: Proceedings of the 6th ACM SIGCHI conference on Creativity & cognitionThis paper describes the use of practice-based distributed collaborative investigations to examine ways in which digital technology can support creative visual art practice. The development of artworks through digital collaboration has enabled empathy ...
Heterogeneity in harmony: diverse practice in a multimedia arts collective
GROUP '05: Proceedings of the 2005 ACM International Conference on Supporting Group WorkHCI and CSCW researchers have begun to call for greater and more explicit support of creative endeavors. Current theories of creativity suggest that it is an inherently collaborative activity, situated and highly contextualized. This work argues that a ...
Digital tools in collaborative creative work
NordiCHI '18: Proceedings of the 10th Nordic Conference on Human-Computer InteractionThe aim of the workshop is to examine and discuss the role and functions of digital tools in collaborative creative work. While advancements in Human-Computer Interaction (HCI) research offer considerable potential for supporting creative work practices,...
Comments