Abstract
This paper documents explorations into an alternative platform for creating live synesthetic imagery. Synesthetic imagery is created to help one embody the emotions that musical messages are intended to convey. The created imagery is typically abstract and generated according to some predefined rules. In this project, we explore the possibility of using virtual dancers for synesthesia and the piano as an interface for choreographing and performing/improvising the digitally created beings. In this case, digitally created water is explored as a metaphoric extension of the virtual dancers’ arms and hands. The non-abstract physically-based digital water’s movements are choreographed and performed/improvised by a human performer using the piano as the interface for directing the digital beings. This work suggests that the non-abstract representational visual elements directed by the musical instrument have potential to be used as an alternative live synesthetic imagery generative method.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Bolognini, N., Senna, I., Maravita, A., Pascual-Leone, A., Merabet, L.B.: Auditory enhancement of visual phosphene perception: The effect of temporal and spatial factors and of stimulus intensity. Neuroscience Letters 477, 109–114 (2010)
Dannenberg, R.B.: Interactive Visual Music: A Personal Perspective. Computer Music Journal 29(4), 25–35 (2005)
Snyder, R.: Video Color Control by Means of an Equal-Tempered Keyboard. Leonardo 18, 93 (1985)
Snibbe, S., Levin, G.: Interactive Dynamic Abstraction. In: Proceedings of Non-photorealistic Animation and Rendering (2000)
DeWitt, T.: Visual Music: Searching for an Aesthtic. Leonardo 20(2), 115–122 (1987)
Clauser, H.R.: Towards a Dynamic, Generative Computer Art. Leonardo 21(2), 115–122 (1988)
Pocock-Williams, L.: Toward the Automatic Generation of Visual Music. Leonardo 25(1), 29–36 (1992)
Alves, B.: Digital Harmony of Sound and Light. Computer Music Journal 29(4), 45–54 (2005)
Whitney, J.: Digital Harmony: On the Complementarity of Music and Visual Art. Byte Books, New York (1980)
Evans, B.: Foundations of a Visual Music. Computer Music Journal 29(4), 11–24 (2005)
Peacock, K.: Instruments to Perform Color-Music: Two Centuries of Technological Experimentation. Leonardo 21(4), 397–406 (1988)
Laban, R.: The Mastery of Movement. Northcote House (1988)
Iwai, T.: PianoAs Image Media. Leonardo 34(3), 183 (2001)
An article, USC animation team creates five-screen mini-Fantasia for New World Symphony (2010), http://www.adobe.com/education/resources/articles/usc-creates-five-screens.html
Akenine-MÖller, T., Haines, E., Hoffman, N.: Real-Time Rendering, 3rd edn. A K Peters (2008)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 ICST Institute for Computer Science, Social Informatics and Telecommunications Engineering
About this paper
Cite this paper
Kim, J. (2014). Choreographing Digital Water for Interactive Water Performance. In: Reidsma, D., Choi, I., Bargar, R. (eds) Intelligent Technologies for Interactive Entertainment. INTETAIN 2014. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 136. Springer, Cham. https://doi.org/10.1007/978-3-319-08189-2_5
Download citation
DOI: https://doi.org/10.1007/978-3-319-08189-2_5
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-08188-5
Online ISBN: 978-3-319-08189-2
eBook Packages: Computer ScienceComputer Science (R0)