Abstract
A review of musical creativity in collaborative virtual environments (CVE) shows recurring interaction metaphors that tend from precise control of individual parameters to higher level gestural influence over whole systems. Musical performances in CVE also show a consistent re-emergence of a unique form of collaboration called “melding” in which individual virtuosity is subsumed to that of the group. Based on these observations, we hypothesized that CVE could be a medium for creating new forms of music, and developed the audiovisual augmented reality system (AVIARy) to explore higher level metaphors for composing spatial music in CVE. This paper describes the AVIARy system, the initial experiments with interaction metaphors, and the application of the system to develop and stage a collaborative musical performance at a sound art concert. The results from these experiments indicate that CVE can be a medium for new forms of musical creativity and distinctive forms of music.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Barbosa A (2003) Displaced Soundscapes: a survey of network systems for music and sonic art creation. Leonardo Music J 13:53–59
Bargar R, Choi I, Das S, Goudeseune C (1994) Model-based interactive sound for an immersive virtual environment. In: Proceedings of the international computer music conference, Aarhus
Bencina R (2005) P5 Glove developments. http://www.audiomulch.com/simulus/p5glove (visited 31 July 2006)
Bencina R, Burk P (2003) PortAudio–an open source cross platform audio API. http://www.portaudio.com/ (visited 31 July 2006)
Berry R, Makino M, Hikawa N, Suzuki M (2003) The augmented composer project: the music table. In: Proceedings of the second IEEE and ACM international symposium on mixed and augmented reality, San Francisco
Bertin J (1981) Graphics and graphic information processing. Walter de Gruter, Berlin
Billinghurst M, Kato H (1999) Collaborative mixed reality. In: Proceedings of the international symposium on mixed reality, Yokohama
Bischoff J, Gold R, Horton J (1978) Music for an interactive network of microcomputers. Comput Music J 2:24–29
Borchers JO, Samminger W, Mühlhäuser M (2001) Conducting a realistic electronic orchestra. In: Proceedings of the 14th annual symposium on user interface software and technology, Orlando
Burke P (1998) JSyn—a real-time synthesis API for Java. In: Proceedings of the international computer music conference, Ann Arbor
Carlile J, Hartmann B (2005) OROBORO: a collaborative controller with interpersonal haptic feedback. In: Proceedings of the conference on new interfaces for musical expression, Vancouver
Cruz-Neira C, Sandin DJ, DeFanti TA, Kenyon RV, Hart JC (1992) The cave-audio visual experience automatic virtual environment. Commun ACM 35(6):64–72
Eckel G (1999) Application for the cyberstage spatial sound server. In: Proceedings of the AES 16th international conference: spatial sound reproduction, Rovaniemi
Gadd A, Fels S (2002) MetaMuse: metaphors for expressive instruments. In: Proceedings of the conference on new interfaces for musical expression, Dublin
Geiger C, Reimann C, Stocklein J, Paelke V (2002) JARToolkit-Java binding for AR toolkit. In: Proceedings of the first IEEE international augmented reality toolkit workshop, Darmstadt
Hinckley K, Pausch R, Goble J.C, Kassell NF (1994) A three-dimensional user interface for neurosurgical visualization. In: Proceedings of the SPIE conference on medical imaging
Hypersense Complex (2003) http://www.arrowtheory.com/hypersense/ (visited 31 July 2006)
Jacob T, Barrass S (2003) The beehive java3D audio device. The Australian meeting on visualisation and virtual reality, Melbourne
Jorda S, Kaltenbrunner M, Geiger G, and Bencina R (2005) The reacTable. In: Proceedings of the international computer music conference, Barcelona
Jung B, Hwang J, Lee S, Kim GJ, Kim H (2000) Incorporating co-presence in distributed virtual music environment. In: Proceedings of the ACM symposium on virtual reality software and technology, Seoul
Kaper HG, Tipei S, Wiebel E (1997) High-performance computing, music composition, and the sonification of scientific data, technical report ANL/MCS-P690-0997
Lanier J, Biocca F (1992) An insider’s view of the future of virtual reality. J Commun 42(4):150
Machover T, Chung J (1989) Hyperinstruments: musically intelligent and interactive performance and creativity systems. In: Proceedings of the international computer music conference, Columbus
Massie TH, Salisbury JK (1994) The PHANToM haptic interface: a device for probing virtual objects. ASME winter annual meeting
Mäki-Patola T (2005) User interface comparison for virtual drums. In: Proceedings of the international conference on new interfaces for musical expression, Vancouver
Morita H, Hashimoto S, Ohteru S (1991) A computer music system that follows a human conductor”. IEEE Comput 24(7):44–53
Morse (2004) AVIARy: audio visualisation interactive augmented reality, the australian meeting on visualisation and virtual reality, Brisbane. http://www.petermorse.com.au/PMcomhtml/aviary.html (visited 31 July 2006)
Mäki-Patola T, Kanerva A, Laitinen J, Takala T (2005) Experiments with virtual reality instruments. In: Proceedings of the international conference on new interfaces for musical expression, Vancouver
O’Modhrain S (2000) Playing by feel: incorporating haptic feedback into computer-based musical instruments. PhD Thesis, Stanford University
Poupyrev I, Berry R, Kurumisawa J, Nakao K, Billinghurst M, Airola C, Kato H, Yonezawa T, Baldwin L (2000) Augmented groove: collaborative jamming in augmented reality. SIGGRAPH’2000 conference abstracts and applications. ACM
Pulkki V (2001) Spatial sound generation and perception by amplitude panning techniques. PhD Thesis, Helsinki University of Technology, Espoo
Ruspini D, Khatib O (1998) Acoustic cues for haptic rendering systems. In: Proceedings of the PHANTOM users group, Dedham
Schertenleib S, Gutierrez M, Vexo V, Thalmann D (2004) Conducting a virtual orchestra. IEEE MultiMedia 11(3):40–49
Sensable (2004) HapticSound demonstration. ACM SIGGRAPH conference on graphics and interaction techniques. http://www.sensable.com/popup_haptic_application_videos.asp (visited 31 July 2006)
Sheridan J, Sood G, Jacob T, Gardner H, Barrass S (2004) SoundStudio4D-a VR interface for gestural composition of spatial soundscapes. In: Proceedings of the international conference on auditory display, Sydney
Sood G, Barrass S (2003) Groovy tubes: an interface for designing sound effects in space and time. In: Proceedings of the australian conference on computer human interaction, Brisbane
Wellner P (1992) The DigitalDesk calculator: tactile manipulation on a desktop display. In: Proceedings of the international conference on user interface and software technology, Hilton Head
Yu J, Machover T (1996) The Palette, the brain opera. http://www.brainop.media.mit.edu/online/net-music/net-instrument/LabeledSharle.html (visited 31 July 2006)
Acknowledgments
The consumers were A/Prof. Stephen Barrass (direction), Tim Barrass (programming), Dr. Alistair Riddell (sound), Anita Fitton (graphics), Onaclov (theatre), Dr. Peter Morse (semiotics). We would especially like to thank Jun/Prof. Steffi Graf and Dr. Leonie Schäfer for their encouragement, incredible patience and invaluable help with this article.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Barrass, S., Barrass, T. Musical creativity in collaborative virtual environments. Virtual Reality 10, 149–157 (2006). https://doi.org/10.1007/s10055-006-0043-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10055-006-0043-5