Abstract
The paper introduces the concept of multimodal environments in relation to Gestalt theory. Multimedia environments provide digital extensions for different human activities, such as movement, thinking, composing, listening, planning, etc. The environments discussed in this paper make use of the state-of-the art in sensoring technology and computing. They typically combine different methods of knowledge representation such as symbolic, iconic, and subsymbolic representations into a hybrid architecture. Movement detection, as well as beat induction and musical responses to action that happen on the scene all involve Gestalt notions. In this paper, we focus on a number of requirements for the application of multimodal environments in music and art. Applications are discussed and the basic architecture of an existing experimental platform is outlined.
Preview
Unable to display preview. Download preview PDF.
References
Bates, J. (1994). The role of emotions in believable agents. Communications of the ACM, 37, 122–125.
Camurri, A. (1995). Interactive dance/music systems. In Proceedings International Computer Music Conference (ICMC-95). Banff: ICMA Press.
Camurri, A., & Ferrentino, P. (1997). A computational model of artificial emotion and its application in the theatrical museal machine project (Tech. Rep.). DIST Laboratory on Musical Informatics.
Camurri, A., Innocenti, C., & Massari, A. (1995). Toward an integrated agent architecture for real-time, multi-modal interaction in multimedia systems. In First International Congress on Music and Artificial Intelligence (ICMAI-95). Edinburgh.
Camurri, A., & Leman, M. (1997). Gestalt-based composition and performance in multimodal environments. In M. Leman (Ed.), Music, Gestalt, and computing: Studies in cognitive and systematic musicology. Berlin, Heidelberg: Springer-Verlag.
Camurri, A., Morasso, P., Tagliasco, V., & Zaccaria, R. (1986). Dance and movement notation. In P. Morasso & V.Tagliasco (Eds.), Human movement understanding. Amsterdam: North Holland.
Damasio, A. (1994). Descatres error: Emotion, reason, and the human brain. Chatham, Kent: Mackays of Chatham.
Leman, M. (1989). Symbolic and subsymbolic information processing in models of musical communication and cognition. Interface-Journal of New Music Research, 18, 141–160.
Leman, M. (1995). Music and schema theory: Cognitive foundations of systematic musicology. Berlin, Heidelberg: Springer-Verlag.
Machover, T., & Chung, J. (1989). Hyperinstruments: Musically intelligent and interactive performance and creativity systems. In Proceedings International Computer Music Conference (ICMC-1989). Columbus, Ohio, USA.
Maes, P., Blumberg, B., Darrel, T., Pentland, A., & Wexelblat, A. (1995). Modeling interactive agents in ALIVE. In Proceedings International Joint Conference on Artificial Intelligence (IJCAI-95). Montreal.
Povall, R. (1995). Compositional methods in interactive performance environments. Journal of New Music Research, 109–120.
Riecken, D. (1992). Wolfgang: A system using emoting potentials to manage musical design. In M. Balaban, K. Ebcioglu, & O. Laske (Eds.), Understanding music with AI: Perspectives on music cognition. Cambridge, MA: The MIT Press.
Riecken, D. (Ed.). (1994). Special issue on intelligent agents. (Communications of the ACM, July 1994)
Rowe, R. (1993). Interactive music systems. Cambridge, MA: The MIT Press.
Schomaker, L. (1995). Taxonomy on multimodal interaction in multimedia systems. MIAMI Esprit Project.
Thorisson, K. (1995). Multimodal interface agents. Unpublished doctoral dissertation, MIT Media Lab.
Vidolin, A.(1987). Ambienti esecutivi.In I profili del suono. Musica Verticale.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1997 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Camurri, A., Leman, M. (1997). Gestalt-based composition and performance in multimodal environments. In: Leman, M. (eds) Music, Gestalt, and Computing. JIC 1996. Lecture Notes in Computer Science, vol 1317. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0034136
Download citation
DOI: https://doi.org/10.1007/BFb0034136
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-63526-0
Online ISBN: 978-3-540-69591-2
eBook Packages: Springer Book Archive