Andrea Giomi
ABSTRACT
During the last years1, motion sensing technologies have been proven to be a useful mean for movement's analysis in relation to dance and music performances. The case study presented is part of a research project that involves dance pedagogy and new technologies at Nice University. This paper focus on description of an interactive experience based on motion sensing technologies allowing dance students to explore the connection between to relate kinesthesia, sense of touch and listening via interactive sound feedbacks.
- Anna Rita Addessi, Filomena Anelli et Marina Maffioli. 2015. The MIROR platform for young children's music and dance creativity: Reflexive interaction meets body-gesture, embodied cognition and Laban educational dance. Perspectives. Journal of Early Childhood Music & Movement Association, 10, 1 (2015), 9--17.Google Scholar
Cross Ref
- Armelle Balas-Chanel. 2002. L'Entretien d'explicitation. Accompagner l'apprenant vers la métacognition explicite. Recherches & educations: S'entretenir 1 (2002).Google Scholar
- Yoram Baram and Ariel Miller. 2007. Auditory feedback control for improvement of gait in patients with Multiple Sclerosis. Journal of the Neurological Sciences 254, 1-2 (2007), 90--94.Google ScholarCross Ref
- Andreas Bergsland and Robert Wechsler. 2017. Issues and Strategies of Rhythmicality for MotionComposer. Proceedings of the 4th International Conference on Movement Computing - MOCO 17 (2017). Google ScholarDigital Library
- Alain Berthoz. 2000. The brains sense of movement, Cambridge, MA: Harvard University Press.Google Scholar
- Frederic Bevilacqua, Fabrice Guédy, Norbert Schnell, Emmanuel Fléty, and Nicolas Leroy. 2007. Wireless Sensor Interface and Gesture-Follower for Music Pedagogy. A NIME Reader. Fifteen Years of New Interfaces for Musical Expression (2017), 267--284. Google ScholarDigital Library
- Frédéric Bevilacqua et al. 2016. Sensori-Motor Learning with Movement Sonification: Perspectives from Recent Interdisciplinary Studies. Frontiers in Neuroscience 10 (2016).Google Scholar
- Eric O. Boyer, Quentin Pyanet, Sylvain Hanneton, and Frédéric Bevilacqua. 2014. Learning Movement Kinematics with a Targeted Sound. Lecture Notes in Computer Science Sound, Music, and Motion (2014), 218--233.Google ScholarCross Ref
- Birgitta Burger, Suvi Saarikallio, Geoff Luck, Marc R. Thompson, and Petri Toiviainen. 2013. Relationships Between Perceived Emotions in Music and Music-induced Movement. Music Perception: An Interdisciplinary Journal 30, 5 (2013), 517--533.Google ScholarCross Ref
- Antonio Camurri and Gualtiero Volpe. 2016. The Intersection of Art and Technology. IEEE MultiMedia 23, 1 (2016), 10--17. Google ScholarDigital Library
- Antonio Camurri et al. 2016. A system to support the learning of movement qualities in dance. Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing Adjunct - UbiComp 16 (2016). Google ScholarDigital Library
- Yves Clot, Daniel Faïta, Gabriel Fernandez, and Livia Scheller. 2000. Entretiens en autoconfrontation croisée: une méthode en clinique de l'activité. Perspectives interdisciplinaires sur le travail et la santé, 2--1 (January 2000).Google Scholar
- Arnie Cox. 2011. Embodying music: principles of the mimetic hypothesis. Music Theory Online 17, 2 (2011), 1--24.Google ScholarCross Ref
- Steve Dixon. 2007. Digital performance: a history of new media in theater, dance, performance art, and installation, Cambridge, MA: MIT Press.Google Scholar
- Emma Frid, Roberto Bresin, Paolo Alborno, and Ludvig Elblaus. 2016. Interactive Sonification of Spontaneous Movement of Children---Cross-Modal Mapping and the Perception of Body Movement Qualities through Sound. Frontiers in Neuroscience 10 (November 2016).Google Scholar
- Nizan Friedman et al. 2014. Retraining and assessing hand movement after stroke using the MusicGlove: comparison with conventional hand therapy and isometric grip training. Journal of NeuroEngineering and Rehabilitation 11, 1 (2014), 76.Google ScholarCross Ref
- Jules Françoise, Yves Candau, Sarah Fdili Alaoui, and Thecla Schiphorst. 2017. Designing for Kinesthetic Awareness. Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems - CHI 17 (2017).Google ScholarDigital Library
- Jules Françoise, Sarah Fdili Alaoui, Thecla Schiphorst, and Frederic Bevilacqua. 2014. Vocalizing dance movement for interactive sonification of laban effort factors. Proceedings of the 2014 conference on Designing interactive systems - DIS 14 (2014). Google ScholarDigital Library
- Rolf Gehlhaar, Paulo Maria Rodrigues, Luis Miguel Girao, and Rui Penha. 2014. Instruments for everyone: designing new means of musical expression for disabled creator. In Anthony Brooks, Sheril Brahnam, & Jain Lakhmi, eds. Technologies of inclusive well-being. Serious game, alternatives realities and play therapy. New York, NY: Springer, 167--198.Google Scholar
- Isabelle Ginot. 2009. Discours, techniques du corps et technocorps. In Paul Gioffredi, ed. A la rencontre de la danse contemporaine: porosités et résistances. Paris: L'Harmattan, 265--293.Google Scholar
- Isabelle Ginot. 2012. Écouter le toucher. Chimères 78, 3 (2012), 87--100.Google Scholar
- Andrea Giomi. 2017. From haptic perception to movement: a phenomenological study on sound and technological mediation in dance pedagogy. Revista Repertório 28 (December 2017), 342--361.Google Scholar
- Hubert Godard. 2006. Des trous noirs. In Nouvelles de Danse n. 53. Scientifiquement, Danse. Quand la danse puise aux sciences et réciproquement, 53. Bruxelles: Contredanse, 23--33.Google Scholar
- Rolf Inge Godøy. 2003. Motor-Mimetic Music Cognition. Leonardo 36, 4 (2003), 317--319.Google ScholarCross Ref
- Rolf Inge Godøy, Egil Haga, and Alexander Refsum Jensenius. 2006. Playing « air instruments »: mimicry of sound-producing gestures by novices and experts. In Sylvie Gibet, Nicolas Courty, & Jean-François Kamp, eds. Gesture in Human-Computer Interaction and Simulation. Berlin-Heidelberg: Springer, 256--267. Google ScholarDigital Library
- Alexander Refsum Jensenius, Ralf Inge Godøy, Marc Leman, and Marcelo Morton Wanderley. 2010. Musical gestures: concepts and methods in research. In Ralf Inge Godøy & Marc Leman, eds. Musical Gestures: Sound, Movement, and Meaning. London-New York: Routledge, 12--35.Google Scholar
- Alexander Refsum Jensenius. 2013. An Action--Sound Approach to Teaching Interactive Music. Organised Sound 18, 02 (November 2013), 178--189.Google ScholarCross Ref
- Alexander Refsum Jensenius. 2017. Sonic Microinteraction in the Air. In Micheline Lesaffre, Pieter-Jan Maes, & Marc Leman, eds. The Routledge Companion to Embodied Music Interaction. New York: Routledge, 431--439.Google Scholar
- Anna Källblad, Anders Friberg, Karl Svensson, Elisabet S. Edelholm. 2008. Hoppsa Universum - An Interactive Dance Installation for Children. 8th International Conference on New Interfaces for Musical Expression, NIME 2008, Genova, Italy, June 5-7, 2008: 128--133Google Scholar
- Mats B. Küssner, Dan Tidhar, Helen M. Prior, and Daniel Leech-Wilkinson. 2014. Musicians are more consistent: Gestural cross-modal mappings of pitch, loudness and tempo in real-time. Frontiers in Psychology 5 (2014).Google Scholar
- Marc Leman. 2008. Embodied music cognition and mediation technology, Cambridge, MA: MIT Press. Google Scholar
- Pieter-Jan Maes, Edith Van Dyck, Micheline Lesaffre, Marc Leman, and Pieter M. Kroonenberg. 2014. The Coupling of Action and Perception in Musical Meaning Formation. Music Perception: An Interdisciplinary Journal 32, 1 (2014), 67--84.Google ScholarCross Ref
- Luc Nijs and Marc Leman. 2016. Performing with the music paint machine: provoking an embodied approach to educational technology. In Andrew King & Evangelos Himonides, eds. Music, technology and education: critical perspectives. London-New York: Routledge, 225--242.Google Scholar
- Armando Menicacci and Emanuele Quinz. 2006. Étendre la perception? Transferts intermodaux et biofeedback en danse. In Nouvelles de Danse n. 53. Scientifiquement, Danse. Quand la danse puise aux sciences et réciproquement, 53. Bruxelles: Contredanse, 76--96.Google Scholar
- Kristian Nymoen, Rolf Inge Godøy, Alexander Refsum Jensenius, and Jim Torresen. 2013. Analyzing correspondence between sound objects and body motion. ACM Transactions on Applied Perception 10, 2 (January 2013), 1--22. Google ScholarDigital Library
- Johanna Vg Robertson, Thomas Hoellinger, Påvel Lindberg, Djamel Bensmail, Sylvain Hanneton, and Agnès Roby-Brami. 2009. Effect of auditory feedback differs according to side of hemiparesis: a comparative pilot study. Journal of NeuroEngineering and Rehabilitation 6, 1 (2009), 45.Google ScholarCross Ref
- Chris Salter. 2010. Entangled: technology and the transformation of performance, Cambridge, MA: MIT Press. Google ScholarDigital Library
- Dhara A. Sharma, Mohamed Faisal Chevidikunnan, Fayaz Rahman Khan, and Riziq Allah Gaowgzeh. 2016. Effectiveness of knowledge of result and knowledge of performance in the learning of a skilled motor activity by healthy young adults. Journal of Physical Therapy Science 28, 5 (2016), 1482--1486.Google ScholarCross Ref
- Roland Sigrist, Georg Rauter, Robert Riener, and Peter Wolf. 2012. Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review. Psychonomic Bulletin & Review 20, 1 (July 2012), 21--53.Google Scholar
- Karen Stensæth. 2014. Potentials and challenges in interactive and musical collaborations involving children with disparate disabilities. A comparison study of how Petronella, with Down syndrome, and Dylan, with autism, interact with musical and interactive tangible "WAVE". In Karen Stensæth, ed. Music, health, technology and design. Oslo: NMH-publications, 97--118.Google Scholar
- Katharina Van Dik. 2014. Usages de la phénoménologie dans les études en danse. Recherches en danse 1 (2014).Google Scholar
- Robert J. Zatorre, Joyce L. Chen, and Virginia B. Penhune. 2007. When the brain plays music: auditory--motor interactions in music perception and production. Nature Reviews Neuroscience 8, 7 (2007), 547--558.Google ScholarCross Ref
Index Terms
- Listening Touch: A Case Study about Multimodal Awareness in Movement Analysis with Interactive Sound Feedback
Recommendations
Quantitative listening: temporal proportion in recordings of Mozart's piano sonatas
AMTA'06: Proceedings of the 7th WSEAS International Conference on Acoustics & Music: Theory & ApplicationsThere is much evidence to suggest that the golden mean (the ratio of approximately 1:1.618) can be observed in the spatial proportions of much classical architecture and painting. Subsequent research has posited that the ratio may also have been used in ...
Imaginal listening: A quaternary framework for listening to electroacoustic music and phenomena of sound-images
Discussing listeners and their listening process in electroacoustic music has always been a difficult task because of the apparent subjectivity of listening. If we understand, however, that listening is a phenomenal process, the subjectivity of ...
Composing by Listening: A Computer-Assisted System for Creating Emotional Music
Most people communicate emotion through their voice, facial expressions, and gestures. However, it is assumed that only "experts" can communicate emotions in music. The authors have developed a computer-based system that enables musically untrained ...
Comments