Ilias Bergström
ABSTRACT
We often take for granted that we have immediate access to our perception and experience of and through our bodies. But inward listening is a demanding activity and thus not easy to learn to perform or design for. With the Sarka mat we want to support the ability to direct attention by providing sound feedback linked to the weight distribution and motion intensity of different parts of the body, and to provide an exemplar for how such design may be conducted. The process of Sarka's creation is informed by Somaesthetic Appreciation Design. We discuss how a sonic feedback signal can influence listeners, followed by how we, in this design, worked to navigate the complex design space presented to us. We detail the design process involved, and the very particular set of limitations which this interactive sonification presented.
- Ilias Bergstrom. 2016. Digital craft tools for user innovation without end-user programming -- the Puppeteering concept. (Under Review).Google Scholar
- Ilias Bergstrom and R. Beau Lotto. 2014. Soma: Live musical performance where congruent visual, auditory, and proprioceptive stimuli fuse to form a combined aesthetic narrative. Leonardo.Google Scholar
- Ilias Bergstrom, Sofia Seinfeld, Jorge Arroyo-Palacios, Mel Slater, and Maria V. Sanchez-Vives. 2014. Using music as a signal for biofeedback. International Journal of Psychophysiology 93, 1: 140--149.Google ScholarCross Ref
- Ilias Bergstrom, Anthony Steed, and Beau Lotto. 2009. Mutable Mapping: gradual re-routing of OSC control data as a form of artistic performance. Proceedings of the international conference on Advances in computer entertainment technology, 290--293. Google ScholarDigital Library
- L. Chiari, M. Dozza, A. Cappello, F. B Horak, V. Macellari, and D. Giansanti. 2005. Audio-biofeedback for balance improvement: an accelerometry-based system. IEEE Transactions on Biomedical Engineering 52, 12: 2108--2111.Google ScholarCross Ref
- Martin Clayton, Rebecca Sager, and Udo Will. 2005. In time with the music: the concept of entrainment and its significance for ethnomusicology.Google Scholar
- Antonio R. Damasio. 2006. Descartes' error. Random House.Google Scholar
- Ludvig Elblaus, Maurizio Goina, Marie-Andrée Robitaille, and Roberto Bresin. 2014. Modes of sonic interaction in circus: Three proofs of concept. Proceedings of the Sound and Music Computing Conference, 1698--1706.Google Scholar
- Moshe Feldenkrais. 1972. Awareness through movement. Feldenkrais Resources.Google Scholar
- Frank Feltham, Lian Loke, Elise van den Hoven, Jeffrey Hannam, and Bert Bongers. 2013. The Slow Floor: Increasing Creative Agency While Walking on an Interactive Surface. Proceedings of the 8th International Conference on Tangible, Embedded and Embodied Interaction, ACM, 105--112. Google ScholarDigital Library
- William Gaver. 2012. What should we expect from research through design? Proceedings of the SIGCHI conference on human factors in computing systems, ACM, 937--946. Google ScholarDigital Library
- T. Hermann. 2008. Taxonomy and definitions for sonification and auditory display. Proc. of the 14th ICAD, Paris.(www. sonification. de/main-def. shtml).Google Scholar
- Thomas Hermann, Andy Hunt, and John G. Neuhoff. 2011. The sonification handbook. Logos Verlag Berlin.Google Scholar
- Kristina Höök, Martin Jonsson, Anna Ståhl, and Johanna Mercurio. Somaesthetic Appreciation Design. Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, ACM, 3131--3142. Google ScholarDigital Library
- P. G Hunter and E. G Schellenberg. 2010. Music and Emotion. In Music Perception, Springer Handbook of Auditory Research 36. 129--164.Google ScholarCross Ref
- Martin Jonsson, Jakob Tholander, and Ylva Fernaeus. 2009. Setting the stage--Embodied and spatial dimensions in emerging programming practices. Interacting with computers 21, 1-2: 117--124. Google ScholarDigital Library
- G. Khut. 2006. Development and Evaluation of Participant-Centred Biofeedback Artworks. Unpublished doctoral exegesis, University of Western Sydney.Google Scholar
- G. Kramer, B. Walker, T. Bonebright, et al. 2010. Sonification report: Status of the field and research agenda.Google Scholar
- D. J Levitin. 2006. This is your brain on music. Dutton Publishing.Google Scholar
- S. R Livingstone and W. F Thompson. 2009. The emergence of music from the Theory of Mind. Musicae Scientiae 10: 83--115.Google ScholarCross Ref
- Alvin Lucier. 1976. Statement on: music for solo performer. Biofeedback and the Arts, Results of Early Experiments. Vancouver: Aesthetic Research Center of Canada Publications: 60--61.Google Scholar
- E. R. Miranda and Marcelo M. Wanderley. 2006. New Digital Musical Instruments: Control And Interaction Beyond the Keyboard. AR Editions. Google ScholarDigital Library
- B. Nettl. 2000. An ethnomusicologist contemplates universals in musical sound and musical culture. The origins of music: 463--472.Google Scholar
- Manfred Nusseck and Marcelo M. Wanderley. 2009. Music and Motion---How Music-Related Ancillary Body Movements Contribute to the Experience of Music. Music Perception: An Interdisciplinary Journal 26, 4: 335--353.Google ScholarCross Ref
- E. Peper, R. Harvey, and N. Takabayashi. 2009. Biofeedback an evidence based approach in clinical practice. Japanese Journal of Biofeedback Research 36, 1: 3--10.Google Scholar
- A. Ross. 2007. The rest is noise: Listening to the twentieth century. Farrar Straus & Giroux.Google Scholar
- V. N Salimpoor, M. Benovoy, K. Larcher, A. Dagher, and R. J Zatorre. 2011. Anatomically distinct dopamine release during anticipation and experience of peak emotion to music. Nature Neuroscience.Google Scholar
- Thecla Schiphorst. 2011. Self-evidence: applying somatic connoisseurship to experience design. CHI'11 Extended Abstracts on Human Factors in Computing Systems, ACM, 145--160. Google ScholarDigital Library
- Richard Shusterman. 2008. Body consciousness: A philosophy of mindfulness and somaesthetics. Cambridge University Press.Google Scholar
- Vygandas Šimbelis, Anders Lundström, Kristina Höök, Jordi Solsona, and Vincent Lewandowski. 2014. Metaphone: machine aesthetics meets interaction design. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, 1--10. Google ScholarDigital Library
- John A. Sloboda. 2005. Exploring the musical mind: cognition, emotion, ability, function. Oxford University Press.Google Scholar
- Jay Vidyarthi, Bernhard E. Riecke, and Diane Gromala, 2012. Sonic Cradle: designing for an immersive experience of meditation by connecting respiration to music. Proceedings of the Designing Interactive Systems Conference (DIS '12). 408--417. Google ScholarDigital Library
- I. Wallis, T. Ingalls, T. Rikakis, et al. 2007. Real-Time Sonification of Movement for an Immersive Stroke Rehabilitation Environment. Proceedings of the 13th International Conference on Auditory Display, Montréal, Canada.Google Scholar
- Matthew Wright. 2005. Open Sound Control: an enabling technology for musical networking. Organised Sound 10, 03: 193--200. Google ScholarDigital Library
- John Zimmerman, Jodi Forlizzi, and Shelley Evenson. 2007. Research through design as a method for interaction design research in HCI. Proceedings of the SIGCHI conference on Human factors in computing systems, ACM, 493--502. Google ScholarDigital Library
Index Terms
- Sarka: Sonification and Somaesthetic Appreciation Design
Recommendations
Cultivating kinaesthetic awareness through interaction: Perspectives from somatic practices and embodied cognition
MOCO '17: Proceedings of the 4th International Conference on Movement ComputingDesigning for kinaesthetic awareness, the perception of our body's position and movement, presents a unique set of challenges and opportunities. While these implications are relatively new in the HCI community, they resonate with experiential knowledge ...
Exploring touch and breath in networked wearable installation design
MM '10: Proceedings of the 18th ACM international conference on MultimediaThis paper describes the artistic design concepts for the interactive wearable artworks tendrils and exhale exhibited at ACM Multimedia 2010 Interactive Art Program in Firenze Italy at the at the Palazzo Medici-Riccardi from 25 October through 6 ...
Aesthetic strategies in sonification
Sound can be listened to in various ways and with different intentions. Multiple factors influence how and what we perceive when listening to sound. Sonification, the acoustic representation of data, is in essence just sound. It functions as ...
Comments