skip to main content
10.1145/3678299.3678349acmotherconferencesArticle/Chapter ViewAbstractPublication PagesamConference Proceedingsconference-collections
research-article
Open access

Articulating body experiences in reaction to movement sonifications: A workshop strategy for early research inquiries

Published: 18 September 2024 Publication History

Abstract

Auditory feedback of body movement has shown to alter one’s body perception. We present a multidisciplinary strategy for articulating how body feelings are affected by movement sonifications. Through a participatory workshop involving methods from design research in HCI and cognitive science, we gathered qualitative and quantitative data revealing contrasting body feelings for two sonifications. Analyses revealed that agility/rigidity, weakness/strength, salience of body boundaries, emotions, and different bodily areas were differently affected. Our findings evidence this paradigm as efficient for distilling qualities altered by sonifications. We discuss its relevance for early stages of the research inquiry and its particular importance in the context of body movement sonifications.

Supplemental Material

PDF File
Supplementary Materials (questionnaire and additional statistics)

References

[1]
Olaf Blanke, Mel Slater, and Andrea Serino. 2015. Behavioral, Neural, and Computational Principles of Bodily Self-Consciousness. Neuron 88, 1 (Oct. 2015), 145–166. https://doi.org/10.1016/j.neuron.2015.09.029
[2]
Ophelia Deroy, Irune Fernandez-Prieto, Jordi Navarra, and Charles Spence. 2018. Unraveling the Paradox of Spatial Pitch (1 ed.). Cambridge University Press, 77–93. https://doi.org/10.1017/9781316651247.006
[3]
C Heath, J Hindmarsh, and P Luff. 2010. Video Analysis and Qualitative Research. Sage.
[4]
Konstantina Kilteni, Antonella Maselli, Konrad P. Kording, and Mel Slater. 2015. Over my fake body: body ownership illusions for studying the multisensory basis of own-body perception. Frontiers in Human Neuroscience 9 (2015). https://doi.org/10.3389/fnhum.2015.00141
[5]
Judith Ley-Flores, Eslam Alshami, Aneesha Singh, Frédéric Bevilacqua, Nadia Bianchi-Berthouze, Ophelia Deroy, and Ana Tajadura-Jiménez. 2022. Effects of pitch and musical sounds on body-representations when moving with sound. Scientific Reports 12, 11 (Feb. 2022), 2676. https://doi.org/10.1038/s41598-022-06210-x
[6]
Judith Ley-Flores, Laia Turmo Vidal, Nadia Berthouze, Aneesha Singh, Frédéric Bevilacqua, and Ana Tajadura-Jiménez. 2021. SoniBand: Understanding the Effects of Metaphorical Movement Sonifications on Body Perception and Physical Activity. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. ACM, Yokohama Japan, 1–16. https://doi.org/10.1145/3411764.3445558
[7]
Marte Roel Lesur, Helena Aicher, Sylvain Delplanque, and Bigna Lenggenhager. 2020. Being Short, Sweet, and Sour: Congruent Visuo-Olfactory Stimulation Enhances Illusory Embodiment. Perception 49, 6 (June 2020), 693–696. https://doi.org/10.1177/0301006620928669
[8]
Marte Roel Lesur, Elena Bolt, Gianluca Saetta, and Bigna Lenggenhager. 2021. The monologue of the double: Allocentric reduplication of the own voice alters bodily self-perception. Consciousness and Cognition 95 (Oct. 2021), 103223. https://doi.org/10.1016/j.concog.2021.103223
[9]
David Silverman. 2004. Qualitative Research: Theory, Method and Practice. SAGE Publications.
[10]
Ana Tajadura-Jiménez, Maria Basia, Ophelia Deroy, Merle Fairhurst, Nicolai Marquardt, and Nadia Bianchi-Berthouze. 2015. As Light As Your Footsteps: Altering Walking Sounds to Change Perceived Body Weight, Emotional State and Gait. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems(CHI ’15). ACM, New York, NY, USA, 2943–2952. https://doi.org/10.1145/2702123.2702374
[11]
Laia Turmo Vidal, Judith Ley-Flores, Elena Márquez Segura, and Ana Tajadura-Jimenez. 2023. Exploring Material Metaphors to Design Sensorial Wearables for Body Transformation Experiences. In Body x Materials: A Workshop Exploring the Role of Material-Enabled Body-Based Multisensory Experiences.
[12]
Laia Turmo Vidal, Yinchu Li, Martin Stojanov, Karin B Johansson, Beatrice Tylstedt, and Lina Eklund. 2023. Towards Advancing Body Maps as Research Tool for Interaction Design. In Proceedings of the Seventeenth International Conference on Tangible, Embedded, and Embodied Interaction(TEI ’23). Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3569009.3573838

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
AM '24: Proceedings of the 19th International Audio Mostly Conference: Explorations in Sonic Cultures
September 2024
565 pages
ISBN:9798400709685
DOI:10.1145/3678299
This work is licensed under a Creative Commons Attribution International 4.0 License.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 September 2024

Check for updates

Author Tags

  1. Multisensory body perception
  2. body movement.
  3. body transformation experiences
  4. mixed methods
  5. sonification

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Funding Sources

Conference

AM '24

Acceptance Rates

Overall Acceptance Rate 177 of 275 submissions, 64%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 111
    Total Downloads
  • Downloads (Last 12 months)111
  • Downloads (Last 6 weeks)34
Reflects downloads up to 01 Mar 2025

Other Metrics

Citations

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Login options

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media