skip to main content
10.1145/3356590.3356631acmotherconferencesArticle/Chapter ViewAbstractPublication PagesamConference Proceedingsconference-collections
short-paper

Interactive sonification and the IoT: the case of smart sonic shoes for clinical applications

Published: 18 September 2019 Publication History

Abstract

To date, little attention has been devoted by the research community to applications of the Internet of Things (IoT) paradigm to the field of interactive sonification. The IoT has the potential to facilitate the emergence of novel forms of interactive sonifications that are the result of shared control of the sonification system by both the user performing the gestures locally to the system itself, and one or more remote users. This can for instance impact therapies based on auditory feedback where the control of the sound generation may be shared by patients and doctors remotely connected. This paper describes a prototype of connected shoes for interactive sonification that can be remotely controlled and can collect data about the gait of a walker. The system targets primarily clinical applications where sound stimuli are utilized to help guide and improve walking actions of patients with motor impairments.

References

[1]
J. Ardouin, L. Charpentier, M. Lagrange, F. Gontier, N. Fortin, D. Ecotière, J. Picaut, and C. Mietlicky. 2018. An innovative low cost sensor for urban sound monitoring. In INTER-NOISE and NOISE-CON Congress and Conference Proceedings, Vol. 258. Institute of Noise Control Engineering, 2226--2237.
[2]
L. Atzori, A. Iera, and G. Morabito. 2010. The Internet of Things: a survey. Computer networks 54, 15 (2010), 2787--2805. https://doi.org/10.1016/j.comnet.2010.05.010
[3]
J. P. Bello, C. Silva, O. Nov, R. L. Dubois, A. Arora, J. Salamon, C. Mydlarz, and H. Doraiswamy. 2019. SONYC: A System for Monitoring, Analyzing, and Mitigating Urban Noise Pollution. Commun. ACM 62, 2 (2019), 68--77. https://doi.org/10.1145/3224204
[4]
S. Dalla Bella, C. E. Benoit, N. Farrugia, P. E. Keller, H. Obrig, S. Mainka, and S. A. Kotz. 2017. Gait improvement via rhythmic stimulation in Parkinson's disease is linked to rhythmic skills. Scientific reports 7 (2017), 42005.
[5]
A. Gandomi and M. Haider. 2015. Beyond the hype: Big data concepts, methods, and analytics. International journal of information management 35, 2 (2015), 137--144.
[6]
T. Hermann and A. Hunt. 2005. Guest editors' introduction: An introduction to interactive sonification. IEEE multimedia 12, 2 (2005), 20--24.
[7]
T. Hermann, A. Hunt, and J. G. Neuhoff. 2011. The sonification handbook. Logos Verlag Berlin, Germany.
[8]
A. McPherson and V. Zappi. 2015. An Environment for SubmillisecondLatency Audio and Sensor Processing on BeagleBone Black. In Audio Engineering Society Convention 138. Audio Engineering Society. http://www.aes.org/e-lib/browse.cfm?elib=17755
[9]
M.W.M. Rodger, W.R. Young, and C.M. Craig. 2013. Synthesis of Walking Sounds for Alleviating Gait Disturbances in Parkinson's Disease. IEEE Transactions on Neural Systems and Rehabilitation Engineering 22, 3 (2013), 543--548.
[10]
S. S. Sethi, R. M. Ewers, N. S. Jones, C. D. L Orme, and L. Picinali. 2018. Robust, real-time and autonomous monitoring of ecosystems with an open, low-cost, networked device. Methods in Ecology and Evolution 9, 12 (2018), 2383--2387.
[11]
S. Skach, A. Xambó, L. Turchet, A. Stolfi, R. Stewart, and M. Barthet. 2018. Embodied Interactions with E-Textiles and the Internet of Sounds for Performing Arts. In Proceedings of the International Conference on Tangible, Embedded, and Embodied Interaction. ACM, 80--87. https://doi.org/10.1145/3173225.3173272
[12]
D. Stowell, D. Giannoulis, E. Benetos, M. Lagrange, and M.D Plumbley. 2015. Detection and classification of acoustic scenes and events. IEEE Transactions on Multimedia 17, 10 (2015), 1733--1746.
[13]
A. Tajadura-Jiménez, M. Basia, O. Deroy, M. Fairhurst, N. Marquardt, and N. Bianchi-Berthouze. 2015. As light as your footsteps: altering walking sounds to change perceived body weight, emotional state and gait. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, 2943--2952.
[14]
M.H. Thaut and M. Abiru. 2010. Rhythmic Auditory Stimulation in Rehabilitation of Movement Disorders: A Review of Current Research. Music Perception 27, 4 (2010), 263--269.
[15]
L. Turchet. 2016. Footstep sounds synthesis: design, implementation, and evaluation of foot-floor interactions, surface materials, shoe types, and walkers' features. Applied Acoustics 107 (2016), 46--68.
[16]
L. Turchet. 2018. Smart Mandolin: autobiographical design, implementation, use cases, and lessons learned. In Proceedings of Audio Mostly Conference. 13:1--13:7. https://doi.org/10.1145/3243274.3243280
[17]
L. Turchet, C. Fischione, G. Essl, D. Keller, and M. Barthet. 2018. Internet of Musical Things: Vision and Challenges. IEEE Access 6 (2018), 61994--62017. https://doi.org/10.1109/ACCESS.2018.2872625
[18]
L. Turchet, S. Serafin, and P. Cesari. 2013. Walking Pace Affected by Interactive Sounds Simulating Stepping on Different Terrains. ACM Transactions on Applied Perception 10, 4 (2013), 23:1--23:14.
[19]
D. Zanotto, L. Turchet, E.M. Boggs, and S.K. Agrawal. 2014. SoleSound: Towards a novel portable system for audio-tactile underfoot feedback. In Proceedings of the 5th IEEE International Conference on Biomedical Robotics and Biomechatronics. IEEE, 193--198.

Cited By

View all
  • (2024)Medicine's New Rhythm: Harnessing Acoustic Sensing via the Internet of Audio Things for HealthcareIEEE Open Journal of the Computer Society10.1109/OJCS.2024.34628125(491-510)Online publication date: 2024
  • (2024)Designing an Internet of Sounds Sonification System with FM Synthesis TechniquesIEEE Communications Magazine10.1109/MCOM.001.240015462:12(42-47)Online publication date: 1-Dec-2024
  • (2023)A Mapping Review of Real-Time Movement Sonification Systems for Movement RehabilitationIEEE Reviews in Biomedical Engineering10.1109/RBME.2022.318784016(672-686)Online publication date: 2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
AM '19: Proceedings of the 14th International Audio Mostly Conference: A Journey in Sound
September 2019
310 pages
ISBN:9781450372978
DOI:10.1145/3356590
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

In-Cooperation

  • The University of Nottingham: The University of Nottingham

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 September 2019

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Interactive sonification
  2. Internet of Things

Qualifiers

  • Short-paper
  • Research
  • Refereed limited

Conference

AM'19
AM'19: Audio Mostly
September 18 - 20, 2019
Nottingham, United Kingdom

Acceptance Rates

AM '19 Paper Acceptance Rate 25 of 49 submissions, 51%;
Overall Acceptance Rate 177 of 275 submissions, 64%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)17
  • Downloads (Last 6 weeks)0
Reflects downloads up to 13 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Medicine's New Rhythm: Harnessing Acoustic Sensing via the Internet of Audio Things for HealthcareIEEE Open Journal of the Computer Society10.1109/OJCS.2024.34628125(491-510)Online publication date: 2024
  • (2024)Designing an Internet of Sounds Sonification System with FM Synthesis TechniquesIEEE Communications Magazine10.1109/MCOM.001.240015462:12(42-47)Online publication date: 1-Dec-2024
  • (2023)A Mapping Review of Real-Time Movement Sonification Systems for Movement RehabilitationIEEE Reviews in Biomedical Engineering10.1109/RBME.2022.318784016(672-686)Online publication date: 2023
  • (2023)The Internet of Sounds: Convergent Trends, Insights, and Future DirectionsIEEE Internet of Things Journal10.1109/JIOT.2023.325360210:13(11264-11292)Online publication date: 1-Jul-2023
  • (2023)Towards a System Supporting Music Feedback Exercise in Physical Tele-Rehabilitation2023 4th International Symposium on the Internet of Sounds10.1109/IEEECONF59510.2023.10335285(1-7)Online publication date: 26-Oct-2023
  • (2021)A Comparative Analysis of Modeling and Predicting Perceived and Induced Emotions in SonificationElectronics10.3390/electronics1020251910:20(2519)Online publication date: 15-Oct-2021
  • (2021)Mind the StepsProceedings of the 16th International Audio Mostly Conference10.1145/3478384.3478398(139-146)Online publication date: 1-Sep-2021
  • (2020)The Internet of Audio Things: State of the Art, Vision, and ChallengesIEEE Internet of Things Journal10.1109/JIOT.2020.29970477:10(10233-10249)Online publication date: Oct-2020

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media