skip to main content
research-article

Walking pace affected by interactive sounds simulating stepping on different terrains

Published: 01 October 2013 Publication History

Abstract

This article investigates whether auditory feedback affects natural locomotion patterns. Individuals were provided with footstep sounds simulating different surface materials. The sounds were interactively generated using shoes with pressure sensors. Results showed that subjects' walking speed changed as a function of the type of simulated ground material. This effect may arise due to the presence of conflicting information between the auditory and foot-haptic modality, or because of an adjustment of locomotion to the physical properties evoked by the sounds simulating the ground materials. The results reported in this study suggest that auditory feedback may be more important in the regulation of walking in natural environments than has been acknowledged. Furthermore, auditory feedback could be used to develop novel approaches to the design of therapeutic and rehabilitation procedures for locomotion.

References

[1]
Avanzini, F. and Crosato, P. 2006. Haptic-auditory rendering and perception of contact stiffness. Lecture Notes in Computer Science 4129, 24--35.
[2]
Avanzini, F. and Rocchesso, D. 2001. Modeling collision sounds: Non-linear contact force. In Proceedings of the Digital Audio Effects Conference. 61--66.
[3]
Baram, Y. and Lenger, R. 2009. Gait improvement in patients with cerebral palsy by visual and auditory feedback. In Proceedings of the Virtual Rehabilitation International Conference. IEEE, 146--149.
[4]
Baram, Y. and Miller, A. 2007. Auditory feedback control for improvement of gait in patients with multiple sclerosis. J. Neurol. Sci. 254, 1, 90--94.
[5]
Bresin, R., Papetti, S., Civolani, M., and Fontana, F. 2010. Expressive sonification of footstep sounds. In Proceedings of the Interactive Sonification Workshop (ISon’10). 51--54.
[6]
Chase, R. A., Harvey, S., Standfast, S., Rapin, I., and Sutton, S. 1959. Comparison of the effects of delayed auditory feedback on speech and key tapping. Science 129, 3353, 903--904.
[7]
Conklyn, D., Stough, D., Novak, E., Paczak, S., Chemali, K., and Bethoux, F. 2010. A home-based walking program using rhythmic auditory stimulation improves gait performance in patients with multiple sclerosis: a pilot study. Neurorehabil. Neural Repair 24, 9, 835--842.
[8]
Cook, P. 1997. Physically informed sonic modeling (PhISM): Synthesis of percussive sounds. Comput. Music J. 21, 3, 38--49.
[9]
DiFranco, D., Beauregard, G., and Srinivasan, M. 1997. The effect of auditory cues on the haptic perception of stiffness in virtual environments. In Proceedings of the ASME Dynamic Systems and Control Division, vol. 61. 17--22.
[10]
Ferrell, W. 1965. Remote manipulation with transmission delay. IEEE Trans. Hum. Factors Electron. 6, 1.
[11]
Fontana, F. and Visell, Y., Eds. 2012. Walking with the Senses: Perceptual Techniques for Walking in Simulated Environments. Logo, Berlin.
[12]
Gaver, W. 1993a. How do we hear in the world? Explorations in ecological acoustics. Ecol. Psychol. 5, 4, 285--313.
[13]
Gaver, W. 1993b. What in the world do we hear?: An ecological approach to auditory event perception. Ecol. Psychol. 5, 1, 1--29.
[14]
Giordano, B., Visell, Y., Yao, H.-Y., Hayward, V., Cooperstock, J., and McAdams, S. 2012. Identification of walked-upon materials in auditory, kinesthetic, haptic and audio-haptic conditions. J. Acoust. Soc. Am. 131, 4002--4012.
[15]
Hayden, R., Clair, A., Johnson, G., and Otto, D. 2009. The effect of rhythmic auditory stimulation (ras) on physical therapy outcomes for patients in gait training following stroke: a feasibility study. Int. J. Neurosci. 119, 12, 2183--2195.
[16]
Hunt, K. H. and Crossley, F. R. E. 1975. Coefficient of restitution interpreted as damping in vibroimpact. ASME Journal of Applied Mechanics 42, 2, 440--445.
[17]
Kalmus, H., Denes, P., and Fry, D. B. 1955. Effect of delayed acoustic feedback on some nonvocal activities. Nature 175, 1078.
[18]
Kim, S., Kwak, E., Park, E., Lee, D., Kim, K., Song, J., and Cho, S. 2011. Changes in gait patterns with rhythmic auditory stimulation in adults with cerebral palsy. Neurorehabil. 29, 3, 233--41.
[19]
Kobayashi, Y., Osaka, R., Hara, T., and Fujimoto, H. 2008. How accurately people can discriminate the differences of floor materials with various elasticities. IEEE Trans. Neural Rehabil. Syst. Eng. 16, 1, 99--105.
[20]
Kwak, E. 2007. Effect of rhythmic auditory stimulation on gait performance in children with spastic cerebral palsy. J. Music Ther. 44, 3, 198--216.
[21]
Lécuyer, A. 2009. Simulating haptic feedback using vision: A survey of research and applications of pseudo-haptic feedback. Presence Teleoper. Virtual Environ. 18, 1, 39--53.
[22]
Lee, B. S. 1951. Artificial stutter. J. Speech Disorders 16, 1, 53--55.
[23]
Lim, I., Van Wegen, E., De Goede, C., Deutekom, M., Nieuwboer, A., Willems, A., Jones, D., Rochester, L., and Kwakkel, G. 2005. Effects of external rhythmical cueing on gait in patients with Parkinsons disease: A systematic review. Clin. Rehabil. 19, 7, 695--713.
[24]
McIntosh, G., Brown, S., Rice, R., and Thaut, M. 1997. Rhythmic auditory-motor facilitation of gait patterns in patients with Parkinsons disease. J. Neurol. Neurosurg. Psych. 62, 1, 22--26.
[25]
Nordahl, R., Serafin, S., and Turchet, L. 2010. Sound synthesis and evaluation of interactive footsteps for virtual reality applications. In Proceedings of the IEEE Virtual Reality Conference. 147--153.
[26]
Perkell, J., Matthies, M., Lane, H., Guenther, F., Wilhelms-Tricarico, R., Wozniak, J., and Guiod, P. 1997. Speech motor control: Acoustic goals, saturation effects, auditory feedback and internal models. Speech Commun. 22, 2--3, 227--250.
[27]
Queralt, A., Weerdesteyn, V., Van Duijnhoven, H., Castellote, J., Valls-Solé, J., and Duysens, J. 2008. The effects of an auditory startle on obstacle avoidance during walking. J. Physiol. 586, 18, 4453--4463.
[28]
Rocchesso, D., Avanzini, F., Rath, M., Bresin, R., and Serafin, S. 2004. Contact sounds for continuous feedback. In Proceedings of the International Workshop on Interactive Sonification. Citeseer, 1--6.
[29]
Roerdink, M., Bank, P., Peper, C., and Beek, P. 2011. Walking to the beat of different drums: practical implications for the use of acoustic rhythms in gait rehabilitation. Gait & Posture 33, 4, 690--694.
[30]
Rubinstein, T., Giladi, N., and Hausdorff, J. 2002. The power of cueing to circumvent dopamine deficits: a review of physical therapy treatment of gait disturbances in Parkinsons disease. Mov. Disorders 17, 6, 1148--1160.
[31]
Schauer, M. and Mauritz, K.-H. 2003. Musical motor feedback (MMF) in walking hemiparetic stroke patients: randomized trials of gait improvement. Clin. Rehabil. 17, 7, 713--722.
[32]
Scott, D., Stohler, C., Egnatuk, C., Wang, H., Koeppe, R., and Zubieta, J.-K. 2007. Individual differences in reward responding explain placebo-induced expectations and effects. Neuron 55, 2, 325--336.
[33]
Serafin, S., Turchet, L., Nordahl, R., Dimitrov, S., Berrezag, A., and Hayward, V. 2010. Identification of virtual grounds using virtual reality haptic shoes and sound synthesis. In Proceedings of the Eurohaptics Symposium on Haptic and Audio-Visual Stimuli: Enhancing Experiences and Interaction. 61--70.
[34]
Sheridan, T. B. 1992. Musings on telepresence and virtual presence. Presence: Teleoper. Virtual Environ. 1, 1, 120--126.
[35]
Staum, M. 1983. Music and rhythmic stimuli in the rehabilitation of gait disorders. J. Music Ther. 20, 2, 69--87.
[36]
Styns, F., van Noorden, L., Moelants, D., and Leman, M. 2007. Walking on music. Hum. Mov. Sci. 26, 769--785.
[37]
Thaut, M. 2005. Rhythm, Music and the Brain: Scientific Foundations and Clinical Applications. Routledge.
[38]
Thaut, M. and Abiru, M. 2010. Rhythmic auditory stimulation in rehabilitation of movement disorders: A review of current research. Music Percept. 27, 4, 263--269.
[39]
Thaut, M., McIntosh, G., Prassas, S., and Rice, R. 1993. The effect of auditory rhythmic cuing on stride and EMG patterns in hemiparetic gait of stroke patients. Neurorehabil. Neural Repair 7, 1, 9--16.
[40]
Thaut, M., McIntosh, G., and Rice, R. 1997. Rhythmic facilitation of gait training in hemiparetic stroke rehabilitation. J. Neurol. Sci. 151, 2, 207--212.
[41]
Turchet, L., Nordahl, R., Berrezag, A., Dimitrov, S., Hayward, V., and Serafin, S. 2010. Audio-haptic physically based simulation of walking on different grounds. In Proceedings of IEEE International Workshop on Multimedia Signal Processing. IEEE, 269--273.
[42]
Turchet, L. and Serafin, S. 2013. Investigating the amplitude of interactive footstep sounds and soundscape reproduction. Appl. Acoust. 74, 4, 566--574.
[43]
Turchet, L., Serafin, S., Dimitrov, S., and Nordahl, R. 2010. Physically based sound synthesis and control of footsteps sounds. In Proceedings of the Digital Audio Effects Conference. 161--168.
[44]
Van Berggeijk, W. A. and David, E. E. 1959. Delayed handwriting. Percept. Motor Skills 9, 3, 347--357.
[45]
Van Peppen, R., Kwakkel, G., Wood-Dauphinee, S., Hendriks, H., Van der Wees, P., and Dekker, J. 2004. The impact of physical therapy on functional outcomes after stroke: whats the evidence? Clin. Rehabil. 18, 8, 833--862.
[46]
Ware, C. and Balakrishnan, R. 1994. Reaching for objects in vr displays: lag and frame rate. ACM Trans. Comput. Hum. Interact. 1, 4, 331--356.
[47]
Yates, A. J. 1963. Delayed auditory feedback. Psychol. Bull. 60, 3, 213--232.

Cited By

View all
  • (2025)The effects of footstep sounds on impression formation and persuasionJournal of Retailing and Consumer Services10.1016/j.jretconser.2024.10408682(104086)Online publication date: Jan-2025
  • (2024)Navigating ‘feel’: When hands touch sound effectsSoundtrack, The10.1386/ts_00033_116:1(61-76)Online publication date: 1-Sep-2024
  • (2024)Survey on Haptic Feedback through Sensory Illusions in Interactive SystemsACM Computing Surveys10.1145/364835356:8(1-39)Online publication date: 10-Apr-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Applied Perception
ACM Transactions on Applied Perception  Volume 10, Issue 4
October 2013
190 pages
ISSN:1544-3558
EISSN:1544-3965
DOI:10.1145/2536764
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 October 2013
Accepted: 01 October 2009
Revised: 01 July 2009
Received: 01 February 2009
Published in TAP Volume 10, Issue 4

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Walking
  2. gait patterns
  3. interactive auditory feedback

Qualifiers

  • Research-article
  • Research
  • Refereed

Funding Sources

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)21
  • Downloads (Last 6 weeks)1
Reflects downloads up to 13 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2025)The effects of footstep sounds on impression formation and persuasionJournal of Retailing and Consumer Services10.1016/j.jretconser.2024.10408682(104086)Online publication date: Jan-2025
  • (2024)Navigating ‘feel’: When hands touch sound effectsSoundtrack, The10.1386/ts_00033_116:1(61-76)Online publication date: 1-Sep-2024
  • (2024)Survey on Haptic Feedback through Sensory Illusions in Interactive SystemsACM Computing Surveys10.1145/364835356:8(1-39)Online publication date: 10-Apr-2024
  • (2024)A Journey Inward: The Somaesthetic Experience of a Heated Walking CarpetExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650915(1-7)Online publication date: 11-May-2024
  • (2024)Virtual Steps: The Experience of Walking for a Lifelong Wheelchair User in Virtual Reality2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR58804.2024.00040(168-178)Online publication date: 16-Mar-2024
  • (2024)Selection as Tapping: An evaluation of 3D input techniques for timing tasks in musical Virtual RealityInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2024.103231185(103231)Online publication date: May-2024
  • (2024)Sonifying gait kinematics: generating water wading sounds through a digital Foley approachPersonal and Ubiquitous Computing10.1007/s00779-024-01829-128:5(823-843)Online publication date: 1-Oct-2024
  • (2023)Vibrollusion: Creating a Vibrotactile Illusion Induced by Audiovisual Touch FeedbackProceedings of the 22nd International Conference on Mobile and Ubiquitous Multimedia10.1145/3626705.3627790(185-197)Online publication date: 3-Dec-2023
  • (2023)Designing Interactive Shoes for Tactile Augmented RealityProceedings of the Augmented Humans International Conference 202310.1145/3582700.3582728(1-14)Online publication date: 12-Mar-2023
  • (2023)Engaging Passers-by with Rhythm: Applying Feedforward Learning to a Xylophonic Media Architecture FacadeProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580761(1-21)Online publication date: 19-Apr-2023
  • Show More Cited By

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media