skip to main content
10.1145/2986416.2986429acmotherconferencesArticle/Chapter ViewAbstractPublication PagesamConference Proceedingsconference-collections
research-article

An investigation of the effect of immersive visual and auditory feedback on rhythmic walking interaction

Published: 04 October 2016 Publication History

Abstract

We present a study whose goal is to investigate the role of immersive visual and auditory feedback to affect preferred walking pace and perceived ease and naturalness of walking actions. Additionally, we measured how the congruence between visual and auditory stimuli affects perceived ease of walking. The visual feedback was presented through a head mounted display and auditory feedback was delivered based on the detected footsteps of participants. Subjects were asked to walk in place on top of an aerobic stepper at the pace they preferred. Their tempo was detected while walking. After each trial the participants answered a series of questions. Results of the experiment show that different footstep sounds affect walking pace, visual feedback, however, did not influence the chosen walking pace. The questionnaire data indicate that perceived congruency between visuals and footstep sounds correlate with the rating of the ease of walking (the more congruent variables, the easier to walk for participants).

References

[1]
T. Banton, J. Stefanucci, F. Durgin, A. Fass, and D. Proffitt. The perception of walking speed in a virtual environment. Presence: Teleoperators and Virtual Environments, 14(4):394--406, 2005.
[2]
R. P. Darken, W. R. Cockayne, and D. Carmein. The omni-directional treadmill: a locomotion device for virtual worlds. In Proceedings of the 10th annual ACM symposium on User interface software and technology, pages 213--221. ACM, 1997.
[3]
F. H. Durgin, L. F. Fox, E. Schaffer, and R. Whitaker. The perception of linear self-motion. In Electronic Imaging 2005, pages 503--514. International Society for Optics and Photonics, 2005.
[4]
J. Feasel, M. Whitton, and J. Wendt. Llcm-wip: Low-latency, continuous-motion walking-in-place. In 3D User Interfaces, 2008. 3DUI 2008. IEEE Symposium on, pages 97--104. IEEE, 2008.
[5]
F. Fontana and Y. Visell. Walking with the Senses: Perceptual Techniques for Walking in Simulated Environments. Logos-Verlag, 2012.
[6]
M. Franěk. Environmental factors influencing pedestrian walking speed 1. Perceptual & Motor Skills, 116(3):992--1019, 2013.
[7]
M. Franěk, L. van Noorden, and L. Režny. Tempo and walking speed with music in the urban context. Frontiers in psychology, 5, 2014.
[8]
E. Goldstein. Sensation and perception. Wadsworth Publishing Company, 2010.
[9]
T. Hermann and A. Hunt. Guest editors' introduction: An introduction to interactive sonification. IEEE multimedia, (2):20--24, 2005.
[10]
J. Konczak. effects of optic flow on the kinematics of human gait: a comparison of young and older adults. Journal of motor behavior, 26(3):225--236, 1994.
[11]
J. Maculewicz, C. Erkut, and S. Serafin. An investigation on the influence of soundscapes and footstep sounds in affecting preferred walking pace. In Proceedings of the 21st International Conference on Auditory Display (ICAD 2015), 2015.
[12]
J. Maculewicz, C. Erkut, and S. Serafin. An investigation on the impact of auditory and haptic feedback on rhythmic walking interactions. International Journal of Human-Computer Studies, 85:40--46, 2016.
[13]
J. Maculewicz, A. Jylha, S. Serafin, and C. Erkut. The effects of ecological auditory feedback on rhythmic walking interaction. MultiMedia, IEEE, 22(1):24--31, 2015.
[14]
E. Medina, R. Fruland, and S. Weghorst. Virtusphere: Walking in a human size vr "Jhamster ball" I. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, volume 52, pages 2102--2106. SAGE Publications, 2008.
[15]
B. J. Mohler, W. B. Thompson, S. H. Creem-Regehr, H. L. Pick Jr, and W. H. Warren Jr. Visual flow influences gait transition speed and preferred walking speed. Experimental Brain Research, 181(2):221--228, 2007.
[16]
N. C. Nilsson, S. Serafin, M. H. Laursen, K. S. Pedersen, E. Sikstrom, and R. Nordahl. Tapping-in-place: Increasing the naturalness of immersive walking-in-place locomotion through novel gestural input. In 3D User Interfaces (3DUI), 2013 IEEE Symposium on, pages 31--38. IEEE, 2013.
[17]
N. C. Nilsson, S. Serafin, and R. Nordahl. A comparison of different methods for reducing the unintended positional drift accompanying walking-in-place locomotion. In 3D User Interfaces (3DUI), 2014 IEEE Symposium on, pages 103--110. IEEE, 2014.
[18]
N. C. Nilsson, S. Serafin, and R. Nordahl. Establishing the range of perceptually natural visual walking speeds for virtual walking-in-place locomotion. Visualization and Computer Graphics, IEEE Transactions on, 20(4):569--578, 2014.
[19]
R. Nordahl, L. Turchet, and S. Serafin. Sound synthesis and evaluation of interactive footsteps and environmental sounds rendering for virtual reality applications. IEEE Trans. Visualization and Computer Graphics, 17(9):1234--1244, September 2011.
[20]
J. Pailhous, A.-M. Ferrandez, M. Flückiger, and B. Baumberger. Unintentional modulations of human gait by optical flow. Behavioural brain research, 38(3):275--281, 1990.
[21]
W. Powell, B. Stevens, S. Hand, and M. Simmonds. Blurring the boundaries: The perception of visual gain in treadmill-mediated virtual environments. In 3rd IEEE VR 2011 Workshop on Perceptual Illusions in Virtual Environments, 2011.
[22]
T. Prokop, M. Schubert, and W. Berger. Visual influence on human locomotion modulation to changes in optic flow. Experimental Brain Research, 114(1):63--70, 1997.
[23]
S. Razzaque, Z. Kohn, and M. C. Whitton. Redirected walking. In Proceedings of EUROGRAPHICS, volume 9, pages 105--106. Citeseer, 2001.
[24]
M. Slater, A. Steed, and M. Usoh. The virtual treadmill: A naturalistic metaphor for navigation in immersive virtual environments. In M. Goebel, editor, First Eurographics Workshop on Virtual Reality, pages 71--86, 1993.
[25]
F. Steinicke, G. Bruder, J. Jerald, H. Frenz, and M. Lappe. Estimation of detection thresholds for redirected walking techniques. Visualization and Computer Graphics, IEEE Transactions on, 16(1):17--27, 2010.
[26]
F. Steinicke, Y. Visell, J. Campos, and A. Lécuyer. Human walking in virtual environments. Springer, 2013.
[27]
E. A. Suma, G. Bruder, F. Steinicke, D. M. Krum, and M. Bolas. A taxonomy for deploying redirection techniques in immersive virtual environments. In Virtual Reality Short Papers and Posters (VRW), 2012 IEEE, pages 43--46. IEEE, 2012.
[28]
W. H. Warren, B. A. Kay, and E. H. Yilmaz. Visual control of posture during walking: functional specificity. Journal of Experimental Psychology: Human Perception and Performance, 22(4):818, 1996.
[29]
J. Wendt, M. Whitton, and F. Brooks. Gud wip: Gait-understanding-driven walking-in-place. In Virtual Reality Conference (VR), 2010 IEEE, pages 51--58. IEEE, 2010.
[30]
V. Zatsiorky, S. Werner, and M. Kaimin. Basic kinematics of walking: step length and step frequency: a review. Journal of sports medicine and physical fitness, 34(2):109--134, 1994.

Cited By

View all
  • (2024)Open Your Ears and Take a Look: A State‐of‐the‐Art Report on the Integration of Sonification and VisualizationComputer Graphics Forum10.1111/cgf.1511443:3Online publication date: 10-Jun-2024
  • (2023)Rhythm Research in Interactive System Design: A Literature ReviewInternational Journal of Human–Computer Interaction10.1080/10447318.2023.2294628(1-20)Online publication date: 27-Dec-2023
  • (2019)Crossmodal perception in virtual realityMultimedia Tools and Applications10.1007/s11042-019-7331-zOnline publication date: 26-Feb-2019
  1. An investigation of the effect of immersive visual and auditory feedback on rhythmic walking interaction

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    AM '16: Proceedings of the Audio Mostly 2016
    October 2016
    285 pages
    ISBN:9781450348225
    DOI:10.1145/2986416
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 04 October 2016

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. auditory feedback
    2. immersive visual feedback
    3. rhythmic interaction

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    AM '16
    AM '16: Audio Mostly 2016
    October 4 - 6, 2016
    Norrköping, Sweden

    Acceptance Rates

    AM '16 Paper Acceptance Rate 40 of 53 submissions, 75%;
    Overall Acceptance Rate 177 of 275 submissions, 64%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)11
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 24 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Open Your Ears and Take a Look: A State‐of‐the‐Art Report on the Integration of Sonification and VisualizationComputer Graphics Forum10.1111/cgf.1511443:3Online publication date: 10-Jun-2024
    • (2023)Rhythm Research in Interactive System Design: A Literature ReviewInternational Journal of Human–Computer Interaction10.1080/10447318.2023.2294628(1-20)Online publication date: 27-Dec-2023
    • (2019)Crossmodal perception in virtual realityMultimedia Tools and Applications10.1007/s11042-019-7331-zOnline publication date: 26-Feb-2019

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media