skip to main content
10.1145/1452392.1452437acmconferencesArticle/Chapter ViewAbstractPublication Pagesicmi-mlmiConference Proceedingsconference-collections
research-article

An audio-haptic interface based on auditory depth cues

Published: 20 October 2008 Publication History

Abstract

Spatialization of sound sources in depth allows a hierarchical display of multiple audio streams and therefore may be an efficient tool for developing novel auditory interfaces. In this paper we present an audio-haptic interface for audio browsing based on rendering distance cues for ordering sound sources in depth. The haptic interface includes a linear position tactile sensor made by conductive material. The touch position on the ribbon is mapped onto the listening position on a rectangular virtual membrane, modeled by a bidimensional Digital Waveguide Mesh and providing distance cues of four equally spaced sound sources. Furthermore a knob of a MIDI controller controls the position of the mesh along the playlist, which allows to browse the whole set of files. Subjects involved in a user study found the interface intuitive and entertaining. In particular the interaction with the stripe was highly appreciated.

References

[1]
S. Brewster, J. Lumsden, M. Bell, M. Hall, and S. Tasker. Multimodal 'eyes-free' interaction techniques for wearable devices. In Proc. of the SIGCHI conference on Human factors in computing systems, pages 473--480, 2003.
[2]
M. Fernström and E. Brazil. Sonic browsing: An auditory tool for multimedia asset management. In Proc. of the 2001 International Conference on Auditory Display, pages 132--135, 2001.
[3]
M. Fernström and C. McNamara. After direct manipulation-direct sonification. ACM transactions on Applied Perception, 2(4):495--499, 2005.
[4]
F. Fontana. Physics-based models for the acoustic representation of space in virtual environments. PhD thesis, University of Verona, Italy, 2003.
[5]
F. Fontana and D. Rocchesso. A physics-based approach to the presentation of acoustic depth. In Proc. of the 2003 International Conference on Auditory Display, pages 79--82, July 2003.
[6]
A. Jensenius, R. Koehly, and M. Wanderley. Building low-cost music controllers. LNCS, 3902:123--129, 2006.
[7]
L. Ludwig. Extending the notion of a window system to audio. Computer, pages 66--72, 1990.
[8]
D. McGookin and S. Brewster. Understanding concurrent earcons: Applying auditory scene analysis principles to concurrent earcon recognition. ACM transactions on Applied Perception, 1(2):130--155, 2004.
[9]
H. Møller, M. Sørensen, D. Hammershøi, and C. Jensen. Head-related transfer functions of human subjects. J. Audio Eng. Soc., 43:300--321, 1995.
[10]
S. Nielsen. Distance Perception in Hearing. PhD thesis, Aalborg University, Denmark, 1991.
[11]
I. Pitt and A. Edwards. Pointing in an auditory interface for blind users. In Proc. of the 1995 IEEE International Conference on Systems, Man and Cybernetics, pages 280--285, 1995.
[12]
A. Savidis, C. Stephanidis, A. Korte, and K. Crispien. A generic direct-manipulation 3D-auditory environment for hierarchical navigation in non-visual interaction. In Proc. of the Second annual ACM conference on Assistive technologies, pages 117--123, 1996.
[13]
C. Schmandt. Audio hallway: A virtual acoustic environment for browsing. In Proc. of the 11th annual ACM symposium on User interface software and technology, pages 163--170, April 1998.
[14]
B. Shinn-Cunningham. Learning reverberation: Considerations for spatial auditory displays. In Proc. of the 2000 International Conference on Auditory Displays, 2000.
[15]
T. Strybel and D. Perrott. Discrimination of relative distance in the auditory modality: The success and failure of the loudness discrimination hypothesis. J. Acoust. Soc. Am., 76(1):318--320, July 1984.
[16]
A. Walker, S. Brewster, and S. McGookin. Diary in the sky: A spatial audio display for a mobile calendar. In Proc. of Interaction Homme-Machine - Human Computer Interaction (IHM-HCI), September 2001.
[17]
F. Winberg and S. Hellstrøm. Designing accessible auditory drag and drop. In Proc. of the 2003 conference on Universal usability, pages 152--153, 2003.
[18]
P. Zahorik. Auditory display of sound source distance. In Proc. of the 2002 International Conference on Auditory Display, July 2002.
[19]
P. Zahorik. Direct-to-reverberant energy ratio sensitivity. J. Acoust. Soc. Am., 112(5):2110--2117, November 2002.

Index Terms

  1. An audio-haptic interface based on auditory depth cues

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    ICMI '08: Proceedings of the 10th international conference on Multimodal interfaces
    October 2008
    322 pages
    ISBN:9781605581989
    DOI:10.1145/1452392
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 20 October 2008

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. audio-haptic interface
    2. auditory navigation
    3. digital waveguide mesh
    4. distance perception
    5. spatialization

    Qualifiers

    • Research-article

    Conference

    ICMI '08
    Sponsor:
    ICMI '08: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERFACES
    October 20 - 22, 2008
    Crete, Chania, Greece

    Acceptance Rates

    Overall Acceptance Rate 453 of 1,080 submissions, 42%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 344
      Total Downloads
    • Downloads (Last 12 months)4
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 15 Feb 2025

    Other Metrics

    Citations

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media