Skip to main content
SpringerLink
Log in

Influence of multisensory feedback on haptic accessibility tasks

  • Original Article
  • Published:
Virtual Reality Aims and scope Submit manuscript

Abstract

Environments of a certain nature, such as those related to maintenance tasks can benefited from haptic stimuli by performing accessibility simulation in a realistic manner. Accessibility is defined as the physical feasibility of accessing an element of a 3D model avoiding undesirable collisions. This paper studies the benefits that multisensory systems can provide in performing this kind of tasks. The research is specially focused on the improvements provided by auditory feedback to the user’s performance. We have carried out a user study where participants had to perform an accessibility task with the aid of different combinations of sensorial stimuli. A large haptic interface for aeronautic maintainability has been extended with real-time sound generation capabilities to study this issue. The results of these experiments show that auditory stimuli provide with useful cues to the users helping them to correct trajectories and hence improving their performance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  • Adachi Y, Kumano T, Ogino K (1995) Intermediate representation for stiff virtual objects. In: Proceedings of the IEEE virtual reality annual international symposium, pp 203–210

  • Adelstein BD, Begault DR, Anderson MR, Wenzel EM (2003) Sensitivity to haptic-audio asynchrony. In: Proceedings of the 5th international conference on multimodal interfaces, Vancouver, Canada, pp 73–76 DOI 10.1145/958432.958448

  • Boff KR, Lincoln JE (1988) Engineering data compendium: human perception and performance. Wright-Patterson Air Force Base, Harry G. Armstrong Aerospace Medical Research Laboratory, Ohio

  • Borro D, Savall J, Amundarain A, Gil JJ, García-Alonso A, Matey L (2004a) A large haptic device for aircraft engine maintainability. IEEE Comput Graph Appl 24(6):70–74 DOI 10.1109/MCG.2004.45

    Google Scholar 

  • Borro D, García-Alonso A, Matey L (2004b) Approximation of optimal voxel size for collision detection in maintainability simulations within massive virtual environments. Comput Graph Forum 23(1):13–23 DOI 10.1111/j.1467-8659.2004.00002.x

    Google Scholar 

  • Colgate JE, Schenkel G (1994) Passivity of a class of sampled-data systems: application to haptic interfaces. In: Proceedings of the American control conference, Baltimore, MD, pp 3236–3240

  • DiFilippo D (2000) The AHI: an audio and haptic interface for simulating contact interactions. Master’s thesis, University of British Columbia

  • DiFilippo D, Pai DK (2000) The AHI: an audio and haptic interface for contact interactions. In: Proceedings of the 13th annual ACM symposium on user interface software and technology, San Diego, California, USA, pp 149–158 DOI 10.1145/354401.354437

  • DiFranco DE, Beauregard GL, Srinivasan MA (1997) The effect of auditory cues on the haptic perception of stiffness in virtual environments. In: Proceedings of the 1997 ASME international mechanical engineering congress and exposition, Dallas, TX, USA, pp 17–22

  • van den Doel K (1998) Sound synthesis for virtual reality and computer games. Ph. D. thesis, University of British Columbia

  • van den Doel K, Pai DK (1998) The sounds of physical shapes. Presence: Teleoperators Virtual Environ 7(4):382–395

    Article  Google Scholar 

  • van den Doel K, Pai DK (2001) JASS: a java audio synthesis system for programmers. In: Proceedings of the 2001 international conference on auditory display, Espoo, Finland, pp 150–154

  • van den Doel K, Kry PG, Pai DK (2001) FoleyAutomatic: Physically-based sound effects for interactive simulation and animation. In: Proceedings of the 28th annual conference on computer graphics and interactive techniques, Los Angeles, USA, pp 537–544 DOI 10.1145/383259.383322

  • García-Alonso A, Gil JJ, Borro D (2005) Interfaces for VR applications development in design. In: Proceedings of the virtual concept 2005, Biarritz, France, p 109

  • Gil JJ, Avello A, Rubio Á, Flórez J (2004) Stability analysis of a 1 DOF haptic interface using the Routh–Hurwitz criterion. IEEE Trans Control Syst Technol 12(4):583–588 DOI 10.1109/TCST.2004.825134

    Google Scholar 

  • Guest S, Catmur C, Lloyd D, Spence C (2002) Audiotactile interactions in roughness perception. Exp Brain Res 146:161–171 DOI 10.1007/s00221-002-1164–z

    Google Scholar 

  • Heller MA (1982) Visual and tactual texture perception: intersensory cooperation. Percept Psychophys 31(4):339–344

    PubMed  Google Scholar 

  • Hodges LF (1992) Tutorial: time-multiplexed stereoscopic computer graphics. IEEE Comput Graph Appl 12(2):20–30 DOI 10.1109/38.124285

    Google Scholar 

  • Hodges LF, Davis ET (1993) Geometric considerations for stereoscopic virtual environments. Presence: Teleoperators Virtual Environ 2(1):34–43

    Google Scholar 

  • Lederman SJ (1979) Auditory texture perception. Perception 8:93–103

    Article  PubMed  Google Scholar 

  • Levitin DJ, MacLean K, Mathews M, Chu LY, Jensen ER (2000) The perception of cross-modal simultaneity. In: Proceedings of International Journal of Computing Anticipatory Systems, vol 517 (1), pp 323–329 DOI 10.1063/1.1291270

  • Mansa I, Amundarain A, Hernantes J, García-Alonso A, Borro D (2006) Occlusion culling for dense geometric scenarios. Proceedings of the Laval Virtual 2006, Laval, France (in press)

  • Mc Gee MR, Gray PD, Brewster SA (2000) The effective combination of haptic and auditory textural information. In: Proceedings of the first international workshop on haptic human–computer interaction, Lecture Notes in Computer Science, Springer, 2058:118–126

  • Mc Gee MR, Gray PD, Brewster SA (2001) Feeling rough: multimodal perception of virtual roughness. In: Proceedings of the 1st Eurohaptics conference, Birmingham, UK, pp 29–33

  • O’Brien JF, Cook PR, Essl G (2001) Synthesizing sounds from physically based motion. In: Proceedings of the 28th annual conference on computer graphics and interactive techniques, Los Angeles, USA, pp 529–536 DOI 10.1145/383259.383321

  • Pai DK (2005) Multisensory interaction: real and virtual, In: P Dario P, Chatila R (eds) Robotics research: the eleventh international symposium, vol 15. Springer tracts in advanced robotics. Springer, Berlin Heidelberg New York, pp 489–500 DOI 10.1007/11008941_52

  • Poling GL, Weisenberger JM, Kerwin K (2003) The role of multisensory feedback in haptic surface perception. In: Proceedings of the 11th annual symposium on haptic interfaces for virtual environments and teleoperator systems, Los Angeles, CA, pp 187–194 DOI 10.1109/HAPTIC.2003.1191271

  • Richmond JL, Pai DK (2000) Active measurement of contact sounds. In: Proceedings of the 2000 IEEE international conference on robotics and automation, San Francisco, CA, USA, pp 2146–2152 DOI 10.1109/ROBOT.2000.846346

  • Salisbury JK, Brock DL, Massie TH, Swarup N, Zilles C (1995) Haptic rendering: programming touch interaction with virtual objects. In: Proceedings of the 1995 symposium on interactive 3D graphics, Monterey, CA, USA, pp 123–130 DOI 10.1145/199404.199426

  • Shannon CE (1949) Communication in the presence of noise. Proc Inst Radio Eng 37(1):10–21

    MathSciNet  Google Scholar 

  • Srinivasan MA, Beauregard GL, Brock DL (1996) The impact of visual information on the haptic perception of stiffness in virtual environments. In: Proceedings of the 1996 ASME international mechanical engineering congress and exposition, Atlanta, Georgia, USA, pp 555–559

  • Stein BE, Meredith MA (1993) The merging of the senses. MIT Press, Cambridge

  • Veron H, Southard DA, Leger JR, Conway JL (1990) Stereoscopic displays for terrain database visualization. Proc Stereosc Displays Appl 124–135

  • Wu W, Basdogan C, Srinivasan MA (1999) Visual, haptic, and bimodal perception of size and stiffness in virtual environments. ASME Dynam Syst Control Div 67:19–26

    Google Scholar 

  • Yano H, Iwata H (2001) Software architecture for audio and haptic rendering based on a physical model. In: Proceedings of the 8th IFIP TC13 conference on human–computer interaction, Tokyo, Japan, pp 19–26

  • Yeh YY, Silverstein LD (1990) Limits of fusion and depth judgment in stereoscopic color displays. Hum Factors 32(1):45–60

    PubMed  Google Scholar 

Download references

Acknowledgments

The research work presented in this paper is supported by the European Commission, under the FP6 IST-2002-002114 Enactive Network of Excellence (http://www.enactivenetwork.org/).

Author information

Authors and Affiliations

  1. CEIT, Paseo Manuel Lardizábal, 15, 20018, San Sebastián, Spain

    Iñaki Díaz, Josune Hernantes, Ignacio Mansa, Alberto Lozano, Diego Borro, Jorge Juan Gil & Emilio Sánchez

  2. TECNUN, University of Navarra, Paseo Manuel Lardizábal, 13, 20018, San Sebastián, Spain

    Iñaki Díaz, Josune Hernantes, Ignacio Mansa, Alberto Lozano, Diego Borro, Jorge Juan Gil & Emilio Sánchez

Authors
  1. Iñaki Díaz
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Josune Hernantes
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ignacio Mansa
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Alberto Lozano
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Diego Borro
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Jorge Juan Gil
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Emilio Sánchez
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jorge Juan Gil.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Díaz, I., Hernantes, J., Mansa, I. et al. Influence of multisensory feedback on haptic accessibility tasks. Virtual Reality 10, 31–40 (2006). https://doi.org/10.1007/s10055-006-0028-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10055-006-0028-4

Keywords

Search

Navigation