Abstract
We present the in-situ visualization of medical data taken from CT or MRI scans in real-time using a video see-through head mounted display (HMD). One of the challenges to improve acceptance of augmented reality (AR) for medical purpose is to overcome the misleading depth perception. This problem is caused by a restriction of such systems. Virtual entities of the AR scene can only be presented superimposed onto real imagery. Occlusion is the most effective depth cue [1] and let e.g. a correctly positioned visualization of the spinal column appear in front of the real skin. We present a technique to handle this problem and introduce a Virtual Window superimposed onto the real skin of the patient to create the feeling of getting a view on the inside of the patient. Due to motion of the observer the frame of the window covers and uncovers fragments of the visualized bones and tissue and enables the depth cues motion parallax and occlusion, which correct the perceptive misinformation. An earlier experiment has shown the perceptive advantage of the window. Therefore seven different visualization modes of the spinal column were evaluated regarding depth perception. This paper introduces the technical realization of the window.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Cutting JE, Vishton PM. Perceiving layout and knowing distances: The integration, relative potency, and contextual use of different information about depth. In: Epstein W, Rogers S, editors. Perception of Space and Motion; 1995. 69–117.
Birkfellner W, Figl M, Huber K, et al. A head-mounted operating binocular for augmented reality visualization in medicine: Design and initial evaluation. IEEE Trans Med Imaging 2002;21(8):991–997.
King AP, Edwards PJ, Maurer CR Jr, det al. Stereo augmented reality in the surgical microscope 2000;9(4):360–368.
Sauer F, Khamene A, Bascle B, Vogt S, Rubinob GJ. Augmented reality visualization in iMRI operating room: System description and pre-clinical testing. Procs SPIE 2002;4681:446–454.
Sauer F, Khamene A, Vogt S. An augmented reality navigation system with a single-camera tracker: System design and needle biopsy phantom trial. LNCS 2002;2489:116–124.
King AP, Edwards PJ, Maurer CR Jr, et al. Design and evaluation of a system for microscope-assisted guided interventions. IEEE Trans Med Imaging 2000;19(11):1082–1093.
Bajura M, Fuchs H, Ohbuchi R. Merging virtual objects with the real world: Seeing ultrasound imagery within the patient. In: Procs Computer Graphics and Interactive Techniques. ACM Press; 1992. 203–210.
Sielhorst T, Bichlmeier C, Heining SM, Navab N. Depth perception a major issue in medical AR: Evaluation study by twenty surgeons. In: Procs MICCAI; 2006.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Bichlmeier, C., Sielhorst, T., Heining, S.M., Navab, N. (2007). Improving Depth Perception in Medical AR. In: Horsch, A., Deserno, T.M., Handels, H., Meinzer, HP., Tolxdorff, T. (eds) Bildverarbeitung für die Medizin 2007. Informatik aktuell. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-71091-2_44
Download citation
DOI: https://doi.org/10.1007/978-3-540-71091-2_44
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-71090-5
Online ISBN: 978-3-540-71091-2
eBook Packages: Computer Science and Engineering (German Language)