Multimodal augmented reality system for surgical microscopy

Jaime Garcia Giraldez; Haydar Talib; Marco Caversaccio; Miguel A. Gonzalez Ballester

doi:10.1117/12.651267

13 March 2006 Multimodal augmented reality system for surgical microscopy

Jaime Garcia Giraldez, Haydar Talib, Marco Caversaccio, Miguel A. Gonzalez Ballester

Proceedings Volume 6141, Medical Imaging 2006: Visualization, Image-Guided Procedures, and Display; 61411S (2006) https://doi.org/10.1117/12.651267
Event: Medical Imaging, 2006, San Diego, California, United States

Abstract

Image-guided, computer-assisted neurosurgery has emerged to improve localization and targeting, to provide a better anatomic definition of the surgical field, and to decrease invasiveness. Usually, in image-guided surgery, a computer displays the surgical field in a CT/MR environment, using axial, coronal or sagittal views, or even a 3D representation of the patient. Such a system forces the surgeon to look away from the surgical scene to the computer screen. Moreover, this kind of information, being pre-operative imaging, can not be modified during the operation, so it remains valid for guidance in the first stage of the surgical procedure, and mainly for rigid structures like bones. In order to solve the two constraints mentioned before, we are developing an ultrasoundguided surgical microscope. Such a system takes the advantage that surgical microscopy and ultrasound systems are already used in neurosurgery, so it does not add more complexity to the surgical procedure. We have integrated an optical tracking device in the microscope and an augmented reality overlay system with which we avoid the need to look away from the scene, providing correctly aligned surgical images with sub-millimeter accuracy. In addition to the standard CT and 3D views, we are able to track an ultrasound probe, and using a previous calibration and registration of the imaging, the image obtained is correctly projected to the overlay system, so the surgeon can always localize the target and verify the effects of the intervention. Several tests of the system have been already performed to evaluate the accuracy, and clinical experiments are currently in progress in order to validate the clinical usefulness of the system.

Citation Download Citation

Jaime Garcia Giraldez, Haydar Talib, Marco Caversaccio, and Miguel A. Gonzalez Ballester "Multimodal augmented reality system for surgical microscopy", Proc. SPIE 6141, Medical Imaging 2006: Visualization, Image-Guided Procedures, and Display, 61411S (13 March 2006); https://doi.org/10.1117/12.651267

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available