Abstract
Inherent to the field of computer-aided surgery (CAS) is the necessity to handle sophisticated equipment in the operating room; an undesired side-effect of this development is the fact that the surgeon’s attention is drawn from the operating field since surgical progress is partially monitored on the computer’s screen. The overlay of computer-generated graphics over a real-world scene, also referred to as augmented reality (AR), provides a possibility to solve this problem. The considerable technical problems associated with this approach such as viewing of the scenery within a common focal range on the head-mounted display (HMD) or latency in display on the HMD have, however, kept AR from widespread usage in CAS. In this paper, the concept of the Varioscope AR, a lightweight head-mounted operating microscope used as a HMD, is introduced. The registration of the patient to the preoperative image data as well as preoperative planning take place on VISIT, a surgical navigation system developed at our hospital. Tracking of the HMD and stereoscopic visualisation take place on a separate POSIX.4 compliant realtime operating system running on PC hardware. While being in a very early stage of laboratory testing, we were able to overcome the technical problems described above; our work resulted in an AR visualisation system with an update rate of 6 Hz and a latency below 130 ms. First tests with 2D/3D registration have shown a match between 3D world coordinates and 2D HMD display coordinates in the range of 1.7 pixels. It integrates seamlessly into a surgical navigation system and provides a common focus for both virtual and real world objects. On the basis of our current results, we conclude that the Varioscope AR with the realtime visualisation unit is a major step towards the introduction of AR into clinical routine.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Azuma, R.: Predictive Tracking for Augmented Reality. PhD thesis, UNC at Chapel Hill (1995)
Bangay, S., Preston, L.: An investigation into factors influencing immersion in interactive virtual reality environments. Stud Health Technol Inform 58, 43–51 (1998)
Birkfellner, W., Solar, P., Gahleitner, A., et al.: Computer-Aided Implant Dentistry -An Early Report. In: Taylor, C., Colchester, A. (eds.) MICCAI 1999. LNCS, vol. 1679, pp. 883–891. Springer, Heidelberg (1999)
Birkfellner, W., Wanschitz, F., Watzinger, F., Huber, K., Figl, M., Schopper, C., Hanel, R., Kainberger, F., Kettenbach, J., Patruta, S., Ewers, R., Bergmann, H.: Accuracy of a navigation system for computer-aided oral implantology. In: Delp, S.L., DiGoia, A.M., Jaramaz, B. (eds.) submitted to MICCAI 2000. LNCS, vol. 1935, pp. 1061–1067. Springer, Heidelberg (2000)
Birkfellner, W., Solar, P., Gahleitner, A., et al.: In-vitro assessment of a registration protocol for image guided implant dentistry. Clin Oral Impl Res (in press)
Birkfellner, W., Huber, K., Larson, A., et al.: A modular software system for computer-aided surgery and it’s first application in oral implantology. IEEE Trans. Med. Imaging (in press)
Blackwell, M., Morgan, F., DiGioia III, A.M.: Augmented reality and its future in orthopaedics. Clin. Orthop. 354, 111–122 (1998)
Brinker, T., Arango, G., Kaminsky, J., et al.: An experimental approach to image guided skull base surgery employing a microscope-based neuronavigation system. Acta Neurochir (Wien) 140(9), 883–889 (1998)
Calvano, C.J., Moran, M.E., Tackett, L.P., Reddy, P.P., Boyle, K.E., Pankratov, M.M.: New visualization techniques for in-utero surgery: amnioscopy with a three-dimensional head-mounted display and a computer-controlled endoscope. J. Endourol. 12(5), 407–410 (1998)
Edwards, P.J., King, A.P., Hawkes, D.J., et al.: Stereo augmented reality in the surgical microscope. Stud. Health Technol. Inform. 62, 102–108 (1999)
Edwards, P.J., Hawkes, D.J., Hill, D.L., et al.: Augmentation of reality using an operating microscope for otolaryngology and neurosurgical guidance. J. Image Guid Surg. 1(3), 172–178 (1995)
Fuchs, H., Livingston, M.A., Raskar, R., et al.: Augmented reality visualization for laparoscopic surgery. In: Wells, W.M., Colchester, A.C.F., Delp, S.L. (eds.) MICCAI 1998. LNCS, vol. 1496, p. 934. Springer, Heidelberg (1998)
Haase, J.: Image-guided neurosurgery/ neuronavigation/the SurgiScope–reflexions on a theme. Minim. Invasive Neurosurg. 42(2), 53–59 (1999)
Kalman, R.E.: A New Approach to Linear Filtering and Prediction Problems. Transactions of the ASME -Journal of Basic Engineering, 35–45 (1960)
Kilgard, M.J.: OpenGL Programming for the X Window System. Addison Wesley, Reading (1996)
Roberts, D.W., Strohbehn, J.W., Hatch, J.F., et al.: A frameless stereotaxic integration of computerized tomographic imaging and the operating microscope. J. Neurosurg. 65(4), 545–549 (1986)
Tsai, R.: A verstaile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses. IEEE Trans. Robotics Autom., RA 3(4), 323–344 (1987)
Wagner, A., Rasse, M., Millesi, W., et al.: Virtual reality for orthognathic surgery: the augmented reality environment concept. J. Oral Maxillofac Surg. 55(5), 456–462 (1997)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2000 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Birkfellner, W. et al. (2000). The Varioscope AR – A Head-Mounted Operating Microscope for Augmented Reality. In: Delp, S.L., DiGoia, A.M., Jaramaz, B. (eds) Medical Image Computing and Computer-Assisted Intervention – MICCAI 2000. MICCAI 2000. Lecture Notes in Computer Science, vol 1935. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-40899-4_90
Download citation
DOI: https://doi.org/10.1007/978-3-540-40899-4_90
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-41189-5
Online ISBN: 978-3-540-40899-4
eBook Packages: Springer Book Archive