Abstract
In image-guided neurosurgery, “mixed reality” merging has been used to merge video images with an underlying computer model. We have developed methods to map intra-operative endoscopic video to 3D surfaces derived from pre-operative scans for enhanced visualization during surgery. We acquired CT images of a brain phantom, and digitized endoscopic video images from a tracked neuro-endoscope. Registration of the phantom and CT images was accomplished using markers that could be identified in both spaces. The endoscopic images were corrected for radial lens distortion, and mapped onto surfaces extracted from the CT images via a ray-traced texture-mapping algorithm. The localization accuracy of the endoscope tip was within 1.0 mm. The mapping operation allows the endoscopic images to be permanently painted onto the surfaces. Our method allows panoramic and stereoscopic visualization from arbitrary perspectives (though the original endoscopic video was monoscopic) and navigation of the painted surface after the procedure.
Chapter PDF
Similar content being viewed by others
References
Milgram, P., Kishino, F.: IEICE Transactions onlnformation Systems E77-D (1994)
Grimson, W.E.L., Lozano-Perez, T., Wells Ill, W.M., Ettinger, G.J., White, S.J., Kikinis, R.: IEEE Transactions on Medical Imaging (1996)
Konen, W., Scholz, M., Tombrock, S.: Computer Aided Surgery. 3, 144–148 (1998)
Jannin, P., Bouliou, A., Scarabin, J.M., Barillot, C., Luber, J.: SPIE Proceedings. vol. 3031, pp. 518–526 (1998)
Clarkson, M.J., Rueckert, D., King, A.P., Edwards, P.J., Hill, D.L.G., Hawkes, D.J.: Registration of video images to tomographic images by optimising mutual information using texture mapping. In: Taylor, C., Colchester, A. (eds.) MICCAI 1999. LNCS, vol. 1679, pp. 579–588. Springer, Heidelberg (1999)
Szeliski, R., Shum, H.Y.: Proceedings SIGGRAPH. pp. 251–258 (1997)
QuickTime. V.R., http://www.apple.com/quicktime/
Surround Video, http://www.bdiamond.com
Berci, G. (ed.): Endoscopy. Appleton-Century_Crofts, New York (1976)
Perneczky, A., Fries, G.: Neurosurgery 42, 219–224 (1998)
Perneczky, A., Fries, G.: Neurosurgery 42, 226–231 (1998)
Auer, L.M., Auer, D.P.: Neurosurgery 43, 529–548 (1998)
Jolesz, F.A., Lorensen, W.E., Shimoto, H., Atsumi, H., Nakajima, S., Kavanaugh, P., Saiviroonporn, P., Seltzer, S.E., Silverman, S.G., Philips, M., Kikinis, R.: AJR 169, 1229–1235 (1997)
Foley, J., van Dam, A., Feiner, S., Hughs, J.: Computer Graphics, 2nd edn. Addison Wesley, Reading (1990)
Stefansic, I., Herline, A.J., Chapman, W.C., Galloway, R.L.: SPIE Conference on Image Display Proceedings. vol. 3335, pp. 208–129 (1998)
Schroeder, W., Martin, K., Lorensen, B.: The Visualization Toolkit: An Object-Oriented Approach To 3D Graphics, 2nd edn. Prentice Hall, Englewood Cliffs (1997)
Tsai, R.Y.: IEEEJournal of Robotics and Automation. RA 3(4), 323–345 (1987)
Haneishi, H., Yagihashi, Y., Miyake, Y.: IEEE Transactions on Medical Imaging 14, 548–555 (1995)
Dey, D., Gobbi, D.G., Surry, K.J.M., Slomka, P.J., Peters, T.M.: SPIE Conference on Image Display Proceedings (2000) (in press)
Haeberli, P., Segal, M.: (1993), http://www.sgi.com/grafica/texmap/index.html
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2000 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Dey, D., Slomka, P.J., Gobbi, D.G., Peters, T.M. (2000). Mixed Reality Merging of Endoscopic Images and 3-D Surfaces. In: Delp, S.L., DiGoia, A.M., Jaramaz, B. (eds) Medical Image Computing and Computer-Assisted Intervention – MICCAI 2000. MICCAI 2000. Lecture Notes in Computer Science, vol 1935. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-40899-4_82
Download citation
DOI: https://doi.org/10.1007/978-3-540-40899-4_82
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-41189-5
Online ISBN: 978-3-540-40899-4
eBook Packages: Springer Book Archive