Abstract
A novel system for image guidance in totally endoscopic coronary artery bypass (TECAB) is presented. Key requirement is the availability of 2D-3D registration techniques that can deal with non-rigid motion and deformation. Image guidance for TECAB is mainly required before the mechanical stabilization of the heart, thus the most dominant source of non-rigid deformation is the motion of the beating heart.
To augment the images in the endoscope of the da Vinci robot, we have to find the transformation from the coordinate system of the preoperative imaging modality to the system of the endoscopic cameras.
In a first step we build a 4D motion model of the beating heart. Intraoperatively we can use the ECG or video processing to determine the phase of the cardiac cycle. We can then take the heart surface from the motion model and register it to the stereo-endoscopic images of the da Vinci robot using 2D-3D registration methods. We are investigating robust feature tracking and intensity-based methods for this purpose.
Images of the vessels available in the preoperative coordinate system can then be transformed to the camera system and projected into the calibrated endoscope view using two video mixers with chroma keying. It is hoped that the augmented view can improve the efficiency of TECAB surgery and reduce the conversion rate to more conventional procedures.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Kappert, U., Cichon, R., Schneider, J., Gulielmos, V., Ahmadzade, T., Nicolai, J., Tugtekin, S.M., Schueler, S.: Technique of closed chest coronary artery surgery on the beating heart. Eur. J. Cardio-Thorac. Surg. 20, 765–769 (2001)
Dogan, S., Aybek, T., Andressen, E., Byhahn, C., Mierdl, S., Westphal, K., Matheis, G., Moritz, A., Wimmer-Greinecker, G.: Totally endoscopic coronary artery bypass grafting on cardiopulmonary bypass with robotically enhanced telemanipulation: Report of forty-five cases. J. Thorac. Cardiovasc. Surg. 123, 1125–1131 (2002)
Falk, V., Diegeler, A., Walther, T., Banusch, J., Brucerius, J., Raumans, J., Autschbach, R., Mohr, F.W.: Total endoscopic computer enhanced coronary artery bypass grafting. Eur. J. Cardio-Thorac. Surg. 17, 38–45 (2000)
Wierzbicki, M., Peters, T.M.: Determining Epicardial Surface Motion Using Elastic Registration: Towards Vitual Reality Guidance of Minimal Invasive Cardiac Interventions. In: Ellis, R.E., Peters, T.M. (eds.) MICCAI 2003. LNCS, vol. 2878, pp. 722–729. Springer, Heidelberg (2003)
Szpala, S., Wierzbicki, M., Guiraudon, G., Peters, T.M.: Real-time fusion of endoscopic views with dynamic 3-d cardiac images: A phantom study. IEEE Trans. Med. Imaging 24, 1207–1215 (2005)
Perperidis, D., Mohiaddin, R., Edwards, P., Hill, R.D.: Segmentation of cardiac MR and CT image sequences using model-based registration of a 4D statistical model. In: Proc. SPIE Medical Imaging 2007, vol. 6512 (2007)
Chandrashekara, R., Mohiaddin, R., Razavi, R., Rueckert, R.: Nonrigid image registration with subdivision lattices: Application to cardiac mr image analysis. In: Taylor, C., Colchester, A. (eds.) MICCAI 1999. LNCS, vol. 1679, pp. 335–342. Springer, Heidelberg (1999)
Rueckert, D., Sonoda, L.I., Hayes, C., Hill, D.L.G., Leach, M.O., Hawkes, D.J.: Nonrigid registration using free-form deformations: Application to breast MR images. IEEE Trans. Med. Imaging 18(8), 712–721 (1999)
Stoyanov, D., Mylonas, G.P., Deligianni, F., Darzi, A., Yang, G.Z.: Soft-tissue motion tracking and structure estimation for robotic assisted mis procedures. In: Duncan, J.S., Gerig, G. (eds.) MICCAI 2005. LNCS, vol. 3749, pp. 139–146. Springer, Heidelberg (2005)
Blackall, J.M., Penney, G.P., King, A.P., Hawkes, D.J.: Alignment of sparse freehand 3-d ultrasound with preoperative images of the liver using models of respiratory motion and deformation. IEEE Trans. Med. Imaging 24, 1405–1416 (2005)
McLeish, K., Hill, D.L.G., Atkinson, D., Blackall, J.M., Razavi, R.: A study of the motion and deformation of the heart due to respiration. IEEE Trans. Med. Imaging 21, 1142–1150 (2002)
Clarkson, M.J., Rueckert, D., Hill, D.L.G., Hawkes, D.J.: A multiple 2D video-3D medical image registration algorithm. In: Proc. SPIE Medical Imaging 2000, vol. 3979, pp. 342–352 (2000)
Clarkson, M.J., Rueckert, D., Hill, D.L.G., Hawkes, D.J.: Using photo-consistency to register 2d optical images of the human face to a 3D surface model. IEEE Trans. Pattern Anal. Mach. Intell. 23, 1266–1280 (2001)
Bouguet, J.: Camera calibration toolbox for matlab (2007), http://www.vision.caltech.edu/bouguetj
Tsai, R.Y.: A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses. IEEE J. Robotics and Automation 3(4), 323–344 (1987)
Falk, V., Mourgues, F., Adhami, L., Jacobs, S., Thiele, H., Nitzsche, S., Mohr, F.W., Coste-Maniere, T.: Cardio navigation: Planning, simulation, and augmented reality in robotic assisted endoscopic bypass grafting. Ann. Thorac. Surg. 79, 2040–2048 (2005)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Figl, M. et al. (2008). Image Guidance for Robotic Minimally Invasive Coronary Artery Bypass. In: Dohi, T., Sakuma, I., Liao, H. (eds) Medical Imaging and Augmented Reality. MIAR 2008. Lecture Notes in Computer Science, vol 5128. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-79982-5_23
Download citation
DOI: https://doi.org/10.1007/978-3-540-79982-5_23
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-79981-8
Online ISBN: 978-3-540-79982-5
eBook Packages: Computer ScienceComputer Science (R0)