Abstract
Accurate 3D reconstruction of the surgical scene is important in intra-operative guidance. Existing methods are often based on the assumption that the camera is static or the tissue is deforming with periodic motion. In minimally invasive surgery, these assumptions do not always hold due to free-form tissue deformation induced by instrument-tissue interaction and camera motion required for continuous exploration of the surgical scene, particularly for intraluminal procedures. The aim of this work is to propose a novel framework for intra-operative free-form deformation recovery. The proposed method builds on a compact scene representation scheme that is suitable for both surgical episode identification and instrument-tissue motion modeling. Unlike previous approaches, it does not impose explicit models on tissue deformation, allowing realistic free-form deformation recovery. Validation is provided on both synthetic and phantom data. The practical value of the method is further demonstrated by deformation recovery on in vivo data recorded from a robotic assisted minimally invasive surgical procedure.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Lau, W.W., Ramey, N.A., Corso, J.J., Thakor, N.V., Hager, G.D.: Stereo-Based Endoscopic Tracking of Cardiac Surface Deformation. In: Barillot, C., Haynor, D.R., Hellier, P. (eds.) MICCAI 2004. LNCS, vol. 3217, pp. 494–501. Springer, Heidelberg (2004)
Hager, G., Vagvolgyi, B., Yuh, D.: Stereoscopic video overlay with deformable registration. Medicine Meets Virtual Reality (2007)
Garcya, O., Civera, J., Gueme, A., Munoz, V., Montiel, J.: Real-time 3d modeling from endoscope image sequences. In: Workshop on Advanced Sensing and Sensor Integration in Medical Robotics, IEEE International Conference on Robotics and Automation (2009)
Mirota, D., Wang, H., Taylor, R.H., Ishii, M., Hager, G.D.: Toward Video-Based Navigation for Endoscopic Endonasal Skull Base Surgery. In: Yang, G.-Z., Hawkes, D., Rueckert, D., Noble, A., Taylor, C. (eds.) MICCAI 2009, Part I. LNCS, vol. 5761, pp. 91–99. Springer, Heidelberg (2009)
Wu, C., Sun, Y., Chang, C.: Three-dimensional modeling from endoscopic video using geometric constraints via feature positioning. IEEE Transactions on Biomedical Engineering 54(7), 1199–1211 (2007)
Hu, M., Penney, G.P., Rueckert, D., Edwards, P.J., Bello, F., Casula, R., Figl, M., Hawkes, D.J.: Non-rigid Reconstruction of the Beating Heart Surface for Minimally Invasive Cardiac Surgery. In: Yang, G.-Z., Hawkes, D., Rueckert, D., Noble, A., Taylor, C. (eds.) MICCAI 2009, Part I. LNCS, vol. 5761, pp. 34–42. Springer, Heidelberg (2009)
Richa, R., Bó, A.P.L., Poignet, P.: Robust 3D Visual Tracking for Robotic-Assisted Cardiac Interventions. In: Jiang, T., Navab, N., Pluim, J.P.W., Viergever, M.A. (eds.) MICCAI 2010, Part I. LNCS, vol. 6361, pp. 267–274. Springer, Heidelberg (2010)
Stoyanov, D., Visentini-Scarzanella, M., Pratt, P., Yang, G.Z.: Real-Time Stereo Reconstruction in Robotically Assisted Minimally Invasive Surgery. In: Jiang, T., et al. (eds.) MICCAI 2010, Part I. LNCS, vol. 6361, pp. 275–282. Springer, Heidelberg (2010)
Mountney, P., Yang, G.-Z.: Motion Compensated SLAM for Image Guided Surgery. In: Jiang, T., Navab, N., Pluim, J.P.W., Viergever, M.A. (eds.) MICCAI 2010, Part II. LNCS, vol. 6362, pp. 496–504. Springer, Heidelberg (2010)
Giannarou, S., Yang, G.Z.: Content-based surgical workflow representation using probabilistic motion modeling. In: International Workshop on Medical Imaging and Augmented Reality, pp. 314–323 (2010)
Giannarou, S., Visentini-Scarzanella, M., Yang, G.Z.: Affine-invariant anisotropic detector for soft tissue tracking in minimally invasive surgery. In: IEEE International Symposium on Biomedical Imaging, pp. 1059–1062 (2009)
Nistér, D.: An efficient solution to the five-point relative pose problem. IEEE Trans. Pattern Anal. Machine Intell. 26(6), 756–770 (2004)
Mosteller, E., Turkey, J.: Data and analysis and regression. Addison Wesley (1977)
Sanchez-Riera, J., Ostlund, J., Fua, P., Moreno-Noguer, F.: Simultaneous pose, correspondence, and non-rigid shape. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1189–1196 (2010)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Giannarou, S., Yang, GZ. (2012). Tissue Deformation Recovery with Gaussian Mixture Model Based Structure from Motion. In: Linte, C.A., Moore, J.T., Chen, E.C.S., Holmes, D.R. (eds) Augmented Environments for Computer-Assisted Interventions. AE-CAI 2011. Lecture Notes in Computer Science, vol 7264. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-32630-1_5
Download citation
DOI: https://doi.org/10.1007/978-3-642-32630-1_5
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-32629-5
Online ISBN: 978-3-642-32630-1
eBook Packages: Computer ScienceComputer Science (R0)