Abstract
We present a way to register the uterus in monocular laparoscopy in realtime using a novel two-phase approach. This differs significantly to SLAM, which is currently the leading approach for registration in MIS when scenes are approximately rigid. In the first phase we construct a 3D model of the uterus using dense SfM. This involves a method for semi-automatically masking the uterus from background structures in a set of reference frames, which we call Mask Bootstrapping from Motion (MBM). In the second phase the 3D model is registered to the live laparoscopic video using a novel wide-baseline approach that uses many texture maps to capture the real changes in appearance of the uterus. Capturing these changes means that registration can be performed reliably without needing temporal priors, which are needed in SLAM. This simplifies registration and leads to far fewer tuning parameters. We show that our approach significantly outperforms SLAM on an in vivo dataset comprising three human uteri.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Agisoft: Photoscan, http://www.agisoft.ru/products/photoscan
Bay, H., Ess, A., Tuytelaars, T., Van Gool, L.: Speeded-up robust features (SURF). Comput. Vis. Image Underst. 110(3) (June 2008)
Collins, T., Bartoli, A.: Towards live monocular 3D laparoscopy using shading and specularity information. In: Abolmaesumi, P., Joskowicz, L., Navab, N., Jannin, P. (eds.) IPCAI 2012. LNCS, vol. 7330, pp. 11–21. Springer, Heidelberg (2012)
Davison, A.J., Reid, I.D., Molton, N.D., Stasse, O.: MonoSLAM: Real-time single camera SLAM. PAMI 29(6), 1052–1067 (2007)
Fischler, M.A., Bolles, R.C.: Random sample consensus. Commun. ACM (1981)
Grasa, O.G., Civera, J., Guemes, A., Muñoz, V., Montiel, J.M.M.: EKF monocular SLAM 3D modeling, measuring and augmented reality from endoscope image sequences. In: AEMI-ARCAI (2009)
Grasa, O.G., Civera, J., Montiel, J.M.M.: EKF monocular SLAM with relocalization for laparoscopic sequences. In: ICRA (2011)
Hartley, R.I., Zisserman, A.: Multiple View Geometry in Computer Vision. Cambridge University Press (2004) ISBN: 0521540518
Klein, G., Murray, D.: Parallel tracking and mapping for small AR workspaces. In: ISMAR, Nara, Japan (November 2007)
Lepetit, V., Moreno-Noguer, F., Fua, P.: EPnP: An accurate O(n) solution to the PnP problem. IJCV (2009)
Lowe, D.G.: Distinctive image features from scale-invariant keypoints. IJCV (2004)
Malti, A., Bartoli, A., Collins, T.: Template-based conformal shape-from-motion-and-shading for laparoscopy. In: Abolmaesumi, P., Joskowicz, L., Navab, N., Jannin, P. (eds.) IPCAI 2012. LNCS, vol. 7330, pp. 1–10. Springer, Heidelberg (2012)
Mountney, P., Stoyanov, D., Davison, A.J., Yang, G.Z.: Simultaneous stereoscope localization and soft-tissue mapping for minimal invasive surgery. In: Larsen, R., Nielsen, M., Sporring, J. (eds.) MICCAI 2006. LNCS, vol. 4190, pp. 347–354. Springer, Heidelberg (2006)
Nakamoto, M., Nakada, K., Sato, Y., Konishi, K., Hashizume, M., Tamura, S.: Intraoperative magnetic tracker calibration using a magneto-optic hybrid tracker for 3-d ultrasound-based navigation in laparoscopic surgery. TMI (2008)
Rosten, E., Drummond, T.: Machine learning for high-speed corner detection. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006, Part I. LNCS, vol. 3951, pp. 430–443. Springer, Heidelberg (2006)
Simpfendörfer, T., Baumhauer, M., Müller, M., Gutt, C., Meinzer, H., Rassweiler, J., Guven, S., Teber, D.: Augmented reality visualization during laparoscopic radical prostatectomy. Endourology (2011)
Strecha, C., von Hansen, W., Gool, L.J.V., Fua, P., Thoennessen, U.: On benchmarking camera calibration and multi-view stereo for high resolution imagery. In: CVPR (2008)
Totz, J., Mountney, P., Stoyanov, D., Yang, G.-Z.: Dense surface reconstruction for enhanced navigation in MIS. In: Fichtinger, G., Martel, A., Peters, T. (eds.) MICCAI 2011, Part I. LNCS, vol. 6891, pp. 89–96. Springer, Heidelberg (2011)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Collins, T., Pizarro, D., Bartoli, A., Canis, M., Bourdel, N. (2013). Realtime Wide-Baseline Registration of the Uterus in Laparoscopic Videos Using Multiple Texture Maps. In: Liao, H., Linte, C.A., Masamune, K., Peters, T.M., Zheng, G. (eds) Augmented Reality Environments for Medical Imaging and Computer-Assisted Interventions. MIAR AE-CAI 2013 2013. Lecture Notes in Computer Science, vol 8090. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-40843-4_18
Download citation
DOI: https://doi.org/10.1007/978-3-642-40843-4_18
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-40842-7
Online ISBN: 978-3-642-40843-4
eBook Packages: Computer ScienceComputer Science (R0)