Abstract
In recent years, laparoscopic surgery has become major surgery due to several advantages for patients. However, it has disadvantages for operators because of the narrow surgical field of view. To solve this problem, our group proposed camera-retractable trocar which can obtain multiple surgical viewpoints while maintaining the minimally invasiveness. The purpose of this study is to obtain a wide visual panoramic view by utilizing image mosaicking of camera-retractable trocar viewpoints videos. We utilize feature points tracking in different videos to generate panoramic video independent of inter-cameras overlap and to increase mosaicking speed and robustness. We evaluate tracking accuracy according to several conditions and mosaicking accuracy according to overlap size. In contrast to the conventional mosaicking approach, the proposed approach can produce panoramic image even in the case of 0% inter-cameras overlap. Additionally, the proposed approach is fast enough for clinical use.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Miranda-Luna, R., et al.: Mosaicing of bladder endoscopic image sequences: distortion calibration and registration algorithm. IEEE Trans. Biomed. Eng. 55(2), 541–553 (2008)
Warren, A., et al.: Horizon stabilized—dynamic view expansion for robotic assisted surgery (HS-DVE). Int. J. Comput. Assist. Radiol. and Surg. 7, 281–288 (2012)
Lerotic, M., Chung, A.J., Clark, J., Valibeik, S., Yang, G.-Z.: Dynamic view expansion for enhanced navigation in natural orifice transluminal endoscopic surgery. In: Metaxas, D., Axel, L., Fichtinger, G., Székely, G. (eds.) MICCAI 2008, Part II. LNCS, vol. 5242, pp. 467–475. Springer, Heidelberg (2008)
Vemuri, A.S., Liu, K., Ho, Y., Wu, H.: Endoscopic video mosaicing: application to surgery and diagnostics. In: Living Imaging Workshop, 1–2 December, IRCAD, Strasbourg, France (2011)
Bergen, T., Ruthotto, S., Munzenmayer, C., Rupp, S., Paulus, D., Winter, C.: Feature-based real-time endoscopic mosaicking. In: Proceeding of 6th International Symposium on Image and Signal Processing and Analysis, pp. 695–700 (2009)
Bergen, T., Wittenberg, T.: Stitching and surface reconstruction from endoscopic image sequences: a review of applications and methods. IEEE J. Biomed. Health Inform. 20, 304–321 (2014)
Tamadazte, B., Agustinos, A., Cinquin, P., Fiard, G., Voros, S.: Multi-view vision system for laparoscopy surgery. J. Comput. Assist. Radiol. Surg. 10, 195–203 (2015)
Okubo, T., Nakaguchi, T., Hayashi, H., Tsumura, T.: Abdominal view expansion by retractable camera. J. Signal Process. 15, 311–314 (2011)
Bay, H., Tuytelaars, T., Gool, L.: SURF: speeded up robust features. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3951, pp. 404–417. Springer, Heidelberg (2006). doi:10.1007/11744023_32
Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24, 381–395 (1981)
Shi, J., Tomasi, C.: Good features to track. In: 9th IEEE Conference on Computer Vision and Pattern Recognition, pp. 593–600 (1994)
Bouguet, J.Y.: Pyramidal implementation of the Lucas Kanade feature tracker: description of the algorithm, Intel Corporation Microprocessor Research Labs (2000)
OpenCV 2.4.13.0 documentation (2016). http://docs.opencv.org/2.4/index.html# Accessed 20 June 2016
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Takada, C., Suzuki, T., Afifi, A., Nakaguchi, T. (2017). Hybrid Tracking and Matching Algorithm for Mosaicking Multiple Surgical Views. In: Peters, T., et al. Computer-Assisted and Robotic Endoscopy. CARE 2016. Lecture Notes in Computer Science(), vol 10170. Springer, Cham. https://doi.org/10.1007/978-3-319-54057-3_3
Download citation
DOI: https://doi.org/10.1007/978-3-319-54057-3_3
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-54056-6
Online ISBN: 978-3-319-54057-3
eBook Packages: Computer ScienceComputer Science (R0)