Abstract
Robot-assisted surgeries have enabled surgeons to perform complex procedures more precisely and easily as compared with the conventional laparoscopic surgery. These new technologies have expanded the indications of the nephron-sparing surgery to cases that are anatomically more complicated. One of the challenging cases is that of the completely endophytic tumors because surgeons do not have any visual clues about tumor location on the kidney surface. In addition, these tumors pose technical challenges for their localization and resection, thereby likely increasing the possibility of perioperative complications. Since April 2014, we have been developing a visual support system for performing robot-assisted laparoscopic partial nephrectomy (RAPN) using the augmented-reality (AR) technology. The AR-based navigation system for RAPN can help identify the vasculature structure and tumor location easily and objectively. Moreover, image registration and organ tracking are critical to improving the accuracy of the system. Notably, tissue deformation, manual adjustment, and depth perception are the key elements for achieving precise image registration. Thus, console surgeons must effectively understand the properties and weak points of the AR navigation system and, accordingly, manipulate the laparoscopic camera and robot forceps to facilitate image registration and organ tracking. The cooperation of the console surgeon can result in a better collaboration between the real-time operation image and three-dimensional computer graphics models in the navigation system. We expect our system will offer significant benefits to both surgeons and patients.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Ljungberg, B., Albiges, L., et al.: European association of urology guidelines on renal cell carcinoma: the 2019 update. Eur. Urol. 75(5), 799–810 (2019)
Autorino, R., Khalifeh, A., et al.: Robot-assisted partial nephrectomy (RAPN) for completely endophytic renal masses: a single institution experience. BJU Int. 113(5), 762–768 (2014)
Komninos, C., Shin, T.Y., et al.: Robotic partial nephrectomy for completely endophytic renal tumors: complications and functional and oncologic outcomes during a 4-year median period of follow-up. Urology. 84(6), 1367–1373 (2014)
Assimos, D.G., Boyce, H., et al.: Intraoperative renal ultrasonography: a useful adjunct to partial nephrectomy. J. Urol. 146(5), 1218–1220 (1991)
Sengiku, A., Koeda, M., et al.: Augmented reality navigation system for robot-assisted laparoscopic partial nephrectomy. In: DUXU: Design, User Experience, and Usability: Designing Pleasurable Experiences, pp. 575–584 (2017)
Hughes-Hallett, A., Mayer, E.K., et al.: Augmented reality partial nephrectomy: examining the current status and future perspectives. Urology. 83(2), 266–273 (2014)
Drost, B., Ulrich, M., et al.: Model globally, match locally: efficient and robust 3D object recognition. In: 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 998–1005 (2010)
Mur-Artal, R., Tardós, J.D.: ORB-SLAM2: an open-source SLAM system for monocular, stereo and RGB-D cameras. IEEE Trans. Robot. 33(5), 1255–1262 (2017)
Hung, A.J., Cai, J., et al.: “Trifecta” in partial nephrectomy. J. Urol. 189(1), 36–42 (2013)
Furukawa, J., Kanayama, H., et al.: ‘Trifecta’ outcomes of robot-assisted partial nephrectomy: a large Japanese multicenter study. Int. J. Clin. Oncol. (2019). https://doi.org/10.1007/s10147-019-01565-0. [Epub ahead of print]
Acknowledgment
This study was supported in part by Grant-in-aid from the Ministry of Education and Science (to A.S. # 17K13035 and to M.K. # 18K11496). The authors thank all the past and present laboratory members in the Department of Urology, Kyoto University Graduate School of Medicine, Kyoto, Japan for their technical assistance. We would like to thank Editage (www.editage.com) for English language editing.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Hamada, A. et al. (2020). The Current Status and Challenges in Augmented-Reality Navigation System for Robot-Assisted Laparoscopic Partial Nephrectomy. In: Kurosu, M. (eds) Human-Computer Interaction. Multimodal and Natural Interaction. HCII 2020. Lecture Notes in Computer Science(), vol 12182. Springer, Cham. https://doi.org/10.1007/978-3-030-49062-1_42
Download citation
DOI: https://doi.org/10.1007/978-3-030-49062-1_42
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-49061-4
Online ISBN: 978-3-030-49062-1
eBook Packages: Computer ScienceComputer Science (R0)