Skip to main content

Advertisement

Springer Nature Link
Log in

Shape estimation of the anterior part of a flexible ureteroscope for intraoperative navigation

  • Original Article
  • Published:
International Journal of Computer Assisted Radiology and Surgery Aims and scope Submit manuscript

Abstract

Purpose

Flexible ureteroscopy (FURS) plays an important role in the diagnosis and treatment of urological diseases. However, manipulating a flexible ureteroscope to the target quickly and safely may be challenging because of the tortuous lumen or poor visibility. Thus, information on the shape of the anterior part of a flexible ureteroscope in addition to the real-time pose is needed to perform accurate maneuvering in the lumen with minimal impingement on the inner renal wall and resulting tissue damage in FURS.

Methods

An adaptive mixed-order Bézier curve fitting algorithm and electromagnetic tracking (EMT) technique were developed for shape estimation utilizing the length of the anterior part, kinematic constraints and the pose information provided by two electromagnetic (EM) sensors mounted at the tip and base of the anterior part. A series of experiments were performed to qualitatively and quantitatively verify the validity of our method. Moreover, algorithm threshold conditions with reference significance under various shape cases were studied.

Results

The performance of our method was evaluated based on 19 representative planar bending shapes that often appear in FURS and eight non-planar shapes, yielding an average error (AE) of 1.0 mm. Moreover, the experiments proved the feasibility of applying our method in cases in which large bending angles (near 270 degrees) occur.

Conclusion

Based on data from two EM sensors mounted at the tip and base of the anterior part of a flexible ureteroscope, the proposed algorithm adaptively selects a cubic or quartic Bézier curve to fit the shape of the anterior part. Experimental results prove the feasibility of our shape estimation method over a broad bending range. The proposed method demonstrates significant potential for use in ureteroscopic navigation systems and robot-assisted surgery.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

References

  1. Yoshida K, Kawa G, Taniguchi H, Inoue T, Mishima T, Yanishi M, Sugi M, Kinoshita H, Matsuda T (2014) Novel ureteroscopic navigation system with a magnetic tracking device: a preliminary ex vivo evaluation. J Endourol 28(9):1053–1057

    Article  Google Scholar 

  2. Li Z-G, Zhao Y, Fan T, Hao L, Han C-H, Zang G-H (2016) Clinical effects of FURL and PCNL with holmium laser for the treatment of kidney stones. Exp Ther Med 12(6):3653–3657

    Article  CAS  Google Scholar 

  3. Kuroda S, Ito H, Sakamaki K, Tabei T, Kawahara T, Fujikawa A, Makiyama K, Yao M, Uemura H, Matsuzaki J (2018) A new prediction model for operative time of flexible ureteroscopy with lithotripsy for the treatment of renal stones. PLoS One 13(2):e0192597

    Article  Google Scholar 

  4. Shi C, Luo X, Qi P, Li T, Song S, Najdovski Z, Fukuda T, Ren H (2016) Shape sensing techniques for continuum robots in minimally invasive surgery: a survey. IEEE Trans Biomed Eng 64(8):1665–1678

    Article  Google Scholar 

  5. Presti DL, Massaroni C, Leitão CSJ, Domingues MDF, Sypabekova M, Barrera D, Floris I, Massari L, Oddo CM, Sales S (2020) Fiber Bragg gratings for medical applications and future challenges: a review. IEEE Access 8:156863–156888

    Article  Google Scholar 

  6. Khan F, Denasi A, Barrera D, Madrigal J, Sales S, Misra S (2019) Multi-core optical fibers with Bragg gratings as shape sensor for flexible medical instruments. IEEE Sens J 19(14):5878–5884

    Article  Google Scholar 

  7. Lu Y, Lu B, Li B, Guo H, Liu Y-h (2021) Robust three-dimensional shape sensing for flexible endoscopic surgery using multi-core FBG sensors. IEEE Robot Automation Lett 6(3):4835–4842

    Article  Google Scholar 

  8. Kim JS, Guo J, Chatrasingh M, Kim S, Iordachita I (2017) Shape determination during needle insertion with curvature measurements. In: 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), IEEE, pp. 201–208

  9. Ha XT, Ourak M, Al-Ahmad O, Wu D, Borghesan G, Menciassi A, Vander Poorten E (2021) Robust catheter tracking by fusing electromagnetic tracking, fiber bragg grating and sparse fluoroscopic images. IEEE Sens J 21(20):23422–23434. https://doi.org/10.1109/jsen.2021.3107036

    Article  CAS  Google Scholar 

  10. Hoeckelmann M, Rudas IJ, Fiorini P, Kirchner F, Haidegger T (2015) Current capabilities and development potential in surgical robotics. Int J Adv Rob Syst 12(5):61

    Article  Google Scholar 

  11. Franz AM, Haidegger T, Birkfellner W, Cleary K, Peters TM, Maier-Hein L (2014) Electromagnetic tracking in medicine—a review of technology, validation, and applications. IEEE Trans Med Imag 33(8):1702–1725

    Article  Google Scholar 

  12. Luo X, Wan Y, He X (2015) Robust electromagnetically guided endoscopic procedure using enhanced particle swarm optimization for multimodal information fusion. Med Phys 42(4):1808–1817

    Article  Google Scholar 

  13. Shi C, Tercero C, Wu X, Ikeda S, Komori K, Yamamoto K, Arai F, Fukuda T (2016) Real-time in vitro intravascular reconstruction and navigation for endovascular aortic stent grafting. Int J Med Robot Comput Assist Surg 12(4):648–657

    Article  Google Scholar 

  14. Lima E, Rodrigues PL, Mota P, Carvalho N, Dias E, Correia-Pinto J, Autorino R, Vilaca JL (2017) Ureteroscopy-assisted percutaneous kidney access made easy: first clinical experience with a novel navigation system using electromagnetic guidance (IDEAL Stage 1). Eur Urol 72(4):610–616

    Article  Google Scholar 

  15. Song S, Li Z, Yu H, Ren H (2015) Electromagnetic positioning for tip tracking and shape sensing of flexible robots. IEEE Sens J 15(8):4565–4575

    Article  Google Scholar 

  16. Ryu SC, Dupont PE (2014) FBG-based shape sensing tubes for continuum robots. In: 2014 IEEE International Conference on Robotics and Automation (ICRA), IEEE, pp. 3531–3537s

  17. Kim B, Ha J, Park FC, Dupont PE (2014) Optimizing curvature sensor placement for fast, accurate shape sensing of continuum robots. In: 2014 IEEE international conference on robotics and automation (ICRA), IEEE, pp. 5374–5379

  18. Jäckle S, Eixmann T, Schulz-Hildebrandt H, Hüttmann G, Pätz T (2019) Fiber optical shape sensing of flexible instruments for endovascular navigation. Int J Comput Assist Radiol Surg 14(12):2137–2145

    Article  Google Scholar 

  19. Song S, Li Z, Yu H, Ren H (2015) Shape reconstruction for wire-driven flexible robots based on Bézier curve and electromagnetic positioning. Mechatronics 29:28–35

    Article  Google Scholar 

  20. Song S, Li Z, Meng MQ-H, Yu H, Ren H (2015) Real-time shape estimation for wire-driven flexible robots with multiple bending sections based on quadratic Bézier curves. IEEE Sens J 15(11):6326–6334

    Article  Google Scholar 

  21. Sadjadi H, Hashtrudi-Zaad K, Fichtinger G (2013) Fusion of electromagnetic trackers to improve needle deflection estimation: simulation study. IEEE Trans Biomed Eng 60(10):2706–2715

    Article  Google Scholar 

  22. Sadjadi H, Hashtrudi-Zaad K, Fichtinger G (2014) Needle deflection estimation: prostate brachytherapy phantom experiments. Int J Comput Assist Radiol Surg 9(6):921–929

    Article  Google Scholar 

  23. Condino S, Ferrari V, Freschi C, Alberti A, Berchiolli R, Mosca F, Ferrari M (2012) Electromagnetic navigation platform for endovascular surgery: How to develop sensorized catheters and guidewires. Int J Med Robot Comput Assist Surg 8(3):300–310

    Article  CAS  Google Scholar 

  24. Condino S, Calabrò E, Alberti A, Parrini S, Cioni R, Berchiolli RN, Gesi M, Ferrari V, Ferrari M (2014) Simultaneous tracking of catheters and guidewires: comparison to standard fluoroscopic guidance for arterial cannulation. Eur J Vasc Endovasc Surg 47(1):53–60

    Article  CAS  Google Scholar 

  25. Gomes P (2012) Medical robotics: Minimally invasive surgery. Elsevier

  26. Gao A, Liu N, Shen M, EMK Abdelaziz M, Temelkuran B, Yang G-Z (2020) Laser-profiled continuum robot with integrated tension sensing for simultaneous shape and tip force estimation. Soft Robot 7(4): 421–443

  27. Glodny B, Unterholzner V, Taferner B, Hofmann KJ, Rehder P, Strasak A, Petersen J (2009) Normal kidney size and its influencing factors-a 64-slice MDCT study of 1040 asymptomatic patients. BMC Urol 9(1):1–13

    Article  Google Scholar 

  28. Haidegger T (2019) Autonomy for surgical robots: Concepts and paradigms. IEEE Trans Med Robot Bionics 1(2):65–76

    Article  Google Scholar 

Download references

Acknowledgements

This research was supported by the National Major Scientific Research Instrument Development Project (Grant No. 81827804), and the Robotics Institute of Zhejiang University (Grant Nos. K11806), and the Key Research and Development Plan of Zhejiang Province (Grant Nos. 2022C03086 and 2017C03036).

Author information

Authors and Affiliations

  1. Biosensor National Special Laboratory, College of Biomedical Engineering and Instrument Science, Zhejiang University, 38 Zheda Road, Hangzhou, Zhejiang Province, 310027, People’s Republic of China

    Chongan Zhang, Chunyong Hu, Zhongyu He, Zuoming Fu, Lixin Xu, Peng Wang, Hong Zhang & Xuesong Ye

  2. Department of Urology, Sir Run Run Shaw Hospital, School of Medicine, Zhejiang University, Hangzhou, 310016, China

    Guoqing Ding

  3. State Key Laboratory of CAD and CG, Zhejiang University, Hangzhou, 310058, China

    Xuesong Ye

Authors
  1. Chongan Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Chunyong Hu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Zhongyu He
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Zuoming Fu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Lixin Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Guoqing Ding
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Peng Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Hong Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Xuesong Ye
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Xuesong Ye.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Ethical approval

This article does not contain any studies with human participants or animals performed by any of the authors.

Informed consent

The data used in this paper are a public dataset and it is anonymous, not used for commercial purposes, but for research purposes only.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhang, C., Hu, C., He, Z. et al. Shape estimation of the anterior part of a flexible ureteroscope for intraoperative navigation. Int J CARS 17, 1787–1799 (2022). https://doi.org/10.1007/s11548-022-02670-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11548-022-02670-8

Keywords