Skip to main content
SpringerLink
Log in

A variable baseline stereoscopic camera with fast deployable structure for natural orifice transluminal endoscopic surgery

  • Original Article
  • Published:
International Journal of Computer Assisted Radiology and Surgery Aims and scope Submit manuscript

Abstract

Purpose

Stereo vision can provide surgeons with 3D images and reduce the difficulty of operation in robot-assisted surgery. In natural orifice transluminal endoscopic surgery, distortions of the stereoscopic images could be induced at different observation depths. This would increase the risk of surgery. We proposed a novel camera to solve this problem.

Methods

This study integrated the camera calibration matrix and the geometric model of stereoscopic system to find the cause of distortion. It was found that image distortions were caused by inappropriate disparity, and this could be avoided by changing the camera baseline. We found the relationship between camera baseline and observation depth with the model. A variable baseline stereoscopic camera with deployable structure was designed to achieve this requirement. The baseline could be adjusted to provide appropriate disparity.

Results

Three controlled experiments were conducted to verify the stereo vision of the proposed camera at different observation depths. No significant difference was observed in the completion time. At the observation depths of 30 mm and 90 mm, the number of errors apparently decreased by 62.90% and 51.06%, respectively.

Conclusions

The significant decrease in number of errors shows that the proposed camera has a better stereo vision than a regular camera at both small and large observation depths. It can produce more accurate stereoscopic images at any depth. This will further improve the safety of robot-assisted surgery.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  1. Zhou Y, Ren H, Meng MQH, Tsz Ho Tse Z, Yu H (2013) Robotics in natural orifice transluminal endoscopic surgery. J Mech Med Biol 13(02):1350044. https://doi.org/10.1142/S0219519413500449

    Article  Google Scholar 

  2. Chan M, Lin W, Zhou C, Qu JY (2003) Miniaturized three-dimensional endoscopic imaging system based on active stereovision. Appl Opt 42(10):1888–1898. https://doi.org/10.1364/AO.42.001888

    Article  PubMed  Google Scholar 

  3. Hu M, Penney G, Figl M, Edwards P, Bello F, Casula R, Rueckert D, Hawkes D (2012) Reconstruction of a 3D surface from video that is robust to missing data and outliers: Application to minimally invasive surgery using stereo and mono endoscopes. Med Image Anal 16(3):597–611. https://doi.org/10.1016/j.media.2010.11.002

    Article  PubMed  Google Scholar 

  4. Ohuchida K (2013) New advances in three-dimensional endoscopic surgery. J Gastrointest Dig Syst 03(04):1000152. https://doi.org/10.4172/2161-069x.1000152

    Article  Google Scholar 

  5. Bogdanova R, Boulanger P, Zheng B (2016) Depth perception of surgeons in minimally invasive surgery. Surg Innov 23(5):515–524. https://doi.org/10.1177/1553350616639141

    Article  PubMed  Google Scholar 

  6. Higuchi K, Kaise M, Noda H, Kirita K, Koizumi E, Umeda T, Akimoto T, Omori J, Akimoto N, Goto O, Tatsuguchi A, Iwakiri K (2020) Three-dimensional flexible endoscopy enables more accurate endoscopic recognition and endoscopic submucosal dissection marking for superficial gastric neoplasia: a pilot study to compare two- and three-dimensional imaging. Surg Endosc 20:1–7. https://doi.org/10.1007/s00464-020-08124-z

    Article  Google Scholar 

  7. Andrew JW, Tom D, Rolf K (1993) Image distortions in stereoscopic video systems. Stereoscop Disp Appl IV. https://doi.org/10.1117/12.157041

    Article  Google Scholar 

  8. Fishman JM, Ellis SR, Hasser CJ, Stern JD (2008) Effect of reduced stereoscopic camera separation on ring placement with a surgical telerobot. Surg Endosc 22(11):2396–2400. https://doi.org/10.1007/s00464-008-0032-8

    Article  PubMed  Google Scholar 

  9. Hoffman DM, Girshick AR, Akeley K, Banks MS (2008) Vergence–accommodation conflicts hinder visual performance and cause visual fatigue. J Vis 8(3):33–33. https://doi.org/10.1167/8.3.33

    Article  PubMed  Google Scholar 

  10. Dawei F (2009) Analysis and design of stereoscopic display in stereo television endoscope system. Int Conf Opt Inst Technol 12:7156. https://doi.org/10.1117/12.806811

    Article  Google Scholar 

  11. Rosenberg LB (1993) The effect of interocular distance upon operator performance using stereoscopic displays to perform virtual depth tasks. IEEE Virtual Reality Annu Int Symp 27–32. https://doi.org/10.1109/vrais.1993.380802

  12. Groen PCD (2017) History of the endoscope [scanning our past. Proc IEEE 105(10):1987–1995. https://doi.org/10.1109/JPROC.2017.2742858

    Article  Google Scholar 

  13. Mintz D, Falk V, Salisbury JK (2000) Comparison of three high-end endoscopic visualization systems on telesurgical performance. Med Image Comput Comput Assist Intervent. Berlin, Heidelberg. Doi: https://doi.org/10.1007/978-3-540-40899-4_39

  14. Avinash A, Abdelaal AE, Salcudean SE (2020) Evaluation of increasing camera baseline on depth perception in surgical robotics. IEEE Int Conf Robot Auto 5509–5515. https://doi.org/10.1109/ICRA40945.2020.9197235

  15. Koh JX, Ren H (2017) Open-source development of a low-cost stereo-endoscopy system for natural orifice transluminal endoscopic surgery. Comput Vis Syst 357–370. https://doi.org/10.1007/978-3-319-68345-4_32

  16. Xu K, Zhao J, Dai Z (2014) A foldable stereo vision unit for Single Port Access Laparoscopy. In: IEEE international conference on robotics and automation, pp 4182–4187. Doi: https://doi.org/10.1109/ICRA.2014.6907467

  17. Avinash A, Abdelaal AE, Mathur P, Salcudean SE (2019) A “pickup” stereoscopic camera with visual-motor aligned control for the da Vinci surgical system: a preliminary study. Int J Comput Assist Radiol Surg 14(7):1197–1206. https://doi.org/10.1007/s11548-019-01955-9

    Article  PubMed  Google Scholar 

  18. Diner DB, Fender DH (1993) Human engineering in stereoscopic viewing devices. advances in computer vision and machine intelligence, 1st edn. Springer US, New York. Doi: https://doi.org/10.1007/978-1-4899-1274-9

  19. Zhengyou Z (1999) Flexible camera calibration by viewing a plane from unknown orientations. IEEE Int Conf Comput Vis 1:666–673. https://doi.org/10.1109/ICCV.1999.791289

    Article  Google Scholar 

  20. Schreuder H, van den Berg C, Hazebroek E, Verheijen R, Schijven M (2011) Laparoscopic skills training using inexpensive box trainers: which exercises to choose when constructing a validated training course. BJOG Int J Obstet Gynaecol 118 (13):1576–1584. Doi: https://doi.org/10.1111/j.1471-0528.2011.03146.x

  21. Faul F, Erdfelder E, Buchner A, Lang A-G (2009) Statistical power analyses using G*Power 3.1: Tests for correlation and regression analyses. Behav Res Methods 41(4):1149–1160. Doi: https://doi.org/10.3758/BRM.41.4.1149

  22. Pallant J (2013) SPSS survival manual: A step by step guide to data analysis using SPSS for windows. Aust NZ J Public Health 37(6):597–598. https://doi.org/10.1111/1753-6405.12166

    Article  Google Scholar 

Download references

Acknowledgements

This research was supported by the National Key R&D Program of China (Grant No. 2017YFC0110401), the National Natural Science Foundation of China (Grant No. 51805362).

Funding

This research was supported by the National Key R&D Program of China (Grant No. 2017YFC0110401), the National Natural Science Foundation of China (Grant No. 51805362).

Author information

Authors and Affiliations

  1. Key Laboratory of Mechanism Theory and Equipment Design of Ministry of Education, Tianjin University, 135 Yaguan Road, Tianjin, 300350, China

    Xinan Sun, He Su, Jinhua Li & Shuxin Wang

  2. School of Mechanical Engineering, Tianjin University, 135 Yaguan Road, Jinnan District, Tianjin, 300350, China

    Xinan Sun, He Su, Jinhua Li & Shuxin Wang

Authors
  1. Xinan Sun
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. He Su
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jinhua Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Shuxin Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Not applicable.

Corresponding author

Correspondence to He Su.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Availability of data and material

Not applicable.

Code availability

Not applicable.

Ethical approval

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Declaration of Helsinki and its later amendments or comparable ethical standards.

Consent to participate

Not applicable.

Consent for publication

Not applicable.

Informed consent

Informed consent was obtained from all individual participants included in the study.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sun, X., Su, H., Li, J. et al. A variable baseline stereoscopic camera with fast deployable structure for natural orifice transluminal endoscopic surgery. Int J CARS 17, 27–39 (2022). https://doi.org/10.1007/s11548-021-02509-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11548-021-02509-8

Keywords

Search

Navigation