Skip to main content

Abstract

The augmented reality (AR) is the latest technology in laparoscopy and minimally invasive surgery (MIS). This technology decreases post-operative pain, recovery time, difficulty rate, and infections. The main limitations of AR systems are system accuracy, the depth perception of organs, and real-time laparoscopy view. The aim of this work is to define the required components to implement an efficient AR visualization system. This work introduces Data, Visualization techniques, and View (DVV) classification system. The components of DVV should be considered and used as validation criteria for introducing any AR visualization system into the operating room. Well-designed DVV system can help the end user and surgeons with a clear view of anatomical details during abdominal surgery. This study validates the DVV taxonomy and considers system comparison, completeness, and acceptance as the primary criteria upon which the proposed DVV classification is based upon. This work also introduces a framework in which AR systems can be discussed, analyzed, validated and evaluated. State_of_the_art solutions are classified, evaluated, validated, and verified to describe how they worked in the domain of AR visualizing laparoscopy during abdominal surgery in the operating room. Finally, this paper states how the proposed system improves the system limitations.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Barcali, E., Iadanza, E., Manetti, L., Francia, P., Nardi, C., Bocchi, L.: Augmented reality in surgery: a scoping review. Appl. Sci. 12(14), 6890 (2022)

    Article  Google Scholar 

  2. Bernhardt, S., Nicolau, S.A., Soler, L., Doignon, C.: The status of augmented reality in laparoscopic surgery as of 2016. Med. Image Anal. 37, 66–90 (2017)

    Article  Google Scholar 

  3. Bourdel, N., et al.: Use of augmented reality in laparoscopic gynecology to visualize myomas. Fertility Sterility 107(3), 737–739 (2017)

    Article  Google Scholar 

  4. Chen, L., Tang, W., John, N.W., Wan, T.R., Zhang, J.J.: Slam-based dense surface reconstruction in monocular minimally invasive surgery and its application to augmented reality. Comput. Methods Programs Biomed. 158, 135–146 (2018)

    Article  Google Scholar 

  5. Cheung, T.T., et al.: Pure laparoscopic hepatectomy with augmented reality-assisted indocyanine green fluorescence versus open hepatectomy for hepatocellular carcinoma with liver cirrhosis: a propensity analysis at a single center. Asian J. Endoscopic Surge 11(2), 104–111 (2018)

    Article  Google Scholar 

  6. Coelho, G., et al.: The potential applications of augmented reality in fetoscopic surgery for antenatal treatment of myelomeningocele. World Neurosurg. 159, 27–32 (2022)

    Article  Google Scholar 

  7. Collins, T., et al.: Augmented reality guided laparoscopic surgery of the uterus. IEEE Trans. Med. Imaging 40(1), 371–380 (2021)

    Article  Google Scholar 

  8. Fucentese, S.F., Koch, P.P.: A novel augmented reality-based surgical guidance system for total knee arthroplasty. Arch. Orthop. Trauma Surg. 141(12), 2227–2233 (2021). https://doi.org/10.1007/s00402-021-04204-4

    Article  Google Scholar 

  9. Ganni, S., Botden, S.M.B.I., Chmarra, M., Goossens, R.H.M., Jakimowicz, J.J.: A software-based tool for video motion tracking in the surgical skills assessment landscape. Surg. Endosc. 32(6), 2994–2999 (2018). https://doi.org/10.1007/s00464-018-6023-5

    Article  Google Scholar 

  10. Golse, N., Petit, A., Lewin, M., Vibert, E., Cotin, S.: Augmented reality during open liver surgery using a markerless non-rigid registration system. J. Gastrointest. Surg. 25(3), 662–671 (2021)

    Article  Google Scholar 

  11. Ivanov, V.M., et al.: Practical application of augmented/mixed reality technologies in surgery of abdominal cancer patients. J. Imaging 8(7), 183 (2022)

    Article  Google Scholar 

  12. Kenngott, H.G., et al.: Mobile, real-time, and point-of-care augmented reality is robust, accurate, and feasible: a prospective pilot study. Surg. Endosc. 32(6), 2958–2967 (2018). https://doi.org/10.1007/s00464-018-6151-y

    Article  Google Scholar 

  13. Kersten-Oertel, M., Jannin, P., Collins, D.L.: DVV: a taxonomy for mixed reality visualization in image guided surgery. IEEE Trans. Visual Comput. Graphics 18(2), 332–352 (2011)

    Article  Google Scholar 

  14. Rowe, S.P., Johnson, P.T., Fishman, E.K.: Cinematic rendering of cardiac CT volumetric data: principles and initial observations. J. Cardiovasc. Comput. Tomogr. 12(1), 56–59 (2018)

    Article  Google Scholar 

  15. Zhao, S., Zhang, W., Sheng, W., Zhao, X.: A frame of 3d printing data generation method extracted from CT data. Sens. Imaging 19(1), 1–13 (2018)

    Article  MathSciNet  Google Scholar 

  16. Zhao, Z., et al.: Augmented reality technology in image-guided therapy: state-of-the-art review. Proc. Inst. Mech. Eng. Part H. J. Eng. Med. 235(12), 1386–1398 (2021)

    Google Scholar 

  17. Zou, Y., Liu, P.X.: A high-resolution model for soft tissue deformation based on point primitives. Comput. Methods Programs Biomed. 148, 113–121 (2017)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Rami S. Alkhawaldeh .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Bikram, K.R., Al-Dala’in, T., Alkhawaldeh, R.S., AlSallami, N., Al-Jerew, O., Ahmed, S. (2023). Taxonomy of AR to Visualize Laparoscopy During Abdominal Surgery. In: Daimi, K., Al Sadoon, A. (eds) Proceedings of the Second International Conference on Innovations in Computing Research (ICR’23). Lecture Notes in Networks and Systems, vol 721. Springer, Cham. https://doi.org/10.1007/978-3-031-35308-6_25

Download citation

Publish with us

Policies and ethics