Skip to main content

Advertisement

Springer Nature Link
Log in

A system for context-aware intraoperative augmented reality in dental implant surgery

  • Original Article
  • Published:
International Journal of Computer Assisted Radiology and Surgery Aims and scope Submit manuscript

Abstract

Purpose   

Large volumes of information in the OR are ignored by surgeons when the amount outpaces human mental processing abilities. We developed an augmented reality (AR) system for dental implant surgery that acts as an automatic information filter, selectively displaying only relevant information. The purpose is to reduce information overflow and offer intuitive image guidance. The system was evaluated in a pig cadaver experiment.

Methods   

Information filtering is implemented via rule-based situation interpretation with description logics. The interpretation is based on intraoperative distances measurement between anatomical structures and the dental drill with optical tracking. For AR, a head-mounted display is used, which was calibrated with a novel method based on SPAAM. To adapt to surgeon specific preferences, we offer two alternative display formats: one with static and another with contact analog AR.

Results   

The system made the surgery easier and showed ergonomical benefits, as assessed by a questionnaire. All relevant phases were recognized reliably. The new calibration showed significant improvements, while the deviation of the realized implants was \(<\)2.5 mm.

Conclusion   

The system allowed the surgeon to fully concentrate on the surgery itself. It offered greater flexibility since the surgeon received all relevant information, but was free to deviate from it. Accuracy of the realized implants remains an open issue and part of future work.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

References

  1. Ewers R, Schicho K, Truppe M, Seemann R, Reichwein A et al (2004) Computer-aided navigation in dental implantology: 7 years of clinical experience. J Oral Maxillofac Surg 62(3):329–334

    Article  PubMed  Google Scholar 

  2. Hassfeld S, Muehling J (2001) Computer assisted oral and maxillofacial surgery a review and an assessment of technology. J Oral Maxillofac Surg 30(1):2–13

    Article  CAS  Google Scholar 

  3. Kersten-Oertel M, Jannin P, Collins DL (2013) The state of the art of visualization in mixed reality image guided surgery. Comput Med Imaging Graph 37(2):98–112

    Article  PubMed  Google Scholar 

  4. Woods DD, Patterson ES, Roth EM (2002) Can we ever escape from data overload? A cognitive systems diagnosis. Cognit Technol Work 4(1):22–36

    Article  Google Scholar 

  5. Yamaguchi S, Ohtani T, Yatani H, Sohmura T (2009) Augmented reality system for dental implant surgery. HCI 13:633–638

    Google Scholar 

  6. Yamaguchi S, Ohtani T, Ono S, Yamanishi Y, Sohmura T, Yatani H (2011) Intuitive surgical navigation system for dental implantology by using retinal imaging display, implant dentistry—a rapidly evolving practice Prof. Ilser Turkyilmaz (Ed.), ISBN: 978-953-307-658-4, InTech. doi:10.5772/19034

  7. Ploder O, Wagner A, Enislidis G, Ewers R (1995) Computer-assisted intraoperative visualization of dental implants. Augmented reality in medicine. Radiologe 35(9):569–572

    CAS  PubMed  Google Scholar 

  8. Wanschitz F, Birkfellner W, Figl M, Patruta S, Wagner A, Watzinger F, Yerit K et al (2002) Computer-enhanced stereoscopic vision in a head-mounted display for oral implant surgery. Clin Oral Implant Res 13(6):610–616

    Article  Google Scholar 

  9. Tran HH, Suenaga H, Kuwana K, Masamune K, Dohi T, Nakajima S, Liao H (2011) Augmented reality system for oral surgery using 3D auto stereoscopic visualization medical image computing and computer-assisted intervention—MICCAI 2011 LNCS 6891, 81-88

  10. Lin YK, Yau HT, Wang IC, Zheng C, Chung KH (2013) A novel dental implant guided surgery based on integration of surgical template and augmented reality, Clin Implant Dent Relat Res. doi:10.1111/cid.12119

  11. Phattanapon R, Kugamoorthy G, Peter H, Matthew D, Siriwan S (2010) Augmented reality haptics system for dental surgical skills training VRST ’10. In: Proceedings of the 17th ACM Symposium on Virtual Reality Software and Technology 97–98

  12. Behringer R, Christian J, Holzinger A, Wilkinson S (2007) Some usability Issues of augmented and mixed reality for e-health applications in the medical domain. USAB 255–266

  13. Adam EC (1993) Fighter cockpits of the future. In: proceedings of 12th IEEE/AIAA digital avionics systems conference (DASC), Int J Comput Assist Radiol Surg, 318–323

  14. Lalys F, Jannin P (2013) Surgical process modelling: a review. Int J Comput Assist Radiol Surg [Epub ahead of print]

  15. Blum T, Feuner H, Navab N (2010) Modeling and segmentation of surgical workflow from laparoscopic video MICCAI 2010

  16. Padoy N, Blum T, Ahmadi A, Feuner H, Berger MO, Navab N (2010) Statistical modeling and recognition of surgical workflow, medical image analysis (2010)

  17. Lalys F, Riaud L, Morandi X, Jannin P (2011) Surgical phases detection from microscope videos by combining SVM and HMM medical computer vision. MCV’10 proceedings of the 2010 international MICCAI conference on Medical computer vision: recognition techniques and applications in medical imaging

  18. Bouarfa L, Jonkera PP, Dankelmana J (2010) Discovery of high-level tasks in the operating room. J Biomed Inform

  19. James A, Vieira D, Lo B, Darzi A, Yang GZ (2007) Eye-gaze driven surgical workflow segmentation MICCAI 2007

  20. Jannin P, Morandi X (2007) Surgical models for computer-assisted neurosurgery. Neuroimage 37:783–791

    Article  CAS  PubMed  Google Scholar 

  21. Neumuth T, Jannin P, Schlomberg J, Meixensberger J, Wiedemann P, Burgert O (2010) Analysis of surgical intervention populations using generic surgical process models. Int J Comput Assist Radiol Surg 6(1):59–71

    Article  PubMed Central  PubMed  Google Scholar 

  22. Baader F, Calvanese D, McGuinness DL, Nardi D, Patel-Schneider PF (2003) The description logic handbook: theory, implementation, applications. Cambridge University Press, Cambridge

    Google Scholar 

  23. Neumuth T, Strau G, Meixensberger J, Lemke HU, Burgert O (2006) Acquisition of process descriptions from surgical interventions. DEXA2006, LNCS(4080)

  24. Katic D, Wekerle AL, Bodenstedt S, Kenngott H, Mueller-Stich BP, Dillmann R, Speidel S (2011) Logic-based situation interpretation with real-valued sensor data for laparoscopic surgery. M2CAI 2011–2nd workshop on modeling and monitoring of computer assisted interventions

  25. Katic D, Wekerle AL, Grtler J, Spengler P, Bodenstedt S, Rhl S, Suwelack S, Kenngott HG, Wagner M, Mueller-Stich BP, Dillmann R, Speidel S (2013) Context-aware augmented reality in laparoscopic surgery. Comp Med Imag Graph 37(2):174–182

    Article  Google Scholar 

  26. Katic D, Sudra G, Speidel S, Castrillon-Oberndorfer G, Eggers G, Dillmann R (2010) Knowledge-based situation interpretation for context-aware augmented reality in dental implant surgery MIAR 2010

  27. Tuceryan M, Navab N (2000) Single point active alignment method (SPAAM) for optical see-through HMD calibration for AR IEEE and ACM international symposium on augmented reality

  28. Katic D, Christian T, Castrillon-Oberndorfer G, Hoffmann J, Eggers G, Dillmann R, Speidel S (2011) Calibration of see-through-goggles for a context-aware augmented reality system computer assisted radiology and surgery

Download references

Acknowledgments

The present research is supported by the German Research Foundation (Research Grant DI 330/23-1) and part of the “SFB TRR 125 Cognition-Guided Surgery” founded by the German Research Foundation. It is furthermore sponsored by the European Social Fund of the State Baden-Wuerttemberg.

Conflict of interest

Darko Katić, Patrick Spengler, Sebastian Bodenstedt, Gregor Castrillon-Oberndorfer, Robin Seeberger, Juergen Hoffmann, Ruediger Dillmann and Stefanie Speidel declare that they have no conflict of interest.

Author information

Authors and Affiliations

  1. Department of Informatics, Institute for Anthropomatics, Karlsruhe Institute of Technology (KIT), Adenauerring 2, 76131 , Karlsruhe, Germany

    Darko Katić, Patrick Spengler, Sebastian Bodenstedt, Ruediger Dillmann & Stefanie Speidel

  2. Department of Cranio-Maxillofacial Surgery, University of Heidelberg, Im Neuenheimer Feld 400, 69120 , Heidelberg, Germany

    Gregor Castrillon-Oberndorfer, Robin Seeberger & Juergen Hoffmann

Authors
  1. Darko Katić
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Patrick Spengler
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Sebastian Bodenstedt
    View author publications

    You can also search for this author inPubMed Google Scholar

  4. Gregor Castrillon-Oberndorfer
    View author publications

    You can also search for this author inPubMed Google Scholar

  5. Robin Seeberger
    View author publications

    You can also search for this author inPubMed Google Scholar

  6. Juergen Hoffmann
    View author publications

    You can also search for this author inPubMed Google Scholar

  7. Ruediger Dillmann
    View author publications

    You can also search for this author inPubMed Google Scholar

  8. Stefanie Speidel
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Darko Katić.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Katić, D., Spengler, P., Bodenstedt, S. et al. A system for context-aware intraoperative augmented reality in dental implant surgery. Int J CARS 10, 101–108 (2015). https://doi.org/10.1007/s11548-014-1005-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11548-014-1005-0

Keywords