Skip to main content

Advertisement

SpringerLink
Log in

Intra-operative augmented reality in distal locking

  • Original Article
  • Published:
International Journal of Computer Assisted Radiology and Surgery Aims and scope Submit manuscript

Abstract

Purpose

To design an augmented reality solution that assists surgeons during the distal locking of intramedullary nailing procedures.

Method

Traditionally, the procedure is performed under X-ray guidance and requires a significant amount of time and radiation exposure. To absolve these complications, we propose video guidance that allows surgeons to achieve both the down-the-beam position of the intramedullary nail and its subsequent locking. For the down-the-beam position, the IM nail pose in X-ray is calculated using a 2D/3D registration scheme and later related to the patient leg pose which is calculated using video-tracked AR markers. For the distal locking, surgeons use an augmented radiolucent drill in which its tip position is detected and tracked in real-time under video guidance.

Validation

To evaluate the feasibility of our solution, we performed a preclinical study on dry bone phantom with the participation of four clinicians.

Results

Participants achieved 100 % success rate in the down-the beam positioning and 93 % success rate in distal locking using only two X-ray images in 100 s.

Conclusions

We confirmed that intra-operative navigation using augmented reality provides an alternative way to perform distal locking in a safe and timely manner.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Bong MR, Koval KJ, Egol KA (2006) The history of intramedullary nailing. Bull Hosp Jt Dis New York 64(3/4):94

    Google Scholar 

  2. Antonova E, Le Kim T, Burge R, Mershon J (2013) Tibia shaft fractures: costly burden of nonunions. BMC Musculoskelet Disord 14(1):42

    Article  PubMed Central  PubMed  Google Scholar 

  3. Yaniv Z, Joskowicz L (2005) Precise robot-assisted guide positioning for distal locking of intramedullary nails. Med Imaging IEEE Trans 24(5):624–635

    Article  Google Scholar 

  4. Leloup T, El Kazzi W, Schuind F, Warzée N (2008) Novel technique for distal locking of intramedullary nail based on two non-constrained fluoroscopic images and navigation. IEEE Trans Med Imaging 27(9):1202–1212

    Article  PubMed  Google Scholar 

  5. Zheng G, Zhang X, Haschtmann D, Gédet P, Langlotz F, Nolte LP (2007) Accurate and reliable pose recovery of distal locking holes in computer-assisted intra-medullary nailing of femoral shaft fractures: a preliminary study. Comput Aid Surg 12(3):138–151

    Article  Google Scholar 

  6. Windolf M, Schroeder J, Fliri L, Dicht B, Liebergall M, Richards RG (2012) Reinforcing the role of the conventional C-arm: a novel method for simplified distal interlocking. BMC Musculoskelet Disord 13(1):8

    Article  PubMed Central  PubMed  Google Scholar 

  7. Rohilla R, Singh R, Rohilla S, Magu N, Devgan A, Siwach R (2011) Locked intramedullary femoral nailing without fracture table or image intensifier. Strateg Trauma Limb Reconstr 6:127–135

    Article  Google Scholar 

  8. Diotte B, Fallavollita P, Wang L, Weidert S, Thaller P-H, Euler E, Navab N (2012) Radiation-free drill guidance in interlocking of intramedullary nails. LNCS, vol 7510. Springer, pp 18–25

  9. Londei R, Esposito M, Diotte B, Weidert S, Euler E, Thaller P, Navab N, Fallavollita P (2014) The ‘augmented’circles: a video-guided solution for the down-the-beam positioning of IM nail holes. In: Information processing in computer-assisted interventions. Springer International Publishing, pp 100–107

  10. Diotte B, Fallavollita P, Wang L, Weidert S, Euler E, Thaller P, Navab N (2015) Multi-modal intra-operative navigation during distal locking of intramedullary nails. IEEE Trans Med Imaging 34(2):487–495

  11. Wang L, Landes J, Weidert S, Blum T, Von Der Heide A, Euler E, Navab N (2010) First animal cadaver study for interlocking of intramedullary nails under camera augmented mobile C-arm. In: Information processing in computer-assisted interventions. Springer, Berlin Heidelberg, pp 56–66

  12. Maqungo S, Horn A, Bernstein B, Keel M, Roche S (2014) Distal interlocking screw placement in the femur: free-hand versus electromagnetic assisted technique (sureshot). J Orthop Trauma 28(1):e281–e283

    Article  PubMed  Google Scholar 

  13. Moreschini O, Petrucci V, Cannata R (2014) Insertion of distal locking screws of tibial intramedullary nails: a comparison between the free-hand technique and the SURESHOT\(^{{\rm TM}}\) distal targeting system. Injury 45(2):405–407

    Article  CAS  PubMed  Google Scholar 

  14. Navab N, Heining S-M, Traub J (2010) Camera augmented mobile C-arm (CAMC): calibration, accuracy study, and clinical applications. Med Imaging IEEE Trans 29(7):1412–1423

    Article  Google Scholar 

  15. Wang L, Fallavollita P, Zou R, Chen X, Weidert S, Navab Nassir (2012) Closed-form inverse kinematics for interventional C-arm X-ray imaging with six degrees of freedom: modeling and application. Med Imaging IEEE Trans 31(5):1086–1099

    Article  Google Scholar 

  16. Chen X, Wang L, Fallavollita P, Navab N (2012) Error analysis of the X-ray projection geometry of camera-augmented mobile C-arm. In: SPIE medical imaging, pp 83160P–83160P

  17. Chen X, Wang L, Fallavollita P, Navab N (2013) Precise X-ray and video overlay for augmented reality fluoroscopy. Int J Comput Assist Radiol Surg 8(1):29–38

    Article  CAS  PubMed  Google Scholar 

  18. Pati S, Erat O, Wang L, Weidert S, Euler E, Navab N, Fallavollita P (2013) Accurate pose estimation using single marker single camera calibration system. In: SPIE medical imaging, pp 867126–867126

  19. Wang L, Fallavollita P, Brand A, Erat O, Weidert S, Thaller P-H, Euler E, Navab N (2012) Intra-op measurement of the mechanical axis deviation: an evaluation study on 19 human cadaver legs. In: Medical image computing and computer-assisted intervention-MICCAI. Springer, Berlin Heidelberg, pp 609–616

  20. Erat O, Pauly O, Weidert S, Thaller P, Euler E, Mutschler W, Navab N, Fallavollita P (2013) How a surgeon becomes superman by visualization of intelligently fused multi-modalities. In: SPIE medical imaging, pp 86710L–86710L

  21. Pauly O, Diotte B, Habert S, Weidert S, Euler E, Fallavollita P, Navab N (2014) Relevance-based visualization to improve surgeon perception. In: Information processing in computer-assisted interventions. Springer International Publishing, pp 178–185

  22. Pauly O, Katouzian A, Eslami A, Fallavollita P, Navab N (2012) Supervised classification for customized intraoperative augmented reality visualization. In: IEEE international symposium on mixed and augmented reality (ISMAR), pp 311–312

Download references

Conflict of interest

None.

Author information

Author notes

    Authors and Affiliations

    1. Chair for Computer Aided Medical Procedures, Technische Univ. Munchen, Munich, Germany

      Roberto Londei, Marco Esposito, Benoit Diotte, Nassir Navab & Pascal Fallavollita

    2. Klinik und Poliklinik Innenstadt, Munich, Germany

      Simon Weidert, Ekkehard Euler & Peter Thaller

    Authors
    1. Roberto Londei
      View author publications

      You can also search for this author in PubMed Google Scholar

    2. Marco Esposito
      View author publications

      You can also search for this author in PubMed Google Scholar

    3. Benoit Diotte
      View author publications

      You can also search for this author in PubMed Google Scholar

    4. Simon Weidert
      View author publications

      You can also search for this author in PubMed Google Scholar

    5. Ekkehard Euler
      View author publications

      You can also search for this author in PubMed Google Scholar

    6. Peter Thaller
      View author publications

      You can also search for this author in PubMed Google Scholar

    7. Nassir Navab
      View author publications

      You can also search for this author in PubMed Google Scholar

    8. Pascal Fallavollita
      View author publications

      You can also search for this author in PubMed Google Scholar

    Corresponding author

    Correspondence to Pascal Fallavollita.

    Additional information

    Roberto Londei and Marco Esposito have contributed equally to this work.

    Rights and permissions

    Reprints and permissions

    About this article

    Check for updates. Verify currency and authenticity via CrossMark

    Cite this article

    Londei, R., Esposito, M., Diotte, B. et al. Intra-operative augmented reality in distal locking. Int J CARS 10, 1395–1403 (2015). https://doi.org/10.1007/s11548-015-1169-2

    Download citation

    • Received:

    • Accepted:

    • Published:

    • Issue Date:

    • DOI: https://doi.org/10.1007/s11548-015-1169-2

    Keywords

    Search

    Navigation