Skip to main content
SpringerLink
Log in

Video-guided calibration of an augmented reality mobile C-arm

  • Original Article
  • Published:
International Journal of Computer Assisted Radiology and Surgery Aims and scope Submit manuscript

Abstract

Purpose

The augmented reality (AR) fluoroscope augments an X-ray image by video and provides the surgeon with a real-time in situ overlay of the anatomy. The overlay alignment is crucial for diagnostic and intra-operative guidance, so precise calibration of the AR fluoroscope is required. The first and most complex step of the calibration procedure is the determination of the X-ray source position. Currently, this is achieved using a biplane phantom with movable metallic rings on its top layer and fixed X-ray opaque markers on its bottom layer. The metallic rings must be moved to positions where at least two pairs of rings and markers are isocentric in the X-ray image. The current “trial and error” calibration process currently requires acquisition of many X-ray images, a task that is both time consuming and radiation intensive. An improved process was developed and tested for C-arm calibration.

Methods

Video guidance was used to drive the calibration procedure to minimize both X-ray exposure and the time involved. For this, a homography between X-ray and video images is estimated. This homography is valid for the plane at which the metallic rings are positioned and is employed to guide the calibration procedure. Eight users having varying calibration experience (i.e., 2 experts, 2 semi-experts, 4 novices) were asked to participate in the evaluation.

Results

The video-guided technique reduced the number of intra-operative X-ray calibration images by 89 % and decreased the total time required by 59 %.

Conclusion

A video-based C-arm calibration method has been developed that improves the usability of the AR fluoroscope with a friendlier interface, reduced calibration time and clinically acceptable radiation doses.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Paul P, Fleig O, Jannin P (2005) Augmented virtuality based on stereoscopic reconstruction in multimodal image-guided neurosurgery: methods and performance evaluation. IEEE Trans Med Imaging 24(11):1500–1511

    Article  PubMed  Google Scholar 

  2. Birkfellner W, Figl M, Huber K, Watzinger F, Wanschitz F, Hummel J, Hanel R, Greimel W, Homolka P, Ewers R, Bergmann H (2002) A head-mounted operating binocular for augmented reality visualization in medicine—design and initial evaluation. IEEE Trans Med Imaging 21(8):991–997

    Article  PubMed  Google Scholar 

  3. Grimson WEL, Lozano-Perez T, Wells WM III, Ettinger GJ, White SJ, Kikinis R (1996) An automatic registration method for frameless stereotaxy, image guided surgery, and enhanced reality visualization. IEEE Trans Med Imaging 15(2):129–140

    Article  PubMed  CAS  Google Scholar 

  4. Bajura M, Fuchs H, Ohbuchi R (1992) Merging virtual objects with the real world: seeing ultrasound imagery within the patient. In: Proceedings of the 19th annual conference on computer graphics and interactive techniques. ACM Press, pp 203–210

  5. State A, Chen DT, Tector C, Brandt A, Chen H, Ohbuchi R, Bajura M, Fuchs H (1994) Case study: observing a volume rendered fetus within a pregnant patient. In: Proceedings of the conference on visualization ’94. IEEE Computer Society Press, pp 364–368

  6. Sauer F, Khamene A, Bascle B, Rubino GJ (2001) A head-mounted display system for augmented reality image guidance: towards clinical evaluation for imri-guided neurosurgery. In: Proceeings of the international conference on medical image computing and computer assisted intervention (MICCAI). Springer, London, pp 707–716

  7. Sauer F, Schoepf UJ, Khamene A, Vogt S, Das M, Silverman SG (2003) Augmented reality system for ct-guided interventions: system description and initial phantom trials. In: Medical imaging: visualization, image-guided procedures, and display

  8. Blackwell M, Nikou C, DiGioia AM, Kanade T (2000) An image overlay system for medical data visualization. Med Image Anal 4(1):67–72

    Article  PubMed  CAS  Google Scholar 

  9. Sielhorst T, Feuerstein M, Navab N (2008) Advanced medical displays: a literature review of augmented reality. IEEE/OSA J Disp Technol. Special issue on Medical Displays, 4(4):451–467

    Google Scholar 

  10. Stetten G, Cois A, Chang W, Shelton D, Tamburo R, Castellucci J, von Ramm O (2005) C-mode real-time tomographic reflection for a matrix array ultrasound sonic flashlight. Acad Radiol 12: 535–543

    Google Scholar 

  11. Fichtinger G, Deguet A, Masamune K, Balogh E, Fischer GS, Mathieu H, Taylor RH, Zinreich SJ, Fayad LM (2005) Image overlay guidance for needle insertion in CT scanner. IEEE Trans Bio-Med Eng 52:1415–1424

    Article  Google Scholar 

  12. Fischer GS, Deguet A, Csoma C, Taylor RH, Fayad L, Carrino JA, Zinreich SJ, Fichtinger G (2007) MRI image overlay: application to arthrography needle insertion. Comput Aided Surg Off J Int Soc Comput Aided Surg 12:2–14

    Article  Google Scholar 

  13. Feuerstein M, Mussack T, Heining SM, Navab N (2008) Intraoperative laparoscope augmentation for port placement and resection planning in minimally invasive liver resection. IEEE Trans Med Imaging 27:355–369

    Article  PubMed  Google Scholar 

  14. Wendler T, Feuerstein M, Traub J, Lasser T, Vogel J, Daghighian F, Ziegler SI, Navab N (2007) Real-time fusion of ultrasound and gamma probe for navigated localization of liver metastases. In: International conference on medical image computing and computer-assisted intervention MICCAI 10, pp 252–260

  15. Moult E et al (2011) Automatic C-arm pose estimation via 2D/3D hybrid registration of a radiographic fiducial. In: SPIE medical imaging. p 79642S

  16. Fallavollita P et al (2010) C-arm pose estimation in prostate brachytherapy by registration to ultrasound. In: MICCAI (3). LNCS, Springer, pp 311–318

  17. Navab N, Mitschke M, Schütz O (1999) Camera-augmented mobile C-arm (CAMC) application: 3D reconstruction using a low-cost mobile C-arm. In: International conference on medical image computing and computer-assisted intervention, Lecture notes in computer science, vol 1679/1999, pp 688–697

  18. Navab N, Heining SM, Traub J (2010) Camera augmented mobile C-arm (CAMC): calibration, accuracy study, and clinical applications. IEEE Trans Med Imaging 29(7):1412–1423

    Article  PubMed  Google Scholar 

  19. Wang L, Traub J, Weidert S, Heining SM, Euler E, Navab N (2010) Parallax-free intraoperative X-ray image stitching. Med Image Anal 14(5):674–686

    Article  PubMed  Google Scholar 

  20. Navab N, Wiesner S, Benhimane S, Euler E, Heining SM (2006) Visual servoing for intraoperative positioning and repositioning of mobile C-arms. In: International conference on medical image computing and computer-assisted intervention, vol 19, no 1, pp 551–560

  21. Wang L, Landes J, Weidert S et al (2010) First animal cadaver study for interlocking of intramedullary nails under camera augmented mobile C-arm. A surgical workflow based preclinical evaluation. In: IPCAI’10 Proceedings of the first international conference on information processing in computer-assisted interventions, pp 56–66

  22. Diotte B, Fallavollita P, Wang L, Weidert S, Thaller P, Euler E, Navab N (2012) Radiation-free drill guidance in interlocking of intramedullary nails. In: 15th international conference on medical image computing and computer-assisted intervention, vol 7510, pp 18–25

  23. Londei R, Esposito M, Diotte B, Weidert S, Euler E, Thaller P, Navab N, Fallavollita P (2014) The ‘augmented’ circles: a video-guided solution for the down-the-beam positioning of IM nail holes. In: Information processing in computer-assisted interventions (IPCAI) (in press)

  24. Wang L, Fallavollita P, Zou R, Chen X, Weidert S, Navab N (2012 May) Closed-form inverse kinematics for interventional C-arm X-ray imaging with six degrees of freedom: modeling and application. IEEE Trans Med Imaging 31(5):1086–1099

    Google Scholar 

  25. Chen X, Wang L, Fallavollita P, Navab N (2013) Precise X-ray and video overlay for augmented reality fluoroscopy. Int J Comput Assist Radiol Surg 8(1):29–38

    Google Scholar 

  26. Chen X, Wang L, Fallavollita P, Navab N (2012) Error analysis of the X-ray projection geometry of camera-augmented mobile C-arm. In: SPIE medical imaging. International Society for Optics and Photonics, pp 83160P–83160P

  27. Pati S, Erat O, Wang L, Weidert S, Euler E, Navab N, Fallavollita P (2013) Accurate pose estimation using single marker single camera calibration system. In: SPIE medical imaging. International Society for Optics and Photonics, pp 867126–867126

  28. Wang L, Fallavollita P, Brand A, Erat O, Weidert S, Thaller P-H, Euler E, Navab N (2012) Intra-op measurement of the mechanical axis deviation: an evaluation study on 19 human cadaver legs. In: Medical image computing and computer-assisted intervention-MICCAI. Springer, Berlin, pp 609–616

  29. Erat O, Pauly O, Weidert S, Thaller P, Euler E, Mutschler W, Navab N, Fallavollita P (2013) How a surgeon becomes superman by visualization of intelligently fused multi-modalities. In: SPIE medical imaging. International Society for Optics and Photonics, pp 86710L–86710L

  30. Pauly O, Katouzian A, Eslami A, Fallavollita P, Navab N (2012) Supervised classification for customized intraoperative augmented reality visualization. In: IEEE international symposium on mixed and augmented reality (ISMAR), pp 311–312

  31. Pauly O, Diotte B, Habert S, Weidert S, Euler E, Fallavollita P, Navab N (2014) Visualization inside the operating room: “learning” what the surgeon wants to see. In: Information processing in computer-assisted interventions (IPCAI) (in press)

  32. Bradski G (2000) The OpenCV library. Dr Dobb’s J 25(11):120–126

    Google Scholar 

  33. Wright R et al (2010) OpenGL SuperBible: comprehensive tutorial and reference. Pearson Education, Upper Saddle River

  34. Suzuki S, Abe K (1985) Topological structural analysis of digital binary images by border following. CVGIP 30(1):32–46

    Google Scholar 

Download references

Conflict of interest

Xin Chen, Hemal Naik, Lejing Wang, Nassir Navab, Pascal Fallavollita have no conflict of interest.

Author information

Authors and Affiliations

  1. Chair for Computer Aided Medical Procedures, Fakultät für Informatik, Technische Universität München, Munich, Germany

    Xin Chen, Hemal Naik, Lejing Wang, Nassir Navab & Pascal Fallavollita

Authors
  1. Xin Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hemal Naik
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Lejing Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Nassir Navab
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Pascal Fallavollita
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Pascal Fallavollita.

Electronic supplementary material

Below is the link to the electronic supplementary material.

ESM 1 (AVI 45692 kb)

Rights and permissions

Reprints and permissions

About this article

Cite this article

Chen, X., Naik, H., Wang, L. et al. Video-guided calibration of an augmented reality mobile C-arm. Int J CARS 9, 987–996 (2014). https://doi.org/10.1007/s11548-014-0995-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11548-014-0995-y

Keywords

Search

Navigation