Abstract
Our purpose is to provide an augmented reality system for Radio-Frequency guidance that could superimpose a 3D model of the liver, its vessels and tumors (reconstructed from CT images) on external video images of the patient. In this paper, we point out that clinical usability not only need the best affordable registration accuracy, but also a certification that the required accuracy is met, since clinical conditions change from one intervention to the other. Beginning by addressing accuracy performances, we show that a 3D/2D registration based on radio-opaque fiducials is more adapted to our application constraints than other methods. Then, we outline a lack in their statistical assumptions which leads us to the derivation of a new extended 3D/2D criterion. Careful validation experiments on real data show that an accuracy of 2 mm can be achieved in clinically relevant conditions, and that our new criterion is up to 9% more accurate, while keeping a computation time compatible with real-time at 20 to 40 Hz.
After the fulfillment of our statistical hypotheses, we turn to safety issues. Propagating the data noise through both our criterion and the classical one, we obtain an explicit formulation of the registration error. As the real conditions do not always fit the theory, it is critical to validate our prediction with real data. Thus, we perform a rigorous incremental validation of each assumption using successively: synthetic data, real video images of a precisely known object, and finally real CT and video images of a soft phantom. Results point out that our error prediction is fully valid in our application range. Eventually, we provide an accurate Augmented Reality guidance system that allows the automatic detection of potentially inaccurate guidance.
Chapter PDF
References
Balter, J.M., Lam, K.L., McGinn, C.J., Lawrence, T.S., Ten Haken, R.K.: Improvement of CT-based treatment-planning models of abdominals targets using static exhale imaging. Int. J. Radiation Oncology Biol. Phys. 41(4), 939–943 (1998)
Soler, L., et al.: Fully automatic anatomical, pathological, and functional segmentation from CT-scans for hepatic surgery. Computer Aided Surgery 6(3) (2001)
Dhome, M., et al.: Determination of the attitude of 3D objects from a single perspective view. IEEE Trans. on PAMI 11(12), 1265–1278 (1989)
Haralick, R., et al.: Pose estimation from corresponding point data. IEEE Trans. on Systems, Man. and Cybernetics 19(06), 1426–1446 (1989)
Grimson, W., et al.: An automatic registration method for frameless stereotaxy, image-guided surgery and enhanced reality visualization. IEEE TMI 15(2), 129–140 (1996)
Fischler, M., Bolles, R.: Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Com. of the ACM 24(6), 381–395 (1981)
Ganapathy, S.: Decomposition of transformation matrices for robot vision. Pattern Recognition Letters 2(6), 401–412 (1984)
Grossmann, E., Santos-Victor, J.: Uncertainty analysis of 3D reconstruction from uncalibrated views. Image and Vision Computing 18, 685–696 (2000)
Hel-Or, Y., Werman, M.: Pose estimation by fusing noisy data of different dimensions. IEEE Trans. on PAMI 17(2), 195–201 (1995)
Lu, C., Hager, G.D., Mjolsness, E.: Fast and globally convergent pose estimation from video images. IEEE Trans. on PAMI 22(6), 610–622 (2000)
McGahan, J.F., Dodd III, G.D.: Radiofrequency ablation of the liver: Current status. American Journal of Roentgenology 176(1), 3–16 (2001)
Nicolau, S., Pennec, X., Soler, L., Ayache, N.: Evaluation of a new 3D/2D registration criterion for liver radio-frequencies guided by augmented reality. In: Ayache, N., Delingette, H. (eds.) IS4TM 2003. LNCS, vol. 2673, pp. 270–283. Springer, Heidelberg (2003)
Pennec, X., Guttmann, C.R.G., Thirion, J.-P.: Feature-based registration of medical images: Estimation and validation of the pose accuracy. In: Wells, W.M., Colchester, A.C.F., Delp, S.L. (eds.) MICCAI 1998. LNCS, vol. 1496, pp. 1107–1114. Springer, Heidelberg (1998)
Pennec, X., Thirion, J.-P.: A framework for uncertainty and validation of 3D registration methods based on points and frames. IJCV 25(3), 203–229 (1997)
Phong, T., Horaud, R., Tao, P.: Object pose from 2-D to 3-D points and line correspondences. IJCV 15, 225–243 (1995)
Press, W.H., Flannery, B.P., Teukolsky, S.A., Vetterling, W.T.: Numerical Recipices in C. Cambridge Univ. Press, Cambridge (1991)
Roche, A., Pennec, X., Malandain, G., Ayache, N.: Rigid registration of 3D ultrasound with MR images: a new approach combining intensity and gradient information. IEEE TMI 20(10), 1038–1049 (2001)
Salvi, J., Armangu, X., Batlle, J.: A comparative review of camera calibrating methods with accuracy evaluation. Pattern Recognition 35(7), 1617–1635 (2002)
Viola, P., Wells, W.M.: Alignment by maximization of mutual information. International Journal of Computer Vision 24(2), 137–154 (1997)
Wong, J., Sharpe, M., Jaffray, D., Kini, V., Robertson, J., Stromberg, J., Martinez, A.: The use of active breathing control (ABC) to reduce margin for breathing motion. Int. J. Radiation Oncology Biol. Phys. 44(4), 911–919 (1999)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Nicolau, S., Pennec, X., Soler, L., Ayache, N. (2004). An Accuracy Certified Augmented Reality System for Therapy Guidance. In: Pajdla, T., Matas, J. (eds) Computer Vision - ECCV 2004. ECCV 2004. Lecture Notes in Computer Science, vol 3023. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24672-5_7
Download citation
DOI: https://doi.org/10.1007/978-3-540-24672-5_7
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-21982-8
Online ISBN: 978-3-540-24672-5
eBook Packages: Springer Book Archive