Abstract
When compared to other imaging modalities, the acquisition and interpretation of ultrasound data is challenging for new users. The main aim of this work is to investigate whether augmented reality can provide a patient specific correspondence between the ultrasound image and a virtual anatomic model of the heart and thus simplify the live echocardiographic scanning process.
The proposed augmented view contains the image of the scene (acquired with a tablet’s camera), a generic heart model and the ultrasound image plane. The position and orientation of the ultrasound probe and patient are tracked with the Vuforia framework, using fiducial markers that are visible on the tablet’s camera image. A customized renderer for augmentation purposes was implemented in OpenGL ES. Data streaming from a high end ultrasound scanner to the tablet device was implemented and the position of the heart model is continuously updated to match the ultrasound data by tracking and matching a set of anatomic landmarks. The prototype was tested in the echo laboratory and real-time performance was achievable as no significant lag between the scanner image and the one presented on the tablet was experienced. Furthermore the suitability of Vuforia for fiducial tracking was evaluated and was deemed sufficiently accurate for this application. The presented prototype was tested by an experienced echocardiographer and was considered beneficial for both teaching purposes and as a help tool for inexperienced ultrasound users.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Bajura, M., Fuchs, H., Ohbuchi, R.: Merging virtual objects with the real world: seeing ultrasound imagery within the patient. ACM SIGGRAPH Comput. Graph. 26(2), 203–210 (1992)
Bluteau, J., Kitahara, I., Kameda, Y., Noma, H., Kogure, K., Ohta, Y.: Visual support for medical communication by using projector-based augmented reality and thermal markers. In: Proceedings of the International Conference on Augmented Tele-Existence, pp. 98–105 (2005)
Ford, S., Viola, I., Bruckner, S., Torp, H., Kiss, G.: Heartpad: real-time visual guidance for cardiac ultrasound. In: Proceedings of the Workshop at SIGGRAPH Asia, pp. 169–176 (2012). http://www.cg.tuwien.ac.at/research/publications/2012/Ford-2012-HRV/
Harders, M., Bianchi, G., Knoerlein, B.: Multimodal augmented reality in medicine. In: Stephanidis, C. (ed.) UAHCI 2007 (Part II). LNCS, vol. 4555, pp. 652–658. Springer, Heidelberg (2007)
Kalkofen, D., Reitinger, B., Risholm, P., Bornik, A.: Integrated medical workflow for augmented reality applications. In: Proceedings of the International Workshop on Augmented environments for Medical Imaging and Computer-aided Surgery (2006)
Kimura, B.J., DeMaria, A.N.: Technology insight: hand-carried ultrasound cardiac assessment-evolution, not revolution. Nat. Clin. Pract. Cardiovasc. Med. 2(4), 217–223 (2005). quiz 224. http://dx.doi.org/10.1038/ncpcardio0154
Orderud, F., Torp, H., Rabben, S.: Automatic alignment of standard views in 3D echocardiograms using real-time tracking. In: Procedings of the SPIE, vol. 7265, p. 72650D (2009)
State, A., Livingston, M., Garrett, W., Hirota., G., Whitton, M., Pisano, E., Fuchs, H.: Technologies for augmented reality systems: realizing ultrasound-guided needle biopsies. In: Proceedings of ACM SIGGRAPH, pp. 439–446 (1998)
Stetten, G., Chib, V.: Overlaying ultrasonographic images on direct vision. J. Ultrasound Med. 20(3), 235–240 (2001)
Stetten, G., Chib, V., Tamburo, R.: Tomographic reflection to merge ultrasound images with direct vision. In: Proceedings of the IEEE Workshop on Applied Imagery Pattern Recognition, pp. 200–205 (2000)
StĂ¼deli, T., Kalkofen, D., Risholm, P., Ali, W., Freudenthal, A., Samset, E.: Visualization tool for improved accuracy in needle placement during percutaneous radio-frequency ablation of liver tumors. Proceedings of the SPIE, vol. 6918, p. 69180B (2008)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Kiss, G., Palmer, C.L., Torp, H. (2015). Patient Adapted Augmented Reality System for Real-Time Echocardiographic Applications. In: Linte, C., Yaniv, Z., Fallavollita, P. (eds) Augmented Environments for Computer-Assisted Interventions. AE-CAI 2015. Lecture Notes in Computer Science(), vol 9365. Springer, Cham. https://doi.org/10.1007/978-3-319-24601-7_15
Download citation
DOI: https://doi.org/10.1007/978-3-319-24601-7_15
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-24600-0
Online ISBN: 978-3-319-24601-7
eBook Packages: Computer ScienceComputer Science (R0)