Abstract
In recent years, development in non-invasive and painless medical imaging such as Computed Tomography (CT) or MRI (magnetic resonance imaging), has improved the process of diseases diagnosis and clarification, including tumours, cysts, injuries, and cancers. The full-body scanner with superior spatial resolution provides essential details of complicated anatomical structures for effective diagnostics. However, it is challenging for a physician in glance over a large data-set of over hundreds or even thousands of images (2D “slices” of the body). Consider a case when a doctor wants to view a patient’s CT or MRI scans for analysing, he needs to review and compare among many layers of 2D image stacks (many 2D slices make a 3D stack). If the patient is scanned multiple time (three consecutive months, for instance) to confirm the growth of the tumours, the dataset is turned to be 4D (time-stamp added). The manual analysing process is time-consuming, troublesome and labour-intensive. The innovation of Augmented Reality (AR) in the last few decades allows us to illuminate this problem. In this paper, we propose an AR technique which assists the doctor in instantly accessing and viewing a patient’s set of medical images quickly and easily. The doctor can use an optical head-mounted display such as the Google Glass, or a VR Headset such as the Samsung Gear VR, or a general smartphone such as the Apple iPhone X. He looks at one palm-sized AR Tag with patient’s document embedded with a QR code, and the smart device could detect and download the patient’s data using the decrypted QR code and display layers of CT or MRI images right on top of the AR tag. Looking in and out from the tag allows the doctor to see the above or below of the current viewing layer. Moreover, shifting the looking orientation left or right allows the doctor to see the same layer of images but in different timestamp (e.g. previous or next monthly scans). Our obtained results demonstrated that this technique enhances the diagnosing process, save cost and time for medical practice.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
CAT scans and PET scans are also common.
References
Azuma, R., Baillot, Y., Behringer, R., Feiner, S., Julier, S., MacIntyre, B.: Recent advances in augmented reality. IEEE Comput. Graph. Appl. 21(6), 34–47 (2001)
Azuma, R.T.: A survey of augmented reality. Presence Teleoperators Virtual Environ. 6(4), 355–385 (1997)
Bartlett, J.: The use of augmented reality in the operating room: a review
Carmigniani, J., Furht, B.: Augmented reality: an overview. In: Furht, B. (ed.) Handbook of Augmented Reality, pp. 3–46. Springer, New York (2011). https://doi.org/10.1007/978-1-4614-0064-6_1
Chang, Y.S., Nuernberger, B., Luan, B., Höllerer, T., O’Donovan, J.: Gesture-based augmented reality annotation. In: 2017 IEEE Virtual Reality (VR), pp. 469–470. IEEE (2017)
Douglas, D., Wilke, C., Gibson, J., Boone, J., Wintermark, M.: Augmented reality: advances in diagnostic imaging. Multimodal Technol. Interact. 1(4), 29 (2017)
Ferroli, P., et al.: Advanced 3-dimensional planning in neurosurgery. Neurosurgery 72(suppl\_1), A54–A62 (2013)
Fründ, J., Gausemeier, J., Matysczok, C., Radkowski, R.: Using augmented reality technology to support the automobile development. In: Shen, W., Lin, Z., Barthès, J.-P.A., Li, T. (eds.) CSCWD 2004. LNCS, vol. 3168, pp. 289–298. Springer, Heidelberg (2005). https://doi.org/10.1007/11568421_29
Ganokratanaa, T., Pumrin, S.: The vision-based hand gesture recognition using blob analysis. In: 2017 International Conference on Digital Arts, Media and Technology (ICDAMT), pp. 336–341. IEEE (2017)
Kaufmann, H., Schmalstieg, D.: Mathematics and geometry education with collaborative augmented reality. ACM (2002)
Li, Y., Wang, B., Gao, Y., Zhou, J.: Affine invariant point-set matching using convex hull bisection. In: 2016 International Conference on Digital Image Computing: Techniques and Applications (DICTA), pp. 1–8. IEEE (2016)
Nee, A.Y., Ong, S., Chryssolouris, G., Mourtzis, D.: Augmented reality applications in design and manufacturing. CIRP Ann. 61(2), 657–679 (2012)
Ong, S., Yuan, M., Nee, A.: Augmented reality applications in manufacturing: a survey. Int. J. Prod. Res. 46(10), 2707–2742 (2008)
Rehman, U., Cao, S.: Augmented-reality-based indoor navigation: a comparative analysis of handheld devices versus Google glass. IEEE Trans. Hum.-Mach. Syst. 47(1), 140–151 (2017)
Siegle, D.: Seeing is believing: using virtual and augmented reality to enhance student learning. Gift. Child Today 42(1), 46–52 (2019)
Soon, T.J.: QR code. Synth. J. 2008, 59–78 (2008)
Tawara, T., Ono, K.: A framework for volume segmentation and visualization using augmented reality. In: 2010 IEEE Symposium on 3D User Interfaces (3DUI), pp. 121–122. IEEE (2010)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Le, H., Nguyen, M., Yan, W.Q. (2020). A Web-Based Augmented Reality Approach to Instantly View and Display 4D Medical Images. In: Palaiahnakote, S., Sanniti di Baja, G., Wang, L., Yan, W. (eds) Pattern Recognition. ACPR 2019. Lecture Notes in Computer Science(), vol 12047. Springer, Cham. https://doi.org/10.1007/978-3-030-41299-9_54
Download citation
DOI: https://doi.org/10.1007/978-3-030-41299-9_54
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-41298-2
Online ISBN: 978-3-030-41299-9
eBook Packages: Computer ScienceComputer Science (R0)