Abstract
Throughout the past several years, the new technologies and enhancements related to medical visualization has been more than fascinating. In this study, we discuss a proposed idea of a handheld or a mobile Augmented Reality (AR) application. This application will ease the process of medical visualization. The criticality of a faulty medical imaging diagnosis could lead to severe consequences and outcomes to patients’ health. This criticality is what ignites new ideas to improve medical imaging. The proposed AR application will help doctors and radiologists in their daily basis. Still most doctors, surgeons, and radiologists use two-dimensional (2D) slices to visualize patients’, which is quite hard to image and map the 3D structure of a human anatomical structure with just 2D plain images. This process requires a lot of experience which sometimes might not be enough. It will help physicians by visualizing patients’ scans such as Computed Tomography (CT) or Magnetic Resonance Imaging (MRI) to be rendered as a three-dimensional (3D) object and not as a 2D object. Using the AR technology makes it much more straightforward in observing the rendered object. The proposed application reads a medical image file(s) such as CT or MRI files and renders its data as a 3D model in real world space, by using a volume rendering technique called ray-tracing. This technique works by reading data from a selected file or dataset. After reading a file, the technique traces a ray into object space from each pixel. Afterwards, it accumulates and calculates the color and opacity values of pixels along each ray. The Final step is to assign the values to its corresponding pixels. By completing this process, a selected dataset is rendered as a 3D object into real world space. With AR technology, seeing and interacting with the 3D object is much easier for the users. The expected outcomes of this study are to improve the process of pre-surgery medical images visualization. With interactive buttons and controllers included in the application and the use of several options like decreasing opacity, clipping, zooming, rotation, threshold … etc. will give more control to the users. Moreover, the proposed application enables users to customize his views to get the best of the 3D object for better visualization. This study discusses the in development mobile AR application that could be used as a new, more facilitating method of visualizing medical images. The application will deliver a more feasible way of interacting with visualized medical images, with buttons and sliders and virtual joysticks creating a better user experience (UX).
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Abou El-Seoud, S., Mady, A., Rashed, E.: An interactive mixed reality ray tracing rendering mobile application of medical data in minimally invasive surgeries. Int. J. Interact. Mobile Technol. (iJIM) 13(03), 29 (2019)
Vavra, P., et al.: Recent development of augmented reality in surgery: a review. J. Health Eng. 2017, 4574172 (2017)
De Paolis, L.T., Aloisio, G.: Augmented reality in minimally invasive surgery. In: Advances in Biomedical Sensing, Measurements, Instrumentation and Systems, pp. 305–320. Springer (2010)
Dicomstandard.org: DICOM Standard (2019). https://www.dicomstandard.org/. Accessed 14 Jul 2019
Google Developers: ARCore overview | ARCore | Google Developers (2019). https://developers.google.com/ar/discover/. Accessed 14 Jul 2019
Udupa, J.K., Goncalves, R.J.: Medical image rendering. Am. J. Card. Imaging 7(3), 154–163 (1993)
What is a Volume Pixel (Volume Pixel or Voxel)? - Definition from Techopedia. https://www.techopedia.com/
Volume ray casting. En.wikipedia.org (2017). https://en.wikipedia.org/wiki/Volume_ray_casting
Möller, T.: Direct Volume Rendering. University of Vienna
Komura, T.: Volume Rendering, Visualization – Lecture 10. The University of Edinburgh (2008)
Wieczorek, M., et al.: GPU-accelerated Rendering for Medical Augmented Reality in Minimally-invasive Procedures. Bildverarbeitung für die Medizin 574, 102–106 (2010)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Mady, A.S., Abou El-Seoud, S. (2021). An Interactive Augmented Reality Volume Rendering Mobile Application. In: Auer, M.E., Tsiatsos, T. (eds) Internet of Things, Infrastructures and Mobile Applications. IMCL 2019. Advances in Intelligent Systems and Computing, vol 1192. Springer, Cham. https://doi.org/10.1007/978-3-030-49932-7_82
Download citation
DOI: https://doi.org/10.1007/978-3-030-49932-7_82
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-49931-0
Online ISBN: 978-3-030-49932-7
eBook Packages: EngineeringEngineering (R0)