Isabela Figueira
ABSTRACT
In recent years, medical research has made extensive use of Augmented Reality (AR) for visualization. These visualizations provide improved 3D understanding and depth perception for surgeons and medical staff during surgical planning, medical training, and procedures. Often, AR in medicine involves impractical and extensive instrumentation in order to provide the precision needed for clinical use. We propose a mobile AR 3D model registration system for use in a practical, non-instrumented hospital setting. Our registration system takes as input a patient-specific model and overlays it on the patient using an accurate pose registration technique that requires a single marker as a point of reference to initialize a point cloud-based pose refinement technique. Our method is automatic, easy to use, and runs in real-time on a mobile phone. We conduct quantitative and qualitative analysis of the registration. The results confirm that our AR pose registration system produces an accurate and visually correct overlay of the medical data in real-time.
Supplemental Material
Available for Download
- D. Amiras, T. J. Hurkxkens, D. Figueroa, P. J Pratt, B. Pitrola, C. Watura, S. Rostampour, G. J. Shimshon, and M. Hamady. 2021. Augmented reality simulator for CT-guided interventions. European Radiology 31 (June 2021), 8897–8902. https://doi.org/10.1007/s00330-021-08043-0Google Scholar
Cross Ref
- P.J. Besl and Neil D. McKay. 1992. A method for registration of 3-D shapes. IEEE Transactions on Pattern Analysis and Machine Intelligence 14, 2 (Feb. 1992), 239–256. https://doi.org/10.1109/34.121791 Conference Name: IEEE Transactions on Pattern Analysis and Machine Intelligence.Google ScholarDigital Library
- Cirurgic3D. 2021. Left Kidney with tumor and cyst (A.R.T.C.). Sketchfab.com. Retrieved July 7, 2022 from https://sketchfab.com/3d-models/left-kidney-with-tumor-and-cyst-artc-600b01d068a44fe3829a159b75f7dfbcGoogle Scholar
- Antoine Petit, Vincenzo Lippiello, and Bruno Siciliano. 2015. Real-time tracking of 3D elastic objects with an RGB-D sensor. In 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, Hamburg, Germany, 3914–3921. https://doi.org/10.1109/IROS.2015.7353928Google ScholarDigital Library
- Max Schneider, Christian Kunz, Andrej Pal’a, Christian Rainer Wirtz, Franziska Mathis-Ullrich, and Michal Hlaváč. 2021. Augmented reality–assisted ventriculostomy. Neurosurgical Focus 50, 1 (Jan. 2021), E16. https://doi.org/10.3171/2020.10.FOCUS20779Google ScholarCross Ref
- Junchen Wang, Hideyuki Suenaga, Kazuto Hoshi, Liangjing Yang, Etsuko Kobayashi, Ichiro Sakuma, and Hongen Liao. 2014. Augmented Reality Navigation With Automatic Marker-Free Image Registration Using 3-D Image Overlay for Dental Surgery. IEEE Transactions on Biomedical Engineering 61, 4 (April 2014), 1295–1304. https://doi.org/10.1109/TBME.2014.2301191 Conference Name: IEEE Transactions on Biomedical Engineering.Google ScholarCross Ref
Index Terms
- Augmented Reality Patient-Specific Registration for Medical Visualization
Recommendations
NextMed, Augmented and Virtual Reality platform for 3D medical imaging visualization: Explanation of the software platform developed for 3D models visualization related with medical images using Augmented and Virtual Reality technology
TEEM'19: Proceedings of the Seventh International Conference on Technological Ecosystems for Enhancing MulticulturalityThe visualization of the radiological results with more advanced techniques than the current ones, such as Augmented Reality and Virtual Reality technologies, represent a great advance for medical professionals, by eliminating their imagination capacity ...
Inverse visualization concept for RGB-D augmented C-arms
X-ray is still the essential imaging for many minimally-invasive interventions. Overlaying X-ray images with an optical view of the surgery scene has been demonstrated to be an efficient way to reduce radiation exposure and surgery time. However, ...
A Semi-automatic Markerless Augmented Reality Approach for On-Patient Volumetric Medical Data Visualization
ISDEA '14: Proceedings of the 2014 Fifth International Conference on Intelligent Systems Design and Engineering ApplicationsIn general, augmented reality (AR) applications use polygonal models to augment a real scene. However, most of the medical applications have volumetric data to be visualized. Therefore, it is desirable to the medical AR systems to provide the ...
Comments