Enrique Castelan
ABSTRACT
Immediate care for trauma wounded patients in austere or remote settings makes medical knowledge, skills, and efficiency of the on-duty medical professional paramount. For wounds that extend deep into internal anatomy, proper visualization of internal anatomy can enable more efficient and effective evaluation when presented to medical providers positioned close to the point of injury (POI). In this paper, a conceptual Augmented Reality (AR) surgical tool is presented to provide visualization of internal human anatomy, superimposed on the view of a patient, to assist medical providers for immediate casualty care. This AR surgical tool can play a role in 3D surgery or treatment planning as a navigational aid in preparing medical interventions and enhancing surgery or treatment procedures by displaying otherwise obscured anatomy and nearby vessels. Critical software and hardware components are integrated to construct a prototype AR system for the portable AR surgical visualization tool. The system uses a Microsoft HoloLens 1 and an Azure Kinect camera for simultaneous body-tracking and anatomy overlay to demonstrate the overall concept. Future extension of this work will aim to create a more accurate and compact prototype system that utilizes HoloLens 2 with an embedded Kinect camera for laboratory and field tests of its use in surgery assistance. Such an AR tool can also serve as a training tool for medical caregivers, applied with a human subject or a medical manikin.
- T. Peters, Mixed and Augmented Reality in Medicine. Boca Raton, FL, USA: CRC Press, 2019.Google Scholar
- ]N. Mitsuhashi, K. Fujieda, T. Tamura, S. Kawamoto, T. Takagi, and K. Okubo, “BodyParts3D: 3D structure database for anatomical concepts,” Nucleic Acids Res., vol. 37, no. SUPPL. 1, pp. 782–785, 2009.Google ScholarCross Ref
- Azure Kinect DK documentation. https://docs.microsoft.com/en-us/azure/kinect-dk/Google Scholar
- MicrosoftResearch. Body Part Recognition and the Development of Kinect. (Jun. 21, 2016). Accessed: Apr. 12, 2021. Available: https://www.youtube.com/watch?v=QPYf6pXe_4Q.Google Scholar
Recommendations
Simulator Sickness in Augmented Reality Training Using the Microsoft HoloLens
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing SystemsAugmented Reality is on the rise with consumer-grade smart glasses becoming available in recent years. Those interested in deploying these head-mounted displays need to understand better the effect technology has on the end user. One key aspect ...
HoloLens-based Mixed Reality Experiences for Subjects with Alzheimer's Disease
CHItaly '17: Proceedings of the 12th Biannual Conference on Italian SIGCHI ChapterHoloLens technology enables mixed reality experiences that integrate holographic objects into the real world in which the mixed reality head-mounted device is used. Since HoloLens' launch in March 2016, some mixed-reality applications of this technology ...
A HoloLens Based Augmented Reality Navigation System for Minimally Invasive Total Knee Arthroplasty
Intelligent Robotics and ApplicationsAbstractIn minimally invasive total knee arthroplasty (MIS-TKA), it is difficult to obtain a global vision of the surgical site in the course of surgery without using X-ray imaging, which brings radiation hazard. To provide the surgeon with accurate image ...
Comments