Multi-modality registration of preoperative MR and intraoperative long-length tomosynthesis using GAN synthesis and 3D-2D registration

Y. Huang; X. Zhang; A. Johnston; C. K. Jones; J. H. Siewerdsen; W. Zbijewski; P. A. Helm; B. Judy; A. Sacino; A. Bydon; T. F. Witham; A. Uneri

doi:10.1117/12.2654329

3 April 2023 Multi-modality registration of preoperative MR and intraoperative long-length tomosynthesis using GAN synthesis and 3D-2D registration

Y. Huang, X. Zhang, A. Johnston, C. K. Jones, J. H. Siewerdsen, W. Zbijewski, P. A. Helm, B. Judy, A. Sacino, A. Bydon, T. F. Witham, A. Uneri

Author Affiliations +

Proceedings Volume 12466, Medical Imaging 2023: Image-Guided Procedures, Robotic Interventions, and Modeling; 124661G (2023) https://doi.org/10.1117/12.2654329
Event: SPIE Medical Imaging, 2023, San Diego, California, United States

Abstract

A new imaging modality (viz., Long-Film [LF]) for acquiring long-length tomosynthesis images of the spine was recently enabled on the O-arm™ system and used in an IRB-approved clinical study at our institution. The work presented here implements and evaluates a combined image synthesis and registration approach to solve multi-modality registration of MR and LF images. The approach is well-suited for pediatric cases that use MR for preoperative diagnosis and aim for lower levels of intraoperative radiation exposure. A patch-based conditional GAN was used to synthesize 3D CT images from MR. The network was trained on deformably co-registered MR and CT image pairs. Synthesized images were registered to LF images using a model-based 3D-2D registration algorithm. Images from our clinical study were manually labeled, and the intra-user variability in anatomical landmark definition was measured in a simulation study. Geometric accuracy of registrations was evaluated on anatomical landmarks in separate test cases from the clinical study. The synthesis process generated CT images with clear bone structures. Analysis of manual labeling revealed 3.1±2.2 mm projection distance error between 3D and 2D anatomical landmarks. Anatomical MR landmarks projected on lateral LF images demonstrated a median projection distance error of 3.6 mm after registration. This work constitutes the first reported approach for MR to LF registration based on deep image synthesis. Preliminary results demonstrated the feasibility of globally rigid registration in aligning preoperative MR and intraoperative LF images. Work currently underway extends this approach to vertebra level, locally rigid / globally deformable registrations, with initialization based on automatically labeled vertebrae levels.

Conference Presentation

Citation Download Citation

Y. Huang, X. Zhang, A. Johnston, C. K. Jones, J. H. Siewerdsen, W. Zbijewski, P. A. Helm, B. Judy, A. Sacino, A. Bydon, T. F. Witham, and A. Uneri "Multi-modality registration of preoperative MR and intraoperative long-length tomosynthesis using GAN synthesis and 3D-2D registration", Proc. SPIE 12466, Medical Imaging 2023: Image-Guided Procedures, Robotic Interventions, and Modeling, 124661G (3 April 2023); https://doi.org/10.1117/12.2654329

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available