Skip to main content
SpringerLink
Log in

Cascading Affine and B-spline Registration Method for Large Deformation Registration of Lung X-rays

  • Original Paper
  • Published:
Journal of Digital Imaging Aims and scope Submit manuscript

Abstract

Accurate registration of lung X-rays is an important task in medical image analysis. However, the conventional methods usually cost a lot in running time, and the existing deep learning methods are hard to deal with the large deformation caused by respiratory and cardiac motion. In this paper, we attempt to use deep learning methods to deal with large deformation and enable it to achieve the accuracy of conventional methods. We proposed the cascading affine and B-spline network (CABN), which consists of convolutional cross-stitch affine block (CCAB) and B-splines U-net-like block (BUB) for large lung motion. CCAB makes use of the convolutional cross-stitch model to learn global features among images. And BUB adopts the idea of cubic B-splines which is suitable for large deformation. We separately demonstrated CCAB, BUB, and CABN on two chest X-ray datasets. The experimental results indicate that our methods are highly competitive both in accuracy and runtime when compared to both other deep learning methods and iterative conventional approaches. Moreover, CCAB also can be used for the preprocessing of non-rigid registration methods, replacing affine in conventional methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17

Similar content being viewed by others

Data Availability

The data that support the findings of this study are available at https://doi.org/10.1109/CVPR.2017.369.

References

  1. Haskins G, Kruger U, Yan P: Deep learning in medical image registration: a survey. J Machine Vision and Applications, 31(1): 1-18, 2020

    Google Scholar 

  2. Oliveira FPM, Tavares JMRS: Medical image registration: a review. J Computer methods in biomechanics and biomedical engineering, 17(2): 73-93, 2014.

    Article  Google Scholar 

  3. Hering A, Häger S, Moltz J, et al: CNN-based lung CT registration with multiple anatomical constraints. J Medical Image Analysis, 72: 102139, 2021.

    Article  Google Scholar 

  4. Murphy K, Van Ginneken B, Reinhardt J M, et al: Evaluation of registration methods on thoracic CT: the EMPIRE10 challenge. J IEEE transactions on medical imaging, 30(11): 1901-1920, 2011.

    Article  Google Scholar 

  5. Regan E A, Hokanson J E, Murphy J R, et al. Genetic epidemiology of COPD (COPDGene) study design. J COPD: Journal of Chronic Obstructive Pulmonary Disease, 7(1): 32-43, 2011.

    Article  Google Scholar 

  6. Krizhevsky A, Sutskever I, Hinton GE: Imagenet classification with deep convolutional neural networks. J Advances in neural information processing systems, 25: 1097-1105, 2012.

    Google Scholar 

  7. Balakrishnan G, Zhao A, Sabuncu MR, et al: VoxelMorph: a learning framework for deformable medical image registration J IEEE Transactions on Medical Imaging:1788–1800, 2019.

  8. Mok TCW, Chung ACS: Fast symmetric diffeomorphic image registration with convolutional neural networks in: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. IEEE, USA, Seattle, 4644–4653, 2020.

  9. Sun K, Simon S: FDRN: A fast deformable registration network for medical images. J Medical Physics, 48(10): 6453-6463, 2021.

    Article  Google Scholar 

  10. Kim B, Kim DH, Park SH, et al: CycleMorph: cycle consistent unsupervised deformable image registration. J Medical Image Analysis, 71: 102036, 2021.

    Article  Google Scholar 

  11. Mok TCW, Chung ACS: Large deformation diffeomorphic image registration with Laplacian pyramid networks in: International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer, Peru, Lima, 211–221, 2020.

  12. Vercauteren T, Pennec X, Perchant A, et al: Diffeomorphic Demons: efficient non-parametric image registration. J NeuroImage, 45(1): S61-S72, 2009.

    Article  Google Scholar 

  13. Avants BB, Tustison NJ, Song G, et al: A reproducible evaluation of ANTs similarity metric performance in brain image registration. J Neuroimage, 54(3): 2033-2044, 2011.

    Article  Google Scholar 

  14. Shen D: Image registration by local histogram matching. J Pattern Recognition, 40(4): 1161-1172, 2007.

    Article  Google Scholar 

  15. Klein S, Staring M, Murphy K, et al: Elastix: a toolbox for intensity-based medical image registration. J IEEE transactions on medical imaging, 29(1): 196-205, 2009.

    Article  Google Scholar 

  16. De Vos BD, Berendsen FF, Viergever MA, et al: A deep learning framework for unsupervised affine and deformable image registration. J Medical image analysis, 52:128-143, 2019.

    Article  Google Scholar 

  17. Hu Y, Modat M, Gibson E, et al: Label-driven weakly-supervised learning for multimodal deformable image registration in: 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018). IEEE, USA, Washington, D.C., 1070–1074, 2018.

  18. Zhao S, Dong Y, Chang EI, et al: Recursive cascaded networks for unsupervised medical image registration in: Proceedings of the IEEE/CVF International Conference on Computer Vision. IEEE, Korea, Seoul, 10600–10610, 2019.

  19. He X, Guo J, Zhang X, et al: Recursive Refinement Network for Deformable Lung Registration between Exhale and Inhale CT Scans. J 2021. https://doi.org/10.48550/arXiv.2106.07608.

  20. Rueckert D, Sonoda LI, Hayes C, et al: Nonrigid registration using free-form deformations: application to breast MR images. J IEEE transactions on medical imaging, 18(8): 712-721, 1999.

    Article  CAS  Google Scholar 

  21. Sdika M: A fast nonrigid image registration with constraints on the Jacobian using large scale constrained optimization. J IEEE transactions on medical imaging, 27(2): 271-281, 2008.

    Article  Google Scholar 

  22. Yin Y, Hoffman EA, Lin CL: Mass preserving nonrigid registration of CT lung images using cubic B‐spline. J Medical physics, 36(9Part1): 4213–4222, 2009.

  23. Shackleford J, Kandasamy N, Sharp G: High performance deformable image registration algorithms for manycore processors, San Francisco: Morgan Kaufmann, 2013.

    Google Scholar 

  24. Chen X, Meng Y, Zhao Y, et al: Learning unsupervised parameter-specific affine transformation for medical images registration in: International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer, 24–34, 2021. https://doi.org/10.1007/978-3-030-87202-1_3.

  25. Mok T C W, Chung A. Conditional deformable image registration with convolutional neural network in: International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer, 35–45, 2021. https://doi.org/10.1007/978-3-030-87202-1_4.

  26. Shu Y, Wang H, Xiao B, et al: Medical image registration based on uncoupled learning and accumulative enhancement in: International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer, 3–13, 2021. https://doi.org/10.1007/978-3-030-87202-1_1.

  27. Thirion JP. Image matching as a diffusion process: an analogy with Maxwell’s Demons. J Medical image analysis, 2(3): 243-260, 1998.

    Article  CAS  Google Scholar 

  28. Wang X, Peng Y, Lu L, et al: ChestX-ray8: Hospital-scale chest x-ray database and benchmarks on weakly-supervised classification and localization of common thorax diseases in: IEEE CVPR. IEEE, USA, Hawai, 2097–2106, 2017.

  29. Mahapatra D, Ge Z, Sedai S, et al: Joint registration and segmentation of xray images using generative adversarial networks in: International Workshop on Machine Learning in Medical Imaging. Springer, Spain, Granada, 73–80, 2018.

  30. Avants BB, Epstein CL, Grossman M, et al: Symmetric diffeomorphic image registration with cross-correlation: evaluating automated labeling of elderly and neurodegenerative brain. J Medical image analysis, 12(1): 26-41, 2008.

    Article  CAS  Google Scholar 

  31. Rueckert D, Aljabar P, Heckemann RA, et al: Diffeomorphic registration using B-splines in: International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer, Germany, Berlin, 702–709, 2006.

  32. Choi Y, Lee S: Injectivity conditions of 2D and 3D uniform cubic B-spline functions. J Graphical models, 62(6): 411-427, 2000.

    Article  Google Scholar 

  33. Zhao S, Lau T, Luo J, et al: Unsupervised 3D end-to-end medical image registration with volume tweening network. J IEEE journal of biomedical and health informatics, 24(5): 1394-1404, 2019.

    Article  PubMed  Google Scholar 

Download references

Funding

This work was supported by the National Natural Science Foundation of China under award number 61976091.

Author information

Authors and Affiliations

  1. School of Information Science and Engineering, East China University of Science and Technology, Shanghai, China

    Qing Chang, Chenhao Lu & Mengke Li

Authors
  1. Qing Chang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Chenhao Lu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mengke Li
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Qing Chang.

Ethics declarations

Ethics Approval

This is an observational study.

Conflict of Interest

The authors declare no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chang, Q., Lu, C. & Li, M. Cascading Affine and B-spline Registration Method for Large Deformation Registration of Lung X-rays. J Digit Imaging 36, 1262–1278 (2023). https://doi.org/10.1007/s10278-022-00763-z

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10278-022-00763-z

Keywords

Search

Navigation