Skip to main content
Springer Nature Link
Log in

MomentaMorph: Unsupervised Spatial-Temporal Registration with Momenta, Shooting, and Correction

  • Conference paper
  • First Online:
Medical Image Computing and Computer Assisted Intervention – MICCAI 2023 Workshops (MICCAI 2023)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 14394))

  • 644 Accesses

Abstract

Tagged magnetic resonance imaging (tMRI) has been employed for decades to measure the motion of tissue undergoing deformation. However, registration-based motion estimation from tMRI is difficult due to the periodic patterns in these images, particularly when the motion is large. With a larger motion the registration approach gets trapped in a local optima, leading to motion estimation errors. We introduce a novel “momenta, shooting, and correction" framework for Lagrangian motion estimation in the presence of repetitive patterns and large motion. This framework, grounded in Lie algebra and Lie group principles, accumulates momenta in the tangent vector space and employs exponential mapping in the diffeomorphic space for rapid approximation towards true optima, circumventing local optima. A subsequent correction step ensures convergence to true optima. The results on a 2D synthetic dataset and a real 3D tMRI dataset demonstrate our method’s efficiency in estimating accurate, dense, and diffeomorphic 2D/3D motion fields amidst large motion and repetitive patterns.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    See Appendix ?? for more details on simulation and training.

  2. 2.

    See Appendix ?? for additional visual results.

References

  1. Arsigny, V., Commowick, O., Pennec, X., Ayache, N.: A log-Euclidean framework for statistics on diffeomorphisms. In: Larsen, R., Nielsen, M., Sporring, J. (eds.) MICCAI 2006. LNCS, vol. 4190, pp. 924–931. Springer, Heidelberg (2006). https://doi.org/10.1007/11866565_113

  2. Axel, L., Dougherty, L.: Heart wall motion: improved method of spatial modulation of magnetization for MR imaging. Radiology 172(2), 349–350 (1989)

    Article  Google Scholar 

  3. Axel, L., Dougherty, L.: MR imaging of motion with spatial modulation of magnetization. Radiology 171(3), 841–845 (1989)

    Article  Google Scholar 

  4. Baker, H.F.: Abel’s Theorem and the Allied Theory: Including the Theory of the Theta Functions. University Press (1897)

    Google Scholar 

  5. Balakrishnan, G., Zhao, A., Sabuncu, M.R., Guttag, J., Dalca, A.V.: Voxelmorph: a learning framework for deformable medical image registration. IEEE TMI 38(8), 1788–1800 (2019)

    Google Scholar 

  6. Beg, M.F., Miller, M.I., Trouvé, A., Younes, L.: Computing large deformation metric mappings via geodesic flows of diffeomorphisms. IJCV 61, 139–157 (2005)

    Article  Google Scholar 

  7. Bian, Z., Jabri, A., Efros, A.A., Owens, A.: Learning pixel trajectories with multiscale contrastive random walks. In: CVPR, pp. 6508–6519 (2022)

    Google Scholar 

  8. Bian, Z., et al.: Drimet: deep registration for 3d incompressible motion estimation in tagged-MRI with application to the tongue. arXiv preprint arXiv:2301.07234 (2023)

  9. Bian, Z., Zhong, J., Hatt, C.R., Burris, N.S.: A deformable image registration based method to assess directionality of thoracic aortic aneurysm growth. In: Medical Imaging 2021: Image Processing, vol. 11596, pp. 724–731. SPIE (2021)

    Google Scholar 

  10. Burris, N.S., et al.: Vascular deformation mapping for CT surveillance of thoracic aortic aneurysm growth. Radiology 302(1), 218–225 (2022)

    Google Scholar 

  11. Campbell, J.E.: A Course of Differential Geometry. Clarendon Press (1926)

    Google Scholar 

  12. Chen, J., et al.: A survey on deep learning in medical image registration: new technologies, uncertainty, evaluation metrics, and beyond. arXiv preprint arXiv:2307.15615 (2023)

  13. Christensen, G.E., Rabbitt, R.D., Miller, M.I.: Deformable templates using large deformation kinematics. IEEE TMI 5(10), 1435–1447 (1996)

    Google Scholar 

  14. Dalca, A.V., Balakrishnan, G., Guttag, J., Sabuncu, M.R.: Unsupervised learning for fast probabilistic diffeomorphic registration. In: Frangi, A.F., Schnabel, J.A., Davatzikos, C., Alberola-López, C., Fichtinger, G. (eds.) MICCAI 2018. LNCS, vol. 11070, pp. 729–738. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-00928-1_82

  15. Hall, B.C.: Lie groups, lie algebras, and representations. In: Quantum Theory for Mathematicians. GTM, vol. 267, pp. 333–366. Springer, New York (2013). https://doi.org/10.1007/978-1-4614-7116-5_16

  16. Hering, A., Häger, S., Moltz, J., Lessmann, N., Heldmann, S., van Ginneken, B.: CNN-based lung CT registration with multiple anatomical constraints. Med. Image Anal. 72, 102139 (2021)

    Article  Google Scholar 

  17. Horn, B.K., Schunck, B.G.: Determining optical flow. Artif. Intell. 17(1–3), 185–203 (1981)

    Article  Google Scholar 

  18. Ibrahim, E.S.H.: Myocardial tagging by cardiovascular magnetic resonance: evolution of techniques-pulse sequences, analysis algorithms, and applications. J. Cardiovasc. Magn. Reson. 13(1), 1–40 (2011)

    Article  Google Scholar 

  19. Jenkinson, M.: Fast, automated. N-dimensional phase-unwrapping algorithm. Mag. Reson. Med. 49(1), 193–197 (2003)

    Google Scholar 

  20. Jia, X., Bartlett, J., Zhang, T., Lu, W., Qiu, Z., Duan, J.: U-net vs transformer: is U-net outdated in medical image registration? In: Lian, C., Cao, X., Rekik, I., Xu, X., Cui, Z. (eds.) MICCAI 2022, pp. 151–160. Springer, Cham (2022). https://doi.org/10.1007/978-3-031-21014-3_16

  21. Jonschkowski, R., Stone, A., Barron, J.T., Gordon, A., Konolige, K., Angelova, A.: What matters in unsupervised optical flow. In: Vedaldi, A., Bischof, H., Brox, T., Frahm, J.-M. (eds.) ECCV 2020. LNCS, vol. 12347, pp. 557–572. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-58536-5_33

  22. Knutsen, A.K., et al.: Improved measurement of brain deformation during mild head acceleration using a novel tagged MRI sequence. J. Biomech. 47(14), 3475–3481 (2014)

    Google Scholar 

  23. Liu, X., Prince, J.L.: Shortest path refinement for motion estimation from tagged MR images. IEEE TMI 29(8), 1560–1572 (2010)

    Google Scholar 

  24. Liu, Y., Zuo, L., Han, S., Xue, Y., Prince, J.L., Carass, A.: Coordinate translator for learning deformable medical image registration. In: Li, X., Lv, J., Huo, Y., Dong, B., Leahy, R.M., Li, Q. (eds.) Multiscale Multimodal Medical Imaging: Third International Workshop, MMMI 2022, Held in Conjunction with MICCAI 2022, pp. 98–109. Springer, Cham (2022). https://doi.org/10.1007/978-3-031-18814-5_10

  25. Mansi, T., Pennec, X., Sermesant, M., Delingette, H., Ayache, N.: iLogDemons: a demons-based registration algorithm for tracking incompressible elastic biological tissues. Int. J. Comput. Vision 92(1), 92–111 (2011)

    Article  Google Scholar 

  26. Osman, N.F., Kerwin, W.S., McVeigh, E.R., Prince, J.L.: Cardiac motion tracking using CINE harmonic phase (HARP) magnetic resonance imaging. Mag. Reson. Med. 42(6), 1048–1060 (1999)

    Article  Google Scholar 

  27. Rohlfing, T., Maurer, C.R., Bluemke, D.A., Jacobs, M.A.: Volume-preserving nonrigid registration of MR breast images using free-form deformation with an incompressibility constraint. IEEE TMI 22(6), 730–741 (2003)

    Google Scholar 

  28. Shao, M., et al.: Analysis of tongue muscle strain during speech from multimodal magnetic resonance imaging. J. Speech Lang. Hear. Res. 66(2), 513–526 (2023)

    Google Scholar 

  29. Spoorthi, G., Gorthi, S., Gorthi, R.K.S.S.: Phasenet: a deep convolutional neural network for two-dimensional phase unwrapping. IEEE Signal Process. Lett. 26(1), 54–58 (2018)

    Article  Google Scholar 

  30. Stone, A., Maurer, D., Ayvaci, A., Angelova, A., Jonschkowski, R.: Smurf: self-teaching multi-frame unsupervised raft with full-image warping. In: CVPR, pp. 3887–3896 (2021)

    Google Scholar 

  31. Vialard, F.X., Risser, L., Rueckert, D., Cotter, C.J.: Diffeomorphic 3d image registration via geodesic shooting using an efficient adjoint calculation. Int. J. Comput. Vision 97, 229–241 (2012)

    Article  MathSciNet  Google Scholar 

  32. Wang, K., Kemao, Q., Di, J., Zhao, J.: Deep learning spatial phase unwrapping: a comparative review. Adv. Photon. Nexus 1(1), 014001 (2022)

    Article  Google Scholar 

  33. Xing, F., et al.: Phase vector incompressible registration algorithm for motion estimation from tagged magnetic resonance images. IEEE TMI 36(10), 2116–2128 (2017)

    Google Scholar 

  34. Ye, M., et al.: Deeptag: an unsupervised deep learning method for motion tracking on cardiac tagging magnetic resonance images. In: CVPR, pp. 7261–7271 (2021)

    Google Scholar 

  35. Yu, J., et al.: New starting point registration method for tagged MRI tongue motion estimation. In: Medical Imaging 2023: Image Processing. SPIE (2023)

    Google Scholar 

  36. Zhang, M., Lucas, J., Ba, J., Hinton, G.E.: Lookahead optimizer: k steps forward, 1 step back. Adv. Neural Inf. Process. Syst. 32 (2019)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Johns Hopkins University, Baltimore, MD, USA

    Zhangxing Bian, Shuwen Wei, Yihao Liu, Aaron Carass & Jerry L. Prince

  2. Johns Hopkins School of Medicine, Baltimore, MD, USA

    Junyu Chen

  3. Massachusetts General Hospital and Harvard Medical School, Boston, MA, USA

    Fangxu Xing & Jonghye Woo

  4. University of Maryland School of Medicine, Baltimore, MD, USA

    Jiachen Zhuo

Authors
  1. Zhangxing Bian
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Shuwen Wei
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yihao Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Junyu Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Jiachen Zhuo
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Fangxu Xing
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Jonghye Woo
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Aaron Carass
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Jerry L. Prince
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zhangxing Bian .

Editor information

Editors and Affiliations

  1. Harvard Medical School, Massachusetts General Hospital, Boston, MA, USA

    Jonghye Woo

  2. Radboud University Nijmegen Medical Center, Nijmegen, The Netherlands

    Alessa Hering

  3. The Netherlands Cancer Institute, Amsterdam, The Netherlands

    Wilson Silva

  4. Harvard Medical School, Massachusetts General Hospital, Boston, MA, USA

    Xiang Li

  5. A*STAR, Institute of High Performance Computing, Singapore, Singapore

    Huazhu Fu

  6. Harvard Medical School, Massachusetts General Hospital, Boston, MA, USA

    Xiaofeng Liu

  7. Harvard Medical School, Massachusetts General Hospital, Boston, MA, USA

    Fangxu Xing

  8. University of Maryland Baltimore County, Baltimore, MD, USA

    Sanjay Purushotham

  9. National Institutes of Health, Bethesda, MD, USA

    Tejas S. Mathai

  10. National Institutes of Health, Bethesda, MD, USA

    Pritam Mukherjee

  11. Radboud University Nijmegen Medical Center, Nijmegen, The Netherlands

    Max De Grauw

  12. The Netherlands Cancer Institute, Amsterdam, The Netherlands

    Regina Beets Tan

  13. The Netherlands Cancer Institute, Amsterdam, The Netherlands

    Valentina Corbetta

  14. University Hospital Freiburg, Freiburg, Germany

    Elmar Kotter

  15. University of Bern, Bern, Switzerland

    Mauricio Reyes

  16. University of Tübingen, Tübingen, Germany

    Christian F. Baumgartner

  17. Harvard Medical School, Massachusetts General Hospital, Boston, MA, USA

    Quanzheng Li

  18. University of Southern California, Los Angeles, CA, USA

    Richard Leahy

  19. Peking University, Beijing, China

    Bin Dong

  20. Hong Kong University of Science and Technology, Kowloon, Hong Kong

    Hao Chen

  21. Vanderbilt University, Nashville, TN, USA

    Yuankai Huo

  22. University of Sydney, Camperdown, NSW, Australia

    Jinglei Lv

  23. Institute of High Performance Computing, Singapore, Singapore

    Xinxing Xu

  24. Hong Kong University of Science and Technology, Hong Kong, China

    Xiaomeng Li

  25. Inception Institute of Artificial Intelligence, Abu Dhabi, United Arab Emirates

    Dwarikanath Mahapatra

  26. University of Alberta, Edmonton, AB, Canada

    Li Cheng

  27. LITIS, University of Rouen, Rouen, France

    Caroline Petitjean

  28. ImViA Laboratory, University of Burgundy, Dijon, France

    Benoît Presles

1 Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (pdf 1024 KB)

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Bian, Z. et al. (2023). MomentaMorph: Unsupervised Spatial-Temporal Registration with Momenta, Shooting, and Correction. In: Woo, J., et al. Medical Image Computing and Computer Assisted Intervention – MICCAI 2023 Workshops. MICCAI 2023. Lecture Notes in Computer Science, vol 14394. Springer, Cham. https://doi.org/10.1007/978-3-031-47425-5_3

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-47425-5_3

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-47424-8

  • Online ISBN: 978-3-031-47425-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Societies and partnerships

Search

Navigation