Skip to main content

Echocardiography Segmentation by Quality Translation Using Anatomically Constrained CycleGAN

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 11768))

Abstract

Segmentation of an echocardiogram (echo) is favorable for assessment of cardiac functionality and disease. The quality of the captured echo is a key factor that affects the segmentation accuracy. In this paper, we propose a novel generative adversarial network architecture, which aims to improve echo quality for the segmentation of the left ventricle (LV). The proposed model is anatomically constrained to the structure of the LV in apical four chamber (AP4) echo view. A set of discriminative features are learned through unpaired translation of low to high quality echo using adversarial training. The anatomical constraint regularizes the model during end-to-end training to preserve the corresponding shape of the LV in the translated echo. Experiments show that leveraging information in the translated high quality echocardiograms by the proposed method improves the robustness of the segmentation, where the worst-case Dice similarity score is improved by a margin of 15% over the baseline.

M. H. Jafari, Z. Liao, and H. Girgis—Joint first authorship.

T. Tsang and P. Abolmaesumi—Joint senior authorship.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Abdi, A.H., et al.: Automatic quality assessment of echocardiograms using convolutional neural networks: feasibility on the apical four-chamber view. IEEE TMI 36(6), 1221–1230 (2017)

    Google Scholar 

  2. Degel, M.A., Navab, N., Albarqouni, S.: Domain and geometry agnostic CNNs for left atrium segmentation in 3D ultrasound. In: Frangi, A.F., Schnabel, J.A., Davatzikos, C., Alberola-López, C., Fichtinger, G. (eds.) MICCAI 2018. LNCS, vol. 11073, pp. 630–637. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-00937-3_72

    Chapter  Google Scholar 

  3. Huo, Y., et al.: Adversarial synthesis learning enables segmentation without target modality ground truth. In: IEEE ISBI, pp. 1217–1220 (2018)

    Google Scholar 

  4. Leclerc, S., et al.: Deep learning for segmentation using an open large-scale dataset in 2D echocardiography. IEEE TMI 38, 2198–2210 (2019)

    Google Scholar 

  5. Noble, J.A., Boukerroui, D.: Ultrasound image segmentation: a survey. IEEE TMI 25(8), 987–1010 (2006)

    Google Scholar 

  6. Oktay, O., et al.: Anatomically constrained neural networks (ACNNs): application to cardiac image enhancement and segmentation. IEEE TMI 37(2), 384–395 (2018)

    Google Scholar 

  7. Ronneberger, O., Fischer, P., Brox, T.: U-Net: convolutional networks for biomedical image segmentation. In: Navab, N., Hornegger, J., Wells, W.M., Frangi, A.F. (eds.) MICCAI 2015. LNCS, vol. 9351, pp. 234–241. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-24574-4_28

    Chapter  Google Scholar 

  8. Salimans, T., et al.: Improved techniques for training GANs. In: NIPS, pp. 2234–2242 (2016)

    Google Scholar 

  9. Zhang, J., et al.: Fully automated echocardiogram interpretation in clinical practice: feasibility and diagnostic accuracy. Circulation 138(16), 1623–1635 (2018)

    Article  Google Scholar 

  10. Zhang, Z., et al.: Translating and segmenting multimodal medical volumes with cycle- and shape-consistency generative adversarial network. In: IEEE CVPR (2018)

    Google Scholar 

  11. Zhu, J.Y., et al.: Unpaired image-to-image translation using cycle-consistent adversarial networks. In: IEEE CVPR, pp. 2223–2232 (2017)

    Google Scholar 

Download references

Acknowledgements

This work is supported in part by the Canadian Institutes of Health Research (CIHR) and in part by the Natural Sciences and Engineering Research Council of Canada (NSERC). The authors would like to acknowledge the support provided by Dale Hawley and the Vancouver Coastal Health in providing us with the anonymized, deidentified data.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Mohammad H. Jafari .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Jafari, M.H. et al. (2019). Echocardiography Segmentation by Quality Translation Using Anatomically Constrained CycleGAN. In: Shen, D., et al. Medical Image Computing and Computer Assisted Intervention – MICCAI 2019. MICCAI 2019. Lecture Notes in Computer Science(), vol 11768. Springer, Cham. https://doi.org/10.1007/978-3-030-32254-0_73

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-32254-0_73

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-32253-3

  • Online ISBN: 978-3-030-32254-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics