Skip to main content

Application of Federated Learning in Medical Imaging

  • Chapter
  • First Online:
Federated Learning

Abstract

Artificial intelligence and in particular deep learning have shown great potential in the field of medical imaging. The models can be used to analyze radiology/pathology images to assist the physicians with their tasks in the clinical workflow such as disease detection, medical intervention, treatment planning, and prognosis to name a few. Accurate and generalizable deep learning models are in high demand but require large and diverse sets of data. Diversity in medical images means images collected at various institutions, using several devices and parameter settings from diverse populations of patients. Thus, producing a diverse data set of medical images requires multiple institutions to share their data. Despite the universal acceptance of Digital Imaging and Communications in Medicine (DICOM) as a common image storage format, sharing large numbers of medical images between multiple institutions is still a challenge. One of the main reasons is strict regulations on storage and sharing of personally identifiable health data including medical images. Currently, large data sets are usually collected with participation of a handful of institutions after rigorous de-identification to remove personally identifiable data from medical images and patient health records. De-identification is time consuming, expensive, and error prone and in some cases can remove useful information. Federated Learning emerged as a practical solution for training of AI models using large multi-institute data sets without a need for sharing the data, thereby removing the need for de-identification while satisfying necessary regulations. In this chapter, we present several examples of federated learning for medical imaging using IBM Federated Learning.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Kim M, Yun J, Cho Y, Shin K, Jang R, Bae HJ, Kim N (2019) Deep learning in medical imaging. Neurospine 16(4):657–668. https://doi.org/10.14245/ns.1938396.198

    Article  Google Scholar 

  2. Russakovsky O, Deng J, Su H et al (2015) ImageNet large scale visual recognition challenge. Int J Comput Vis 115:211–252

    Article  MathSciNet  Google Scholar 

  3. Johnson A, Pollard T, Mark R, Berkowitz S, Horng S (2019) MIMIC-CXR Database (version 2.0.0). PhysioNet. https://doi.org/10.13026/C2JT1Q.

  4. Johnson AEW, Pollard TJ, Berkowitz SJ et al (2019) MIMIC-CXR, a de-identified publicly available database of chest radiographs with free-text reports. Sci Data 6:317. https://doi.org/10.1038/s41597-019-0322-0

    Article  Google Scholar 

  5. Irvin J, Rajpurkar P, Ko M, Yu Y, Ciurea-Ilcus S (2019) CheXpert: a large chest radiograph dataset with uncertainty labels and expert comparison. In: 33rd AAAI conference on artificial intelligence

    Google Scholar 

  6. Peng Y, Wang X, Lu L, Bagheri M, Summers RM, Lu Z (2018) NegBio: a high-performance tool for negation and uncertainty detection in radiology reports. In: AMIA 2018 informatics summit

    Google Scholar 

  7. (2001) DICOM reference guide. Health Dev 30:5–30

    Google Scholar 

  8. HIPAA (2020) US Department of Health and Human Services. https://www.hhs.gov/hipaa/index.html

  9. GDPR (2016) Intersoft consulting. https://gdpr-info.eu

  10. McMahan HB, Moore E, Ramage D, Hampson S, Arcas BAY (2017) Communication-efficient learning of deep networks from decentralized data. arXiv preprint arXiv:1602.05629

    Google Scholar 

  11. Ludwig H, Baracaldo N, Thomas G, Zhou Y, Anwar A, Rajamoni S, Ong Y, Radhakrishnan J, Verma A, Sinn M et al (2020) IBM federated learning: an enterprise framework white paper V0.1. arXiv preprint arXiv:2007.10987

    Google Scholar 

  12. Dalen JE (2002) Pulmonary embolism: what have we learned since Virchow? Natural history, pathophysiology, and diagnosis. Chest 122(4):1440–1456

    Article  Google Scholar 

  13. Barritt DW, Jordan SC (1960) Anticoagulant drugs in the treatment of pulmonary embolism: a controlled trial. The Lancet 275(7138):1309–1312

    Article  Google Scholar 

  14. Hermann RE, Davis JH, Holden WD (1961) Pulmonary embolism: a clinical and pathologic study with emphasis on the effect of prophylactic therapy with anticoagulants. Am J Surg 102(1):19–28

    Article  Google Scholar 

  15. Morrell MT, Dunnill MS (1968) The post-mortem incidence of pulmonary embolism in a hospital population. Br J Surg 55(5):347–352

    Article  Google Scholar 

  16. Coon WW, Willis PW 3rd, Symons MJ (1969) Assessment of anticoagulant treatment of venous thromboembolism. Ann Surg 170(4):559

    Article  Google Scholar 

  17. Carson JL, Kelley MA, Duff A, Weg JG, Fulkerson WJ, Palevsky HI, Schwartz JS, Thompson BT, Popovich J Jr, Hobbins TE, Spera MA (1992) The clinical course of pulmonary embolism. N Engl J Med 326(19):1240–1245

    Article  Google Scholar 

  18. Das M, Mühlenbruch G, Helm A, Bakai A, Salganicoff M, Stanzel S, Liang J, Wolf M, Günther RW, Wildberger JE (2008) Computer-aided detection of pulmonary embolism: influence on radiologists’ detection performance with respect to vessel segments. Eur Radiol 18(7):1350–1355

    Article  Google Scholar 

  19. Zhou C, Chan HP, Patel S, Cascade PN, Sahiner B, Hadjiiski LM, Kazerooni EA (2005) Preliminary investigation of computer-aided detection of pulmonary embolism in three-dimensional computed tomography pulmonary angiography images. Acad Radiol 12(6):782

    Article  Google Scholar 

  20. Schoepf UJ, Schneider AC, Das M, Wood SA, Cheema JI, Costello P (2007) Pulmonary embolism: computer-aided detection at multidetector row spiral computed tomography. J Thorac Imaging 22(4):319–323

    Article  Google Scholar 

  21. Buhmann S, Herzog P, Liang J, Wolf M, Salganicoff M, Kirchhoff C, Reiser M, Becker CH (2007) Clinical evaluation of a computer-aided diagnosis (CAD) prototype for the detection of pulmonary embolism. Acad Radiol 14(6):651–658

    Article  Google Scholar 

  22. Engelke C, Schmidt S, Bakai A, Auer F, Marten K (2008) Computer-assisted detection of pulmonary embolism: performance evaluation in consensus with experienced and inexperienced chest radiologists. Eur Radiol 18(2):298–307

    Article  Google Scholar 

  23. Liang J, Bi J (2007) Computer aided detection of pulmonary embolism with tobogganing and multiple instance classification in CT pulmonary angiography. In: Biennial international conference on information processing in medical imaging. Springer, Berlin/Heidelberg, pp 630–641

    Chapter  Google Scholar 

  24. Tajbakhsh N, Gotway MB, Liang J (2015) Computer-aided pulmonary embolism detection using a novel vessel-aligned multi-planar image representation and convolutional neural networks. In: International conference on medical image computing and computer-assisted intervention. Springer, Cham, pp 62–69

    Google Scholar 

  25. Huang SC, Kothari T, Banerjee I, Chute C, Ball RL, Borus N et al (2020) PENet—a scalable deep-learning model for automated diagnosis of pulmonary embolism using volumetric CT imaging. NPJ Digit Med 3(1):1–9

    Article  Google Scholar 

  26. Gonzalez G. CAD-PE challenge website. Available online: http://www.cad-pe.org

  27. Masoudi M, Pourreza HR, Saadatmand-Tarzjan M, Eftekhari N, Zargar FS, Rad MP (2018) A new data set of computed-tomography angiography images for computer-aided detection of pulmonary embolism. Sci Data 5(1):1–9

    Article  Google Scholar 

  28. Ronneberger O, Fischer P, Brox T (2015) U-Net: convolutional networks for biomedical image segmentation. In: International conference on medical image computing and computer-assisted intervention. Springer, Cham, pp 234–241

    Google Scholar 

  29. Milletari F, Navab N, Ahmadi SA (2016) V-Net: fully convolutional neural networks for volumetric medical image segmentation. In: 2016 fourth international conference on 3D vision (3DV). IEEE, pp 565–571

    Google Scholar 

  30. Ørting SN, Petersen J, Thomsen LH, Wille MMW, Bruijne de M (2018) Detecting emphysema with multiple instance learning. In: 2018 IEEE 15th international symposium biomedical imaging (ISBI), pp 510–513

    Google Scholar 

  31. Cheplygina V, Sørensen L, Tax DMJ, Pedersen JH, Loog M, de Bruijne M (2014) Classification of COPD with multiple instance learning. In: 2014 22nd international conference on pattern recognition, pp 1508–1513

    Google Scholar 

  32. Peña IP, Cheplygina V, Paschaloudi S et al (2018) Automatic emphysema detection using weakly labeled HRCT lung images. PLoS ONE 13(10). https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6188751/

  33. Bortsova G, Dubost F, Ørting S et al (2018) Deep learning from label proportions for emphysema quantification. In: Medical image computing and computer assisted intervention—MICCAI 2018, pp 768–776

    Google Scholar 

  34. Karabulut EM, Ibrikci T (2015) Emphysema discrimination from raw HRCT images by convolutional neural networks. In: 2015 9th international conference on electrical and electronics engineering, ELECO, pp 705–708. http://ieeexplore.ieee.org/document/7394441/

  35. Negahdar M, Coy A, Beymer D (2019) An end-to-end deep learning pipeline for emphysema quantification using multi-label learning. In: 41st annual international conference on IEEE engineering in medicine biology society, EMBC 2019, pp 929–932

    Google Scholar 

  36. Humphries S, Notary A, Centeno JP, Strand M, Crapo J, Silverman E, Lynch D (2020) Deep learning enables automatic classification of emphysema pattern at CT. Radiology 294(2):434–444

    Article  Google Scholar 

  37. Braman N, Beymer D, Degan E (2018) Disease detection in weakly annotated volumetric medical images using a convolutional LSTM network. arXiv preprint arXiv:1812.01087

    Google Scholar 

  38. Shi X, Chen Z, Wang H, Yeung DY, Wong WK, Woo WC (2015) Convolutional LSTM network: a machine learning approach for precipitation nowcasting. Adv Neural Inf Process Syst 2015:802–810

    Google Scholar 

  39. National Lung Screening Trial Research Team; Aberle DR, Berg CD, Black WC, Church TR, Fagerstrom RM, Galen B, Gareen IF, Gatsonis C, Goldin J, Gohagan JK, Hillman B, Jaffe C, Kramer BS, Lynch D, Marcus PM, Schnall M, Sullivan DC, Sullivan D, Zylak CJ (2011) The national lung screening trial: overview and study design. Radiology 258(1):243–253

    Article  Google Scholar 

  40. Hohberger LA, Schroeder DR, Bartholmai BJ et al (2014) Correlation of regional emphysema and lung cancer: a lung tissue research consortium-based study. J Thorac Oncol Off Publ Int Assoc Study Lung Cancer 9(5):639–645

    Google Scholar 

  41. Huang G, Liu Z, Van Der Maaten L, Weinberger KQ (2017) Densely connected convolutional networks. In: 2017 IEEE conference on computer vision and pattern recognition (CVPR), pp 2261–2269. https://doi.org/10.1109/CVPR.2017.243

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ehsan Degan .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Degan, E. et al. (2022). Application of Federated Learning in Medical Imaging. In: Ludwig, H., Baracaldo, N. (eds) Federated Learning. Springer, Cham. https://doi.org/10.1007/978-3-030-96896-0_22

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-96896-0_22

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-96895-3

  • Online ISBN: 978-3-030-96896-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics