Skip to main content

Enhancing Federated Learning Performance Fairness via Collaboration Graph-Based Reinforcement Learning

  • Conference paper
  • First Online:
Medical Image Computing and Computer Assisted Intervention – MICCAI 2024 (MICCAI 2024)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 15010))

  • 1293 Accesses

Abstract

Federated learning has recently developed into a pivotal distributed learning paradigm, wherein a server aggregates numerous client-trained models into a global model without accessing any client data directly. It is acknowledged that the impact of statistical heterogeneity in client local data on the pace of global model convergence, but it is often underestimated that this heterogeneity also engenders a biased global model with notable variance in accuracy across clients. Contextually, the prevalent solutions entail modifying the optimization objective. However, these solutions often overlook implicit relationships, such as the pairwise distances of site data distributions, which makes pairwise exclusive or synergistic optimization among client models. Such optimization conflicts compromise the efficacy of earlier methods, leading to performance imbalance or even negative transfer. To tackle this issue, we propose a novel aggregation strategy called Collaboration Graph-based Reinforcement Learning (FedGraphRL). By deploying a reinforcement learning (RL) agent equipped with a multi-layer adaptive graph convolutional network (AGCN) on the server-side, we can learn a collaboration graph from client state vectors, revealing the collaborative relationships among clients during optimization. Guided by an introduced reward that balances fairness and performance, the agent allocates aggregation weights, thereby promoting automated decision-making and improvements in fairness. The experimental results on two real-world multi-center medical datasets suggest the effectiveness and superiority of the proposed FedGraphRL.

Y. Xia and B. Ma—Contributed equally to this work.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Abràmoff, M.D., et al.: Automated analysis of retinal images for detection of referable diabetic retinopathy. JAMA Ophthalmol. 131(3), 351–357 (2013)

    Article  Google Scholar 

  2. Bao, W., Wang, H., Wu, J., He, J.: Optimizing the collaboration structure in cross-silo federated learning. In: ICML, vol. 202, pp. 1718–1736 (2023)

    Google Scholar 

  3. Chen, F., Long, G., Wu, Z., Zhou, T., Jiang, J.: Personalized federated learning with a graph. In: IJCAI, pp. 2575–2582 (2022)

    Google Scholar 

  4. Chen, J., Ma, B., Cui, H., Xia, Y.: Think twice before selection: federated evidential active learning for medical image analysis with domain shifts. In: CVPR (2024)

    Google Scholar 

  5. Decenciere, E., et al.: TeleOphta: machine learning and image processing methods for teleophthalmology. Irbm 34(2), 196–203 (2013)

    Article  Google Scholar 

  6. Hosseini, S.M., Sikaroudi, M., Babaie, M., Tizhoosh, H.: Proportionally fair hospital collaborations in federated learning of histopathology images. IEEE TMI (2023)

    Google Scholar 

  7. Hu, Z., Shaloudegi, K., Zhang, G., Yu, Y.: Federated learning meets multi-objective optimization. IEEE Trans. Netw. Sci. Eng. 9(4), 2039–2051 (2022)

    Article  MathSciNet  Google Scholar 

  8. Jiang, M., et al.: Fair federated medical image segmentation via client contribution estimation. In: CVPR, pp. 16302–16311 (2023)

    Google Scholar 

  9. Kairouz, P., McMahan, H.B., Avent, B., et al.: Advances and open problems in federated learning. Found. Trends Mach. Learn. 14(12), 1–210 (2021)

    Article  Google Scholar 

  10. Karthick, M., Sohier, D.: Aptos 2019 blindness detection. Kaggle https://kaggle.com/competitions/aptos2019-blindness-detection Go to reference in chapter (2019)

  11. Kinga, D., Adam, J.B., et al.: A method for stochastic optimization. In: ICLR, vol. 5, p. 6 (2015)

    Google Scholar 

  12. Kipf, T.N., Welling, M.: Semi-supervised classification with graph convolutional networks. In: ICLR (2017)

    Google Scholar 

  13. Li, T., Beirami, A., Sanjabi, M., Smith, V.: Tilted empirical risk minimization. In: ICLR (2021)

    Google Scholar 

  14. Li, T., Sahu, A.K., Talwalkar, A., Smith, V.: Federated learning: challenges, methods, and future directions. IEEE Signal Process. Mag. 37(3), 50–60 (2020)

    Article  Google Scholar 

  15. Li, T., Sanjabi, M., Beirami, A., Smith, V.: Fair resource allocation in federated learning. In: ICLR (2020)

    Google Scholar 

  16. Lillicrap, T.P., et al.: Continuous control with deep reinforcement learning. In: ICLR (2016)

    Google Scholar 

  17. Liu, Q., Dou, Q., Yu, L., Heng, P.A.: MS-Net: multi-site network for improving prostate segmentation with heterogeneous MRI data. IEEE TMI 39(9), 2713–2724 (2020)

    Google Scholar 

  18. Liu, R., et al.: DeepDRiD: diabetic retinopathy grading and image quality estimation challenge. Patterns 3(6) (2022)

    Google Scholar 

  19. Ma, B., Zhang, J., Xia, Y., Tao, D.: VNAS: variational neural architecture search. Int. J. Comput. Vis. 1–25 (2024)

    Google Scholar 

  20. McMahan, B., Moore, E., Ramage, D., Hampson, S., Arcas, B.A.: Communication-efficient learning of deep networks from decentralized data. In: AISTATS (2017)

    Google Scholar 

  21. Mohri, M., Sivek, G., Suresh, A.T.: Agnostic federated learning. In: ICML (2019)

    Google Scholar 

  22. Porwal, P., et al.: Indian diabetic retinopathy image dataset (IDRiD): a database for diabetic retinopathy screening research. Data 3(3), 25 (2018)

    Article  Google Scholar 

  23. Roth, H.R., et al.: Federated learning for breast density classification: a real-world implementation. In: DART at MICCAI (2020)

    Google Scholar 

  24. Tan, M., Le, Q.: EfficientNet: rethinking model scaling for convolutional neural networks. In: ICML, pp. 6105–6114 (2019)

    Google Scholar 

  25. Tang, X., Yu, H.: Competitive-cooperative multi-agent reinforcement learning for auction-based federated learning. In: IJCAI (2023)

    Google Scholar 

  26. Tschandl, P., Rosendahl, C., Kittler, H.: The HAM10000 dataset, a large collection of multi-source dermatoscopic images of common pigmented skin lesions. Sci. Data 5(1), 1–9 (2018)

    Article  Google Scholar 

  27. Wang, Z., Fan, X., Qi, J., Wen, C., Wang, C., Yu, R.: Federated learning with fair averaging. In: IJCAI, pp. 1615–1623 (2021)

    Google Scholar 

  28. Zhang, G., Malekmohammadi, S., Chen, X., Yu, Y.: Proportional fairness in federated learning. TMLR 2023 (2023)

    Google Scholar 

  29. Zhang, S.Q., Lin, J., Zhang, Q.: A multi-agent reinforcement learning approach for efficient client selection in federated learning. In: AAAI (2022)

    Google Scholar 

  30. Zhou, Y., Wang, B., Huang, L., Cui, S., Shao, L.: A benchmark for studying diabetic retinopathy: segmentation, grading, and transferability. IEEE TMI 40(3), 818–828 (2020)

    Google Scholar 

Download references

Acknowledgement

This work was supported in part by the National Natural Science Foundation of China under Grants 62171377, in part by Shenzhen Science and Technology Program under Grants JCYJ20220530161616036, in part by the Ningbo Clinical Research Center for Medical Imaging under Grant 2021L003 (Open Project 2022LYKFZD06), and in part by the Innovation Foundation for Master Dissertation of Northwestern Polytechnical University under Grant PF2024013.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yong Xia .

Editor information

Editors and Affiliations

Ethics declarations

Disclosure of Interests

The authors have no competing interests to declare that are relevant to the content of this article.

1 Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (pdf 538 KB)

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Xia, Y., Ma, B., Dou, Q., Xia, Y. (2024). Enhancing Federated Learning Performance Fairness via Collaboration Graph-Based Reinforcement Learning. In: Linguraru, M.G., et al. Medical Image Computing and Computer Assisted Intervention – MICCAI 2024. MICCAI 2024. Lecture Notes in Computer Science, vol 15010. Springer, Cham. https://doi.org/10.1007/978-3-031-72117-5_25

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-72117-5_25

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-72116-8

  • Online ISBN: 978-3-031-72117-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics