Abstract
Federated learning has recently developed into a pivotal distributed learning paradigm, wherein a server aggregates numerous client-trained models into a global model without accessing any client data directly. It is acknowledged that the impact of statistical heterogeneity in client local data on the pace of global model convergence, but it is often underestimated that this heterogeneity also engenders a biased global model with notable variance in accuracy across clients. Contextually, the prevalent solutions entail modifying the optimization objective. However, these solutions often overlook implicit relationships, such as the pairwise distances of site data distributions, which makes pairwise exclusive or synergistic optimization among client models. Such optimization conflicts compromise the efficacy of earlier methods, leading to performance imbalance or even negative transfer. To tackle this issue, we propose a novel aggregation strategy called Collaboration Graph-based Reinforcement Learning (FedGraphRL). By deploying a reinforcement learning (RL) agent equipped with a multi-layer adaptive graph convolutional network (AGCN) on the server-side, we can learn a collaboration graph from client state vectors, revealing the collaborative relationships among clients during optimization. Guided by an introduced reward that balances fairness and performance, the agent allocates aggregation weights, thereby promoting automated decision-making and improvements in fairness. The experimental results on two real-world multi-center medical datasets suggest the effectiveness and superiority of the proposed FedGraphRL.
Y. Xia and B. Ma—Contributed equally to this work.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Abràmoff, M.D., et al.: Automated analysis of retinal images for detection of referable diabetic retinopathy. JAMA Ophthalmol. 131(3), 351–357 (2013)
Bao, W., Wang, H., Wu, J., He, J.: Optimizing the collaboration structure in cross-silo federated learning. In: ICML, vol. 202, pp. 1718–1736 (2023)
Chen, F., Long, G., Wu, Z., Zhou, T., Jiang, J.: Personalized federated learning with a graph. In: IJCAI, pp. 2575–2582 (2022)
Chen, J., Ma, B., Cui, H., Xia, Y.: Think twice before selection: federated evidential active learning for medical image analysis with domain shifts. In: CVPR (2024)
Decenciere, E., et al.: TeleOphta: machine learning and image processing methods for teleophthalmology. Irbm 34(2), 196–203 (2013)
Hosseini, S.M., Sikaroudi, M., Babaie, M., Tizhoosh, H.: Proportionally fair hospital collaborations in federated learning of histopathology images. IEEE TMI (2023)
Hu, Z., Shaloudegi, K., Zhang, G., Yu, Y.: Federated learning meets multi-objective optimization. IEEE Trans. Netw. Sci. Eng. 9(4), 2039–2051 (2022)
Jiang, M., et al.: Fair federated medical image segmentation via client contribution estimation. In: CVPR, pp. 16302–16311 (2023)
Kairouz, P., McMahan, H.B., Avent, B., et al.: Advances and open problems in federated learning. Found. Trends Mach. Learn. 14(12), 1–210 (2021)
Karthick, M., Sohier, D.: Aptos 2019 blindness detection. Kaggle https://kaggle.com/competitions/aptos2019-blindness-detection Go to reference in chapter (2019)
Kinga, D., Adam, J.B., et al.: A method for stochastic optimization. In: ICLR, vol. 5, p. 6 (2015)
Kipf, T.N., Welling, M.: Semi-supervised classification with graph convolutional networks. In: ICLR (2017)
Li, T., Beirami, A., Sanjabi, M., Smith, V.: Tilted empirical risk minimization. In: ICLR (2021)
Li, T., Sahu, A.K., Talwalkar, A., Smith, V.: Federated learning: challenges, methods, and future directions. IEEE Signal Process. Mag. 37(3), 50–60 (2020)
Li, T., Sanjabi, M., Beirami, A., Smith, V.: Fair resource allocation in federated learning. In: ICLR (2020)
Lillicrap, T.P., et al.: Continuous control with deep reinforcement learning. In: ICLR (2016)
Liu, Q., Dou, Q., Yu, L., Heng, P.A.: MS-Net: multi-site network for improving prostate segmentation with heterogeneous MRI data. IEEE TMI 39(9), 2713–2724 (2020)
Liu, R., et al.: DeepDRiD: diabetic retinopathy grading and image quality estimation challenge. Patterns 3(6) (2022)
Ma, B., Zhang, J., Xia, Y., Tao, D.: VNAS: variational neural architecture search. Int. J. Comput. Vis. 1–25 (2024)
McMahan, B., Moore, E., Ramage, D., Hampson, S., Arcas, B.A.: Communication-efficient learning of deep networks from decentralized data. In: AISTATS (2017)
Mohri, M., Sivek, G., Suresh, A.T.: Agnostic federated learning. In: ICML (2019)
Porwal, P., et al.: Indian diabetic retinopathy image dataset (IDRiD): a database for diabetic retinopathy screening research. Data 3(3), 25 (2018)
Roth, H.R., et al.: Federated learning for breast density classification: a real-world implementation. In: DART at MICCAI (2020)
Tan, M., Le, Q.: EfficientNet: rethinking model scaling for convolutional neural networks. In: ICML, pp. 6105–6114 (2019)
Tang, X., Yu, H.: Competitive-cooperative multi-agent reinforcement learning for auction-based federated learning. In: IJCAI (2023)
Tschandl, P., Rosendahl, C., Kittler, H.: The HAM10000 dataset, a large collection of multi-source dermatoscopic images of common pigmented skin lesions. Sci. Data 5(1), 1–9 (2018)
Wang, Z., Fan, X., Qi, J., Wen, C., Wang, C., Yu, R.: Federated learning with fair averaging. In: IJCAI, pp. 1615–1623 (2021)
Zhang, G., Malekmohammadi, S., Chen, X., Yu, Y.: Proportional fairness in federated learning. TMLR 2023 (2023)
Zhang, S.Q., Lin, J., Zhang, Q.: A multi-agent reinforcement learning approach for efficient client selection in federated learning. In: AAAI (2022)
Zhou, Y., Wang, B., Huang, L., Cui, S., Shao, L.: A benchmark for studying diabetic retinopathy: segmentation, grading, and transferability. IEEE TMI 40(3), 818–828 (2020)
Acknowledgement
This work was supported in part by the National Natural Science Foundation of China under Grants 62171377, in part by Shenzhen Science and Technology Program under Grants JCYJ20220530161616036, in part by the Ningbo Clinical Research Center for Medical Imaging under Grant 2021L003 (Open Project 2022LYKFZD06), and in part by the Innovation Foundation for Master Dissertation of Northwestern Polytechnical University under Grant PF2024013.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Ethics declarations
Disclosure of Interests
The authors have no competing interests to declare that are relevant to the content of this article.
1 Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Xia, Y., Ma, B., Dou, Q., Xia, Y. (2024). Enhancing Federated Learning Performance Fairness via Collaboration Graph-Based Reinforcement Learning. In: Linguraru, M.G., et al. Medical Image Computing and Computer Assisted Intervention – MICCAI 2024. MICCAI 2024. Lecture Notes in Computer Science, vol 15010. Springer, Cham. https://doi.org/10.1007/978-3-031-72117-5_25
Download citation
DOI: https://doi.org/10.1007/978-3-031-72117-5_25
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-72116-8
Online ISBN: 978-3-031-72117-5
eBook Packages: Computer ScienceComputer Science (R0)