Abstract
The surge of ubiquitous data underscores the need for Federated learning (FL), which allows distributed data entities to learn a global model orchestrally without revealing their private local data, ensuring the privacy and security of users. However, the performance of the trained global model on individual clients is impaired by the heterogeneous nature of the client’s local data, exposed as the performance unfairness in FL. Such unfairness issues grab the research community’s attention and a few recent works embark upon fair solutions via reweighting clients during aggregation but overlooking the impact of client selection for aggregation. To fill this gap, in this paper, a Fairness Compensation-based FL scheme (FCFL) is proposed to alleviate the unfairness amongst clients. In particular, the unfairness of each client during the FL training process is estimated as the accuracy difference between local performance and global performance, and accumulated queues are calculated for the cumulative unfairness value in each round. In addition, a fairness compensation FL method is devised, which can select participating clients dynamically and adjust the aggregation weights adaptively in each round to guarantee fairness in the training process. Specifically, the proposed FCFL scheme is a flexible framework with tunable parameters and the FedAvg algorithm is its special case when \(\alpha =0\). Finally, intensive experiments are conducted on three benchmark datasets with different settings, demonstrating that the FCFL outperforms the state-of-the-art baselines by improving the fairness metric up to 30.4% while maintaining a competitive accuracy performance. The source code is available at https://github.com/wlffffff/FCFL.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Cho, Y.J., Wang, J., Joshi, G.: Client selection in federated learning: convergence analysis and power-of-choice selection strategies. arXiv preprint arXiv:2010.01243 (2020)
Cong, Y., et al.: Ada-FFL: adaptive computing fairness federated learning. CAAI Trans. Intell. Technol. (2023)
Du, W., Xu, D., Wu, X., Tong, H.: Fairness-aware agnostic federated learning. In: Proceedings of the 2021 SIAM International Conference on Data Mining (SDM), pp. 181–189. SIAM (2021)
Ezzeldin, Y.H., Yan, S., He, C., Ferrara, E., Avestimehr, A.S.: Fairfed: enabling group fairness in federated learning. In: Proceedings of the AAAI Conference on Artificial Intelligence. vol. 37, pp. 7494–7502 (2023)
Hamidi, S.M., Damen, O.: Fair wireless federated learning through the identification of a common descent direction. IEEE Commun. Lett. (2024)
Hu, Z., Shaloudegi, K., Zhang, G., Yu, Y.: Fedmgda+: federated learning meets multi-objective optimization. IEEE Trans. Netw. Sci. Eng. 9(4), 2039–2051 (2022)
Huang, T., Lin, W., Wu, W., He, L., Li, K., Zomaya, A.Y.: An efficiency-boosting client selection scheme for federated learning with fairness guarantee. IEEE Trans. Parallel Distrib. Syst. 32(7), 1552–1564 (2020)
Huang, W., Li, T., Wang, D., Du, S., Zhang, J., Huang, T.: Fairness and accuracy in horizontal federated learning. Inf. Sci. 589, 170–185 (2022)
Jiang, M., Wang, Z., Dou, Q.: Harmofl: harmonizing local and global drifts in federated learning on heterogeneous medical images. In: Proceedings of the AAAI Conference on Artificial Intelligence. vol. 36, pp. 1087–1095 (2022)
Li, T., Hu, S., Beirami, A., Smith, V.: Ditto: Fair and robust federated learning through personalization. In: International Conference on Machine Learning (ICML), pp. 6357–6368. PMLR (2021)
Li, T., Sanjabi, M., Beirami, A., Smith, V.: Fair resource allocation in federated learning. arXiv preprint arXiv:1905.10497 (2019)
Li, X., Zhao, S., Chen, C., Zheng, Z.: Heterogeneity-aware fair federated learning. Inf. Sci. 619, 968–986 (2023)
Liu, Z., Chen, Y., Yu, H., Liu, Y., Cui, L.: Gtg-Shapley: efficient and accurate participant contribution evaluation in federated learning. ACM Trans. Intell. Syst. Technol. (TIST) 13(4), 1–21 (2022)
Luo, B., Li, X., Wang, S., Huang, J., Tassiulas, L.: Cost-effective federated learning in mobile edge networks. IEEE J. Sel. Areas Commun. 39(12), 3606–3621 (2021)
McMahan, B., Moore, E., Ramage, D., Hampson, S., y Arcas, B.A.: Communication-efficient learning of deep networks from decentralized data. In: Artificial Intelligence and Statistics, pp. 1273–1282. PMLR (2017)
Mohri, M., Sivek, G., Suresh, A.T.: Agnostic federated learning. In: International Conference on Machine Learning (ICML), pp. 4615–4625. PMLR (2019)
Pan, Z., Wang, S., Li, C., Wang, H., Tang, X., Zhao, J.: Fedmdfg: federated learning with multi-gradient descent and fair guidance. In: Proceedings of the AAAI Conference on Artificial Intelligence. vol. 37, pp. 9364–9371 (2023)
Shi, Y., Liu, Z., Shi, Z., Yu, H.: Fairness-aware client selection for federated learning. In: 2023 IEEE International Conference on Multimedia and Expo (ICME), pp. 324–329. IEEE (2023)
Shi, Y., Yu, H., Leung, C.: Towards fairness-aware federated learning. IEEE Trans. Neural Netw. Learn. Syst. (2023)
Singhal, P., Pandey, S.R., Popovski, P.: Greedy Shapley client selection for communication-efficient federated learning. IEEE Networking Lett. (2024)
Sun, Y., Si, S., Wang, J., Dong, Y., Zhu, Z., Xiao, J.: A fair federated learning framework with reinforcement learning. In: 2022 International Joint Conference on Neural Networks (IJCNN), pp. 1–8. IEEE (2022)
Wahab, O.A., Rjoub, G., Bentahar, J., Cohen, R.: Federated against the cold: a trust-based federated learning approach to counter the cold start problem in recommendation systems. Inf. Sci. 601, 189–206 (2022)
Wang, Z., Fan, X., Qi, J., Wen, C., Wang, C., Yu, R.: Federated learning with fair averaging. arXiv preprint arXiv:2104.14937 (2021)
Xiong, Z., Cai, Z., Takabi, D., Li, W.: Privacy threat and defense for federated learning with non-iid data in AIoT. IEEE Trans. Industr. Inf. 18(2), 1310–1321 (2021)
Xiong, Z., Li, W., Cai, Z.: Federated generative model on multi-source heterogeneous data in IoT. In: Proceedings of the AAAI Conference on Artificial Intelligence. vol. 37, pp. 10537–10545 (2023)
Xiong, Z., Li, W., Li, Y., Cai, Z.: Exact-fun: an exact and efficient federated unlearning approach. In: 2023 IEEE International Conference on Data Mining (ICDM), pp. 1439–1444. IEEE (2023)
Yang, Q., Liu, Y., Chen, T., Tong, Y.: Federated machine learning: concept and applications. ACM Trans. Intell. Syst. Technol. (TIST) 10(2), 1–19 (2019)
Yue, X., Nouiehed, M., R, A.K.: Gifair-FL: a framework for group and individual fairness in federated learning. INFORMS J. Data Sci. 2(1), 10–23 (2023)
Zhao, J., Zhu, X., Wang, J., Xiao, J.: Efficient client contribution evaluation for horizontal federated learning. In: ICASSP 2021-2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 3060–3064. IEEE (2021)
Zhao, Z., Joshi, G.: A dynamic reweighting strategy for fair federated learning. In: ICASSP 2022-2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 8772–8776. IEEE (2022)
Acknowledgments
This research was supported by the National Science Foundation grants No. 2011845 and 2343619.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Ethics declarations
Disclosure of Interests
The authors have no competing interests to declare that are relevant to the content of this article.
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Wang, L., Xiong, Z., Luo, G., Li, W., Chen, A. (2024). FCFL: A Fairness Compensation-Based Federated Learning Scheme with Accumulated Queues. In: Bifet, A., Davis, J., Krilavičius, T., Kull, M., Ntoutsi, E., Žliobaitė, I. (eds) Machine Learning and Knowledge Discovery in Databases. Research Track. ECML PKDD 2024. Lecture Notes in Computer Science(), vol 14943. Springer, Cham. https://doi.org/10.1007/978-3-031-70352-2_23
Download citation
DOI: https://doi.org/10.1007/978-3-031-70352-2_23
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-70351-5
Online ISBN: 978-3-031-70352-2
eBook Packages: Computer ScienceComputer Science (R0)
