Abstract
The collaboration of multiple organizations, such as hospitals, with access to data, can expedite the training process, resulting in superior machine learning models with increased data availability. However, the sensitivity of medical data poses challenges to information sharing without compromising privacy and confidentiality. Federated Learning (FL) offers a promising solution by enabling collaborative training through a data-sharing-free approach. Nevertheless, a large number of FL aggregation algorithms assume clients are honest, leaving the global model vulnerable to poisoning attacks. Approaches to safeguard against such attacks often add high computational costs, making them unsuitable for practical applications. In this work, we propose a robust aggregation rule, named Trimmed-Median Neighbourhood, for Byzantine-tolerant machine learning, offering computational efficiency and resilience to various attacks. Our method achieves up to a 2% improvement over the baseline and modified approaches in an adversarial attack setting on a non-IID data split from the HAM10000 dataset while maintaining low computational requirements. The code is available here.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Barragán-Montero, A., et al.: Artificial intelligence and machine learning for medical imaging: a technology review. Physica Med. 83, 242–256 (2021)
Bansal, A., Sharma, R., Kathuria, M.: A systematic review on data scarcity problem in deep learning: solution and applications. ACM Comput. Surv. (CSUR) 54(10s), 1–29 (2022)
US Department of Health and Human Services. Hipaa (2020). https://www.hhs.gov/hipaa/index.html
Van Panhuis, W.G., et al.: A systematic review of barriers to data sharing in public health. BMC Public Health 14(1), 1–9 (2014)
Kaushal, A., Altman, R., Langlotz, C.: Health care AI systems are biased. Sci. Am. 11, 17 (2020)
McMahan, B., Moore, E., Ramage, D., Hampson, S., Aguera y Arcas, B.: Communication-efficient learning of deep networks from decentralized data. In: Artificial Intelligence and Statistics, pp. 1273–1282. PMLR (2017)
Guan, H., Liu, M.: Federated learning for medical image analysis: a survey. arXiv preprint arXiv:2306.05980 (2023)
Zhang, J., Li, C., Qi, J., He, J.: A survey on class imbalance in federated learning. arXiv preprint arXiv:2303.11673 (2023)
Zhu, H., Jinjin, X., Liu, S., Jin, Y.: Federated learning on non-IID data: a survey. Neurocomputing 465, 371–390 (2021)
Fu, S., Xie, C., Li, B., Chen, Q.: Attack-resistant federated learning with residual-based reweighting. arXiv preprint arXiv:1912.11464 (2019)
Lamport, L.: The weak byzantine generals problem. J. ACM (JACM) 30(3), 668–676 (1983)
Li, T., Kumar Sahu, A., Talwalkar, A., Smith, V.: Federated learning: challenges, methods, and future directions. IEEE Signal Process. Mag. 37(3), 50–60 (2020)
Wang, H., Yurochkin, H., Sun, Y., Papailiopoulos, D., Khazaeni, Y.: Federated learning with matched averaging. arXiv preprint arXiv:2002.06440 (2020)
Wang, J., Liu, Q., Liang, H., Joshi, G., Poor, H.V.: Tackling the objective inconsistency problem in heterogeneous federated optimization. Adv. Neural. Inf. Process. Syst. 33, 7611–7623 (2020)
Blanchard, P., Mhamdi, El.M., Guerraoui, R., Stainer, J.: Machine learning with adversaries: Byzantine tolerant gradient descent. In: Advances in Neural Information Processing Systems, vol. 30 (2017)
Yin, D., Chen, Y., Kannan, R., Bartlett, P.: Byzantine-robust distributed learning: towards optimal statistical rates. In: International Conference on Machine Learning, pp. 5650–5659. PMLR, (2018)
Alkhunaizi, N., Kamzolov, D., Takáč, M., Nandakumar, K.: Suppressing poisoning attacks on federated learning for medical imaging. In: Medical Image Computing and Computer Assisted Intervention–MICCAI 2022: 25th International Conference, Singapore, September 18–22, 2022, Proceedings, Part VIII, pp. 673–683. Springer, Cham (2022). https://doi.org/10.1007/978-3-031-16452-1_64
Li, Z., Zhao, Y., Botta, N., Ionescu, C., Hu, X.: COPOD: copula-based outlier detection. In: 2020 IEEE International Conference on Data Mining (ICDM), pp. 1118–1123. IEEE (2020)
Tschandl, P., Rosendahl, C., Kittler, H.: The ham10000 dataset, a large collection of multi-source dermatoscopic images of common pigmented skin lesions. Sci. Data 5(1), 1–9 (2018)
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Hashmi, A.U.R., Azz, M.EA. (2024). TMN: An Efficient Robust Aggregator for Federated Learning. In: Su, R., Zhang, YD., Frangi, A.F. (eds) Proceedings of 2023 International Conference on Medical Imaging and Computer-Aided Diagnosis (MICAD 2023). MICAD 2023. Lecture Notes in Electrical Engineering, vol 1166. Springer, Singapore. https://doi.org/10.1007/978-981-97-1335-6_26
Download citation
DOI: https://doi.org/10.1007/978-981-97-1335-6_26
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-97-1334-9
Online ISBN: 978-981-97-1335-6
eBook Packages: Computer ScienceComputer Science (R0)