Skip to main content

Part of the book series: Lecture Notes in Electrical Engineering ((LNEE,volume 1166))

  • 396 Accesses

Abstract

The collaboration of multiple organizations, such as hospitals, with access to data, can expedite the training process, resulting in superior machine learning models with increased data availability. However, the sensitivity of medical data poses challenges to information sharing without compromising privacy and confidentiality. Federated Learning (FL) offers a promising solution by enabling collaborative training through a data-sharing-free approach. Nevertheless, a large number of FL aggregation algorithms assume clients are honest, leaving the global model vulnerable to poisoning attacks. Approaches to safeguard against such attacks often add high computational costs, making them unsuitable for practical applications. In this work, we propose a robust aggregation rule, named Trimmed-Median Neighbourhood, for Byzantine-tolerant machine learning, offering computational efficiency and resilience to various attacks. Our method achieves up to a 2% improvement over the baseline and modified approaches in an adversarial attack setting on a non-IID data split from the HAM10000 dataset while maintaining low computational requirements. The code is available here.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Barragán-Montero, A., et al.: Artificial intelligence and machine learning for medical imaging: a technology review. Physica Med. 83, 242–256 (2021)

    Article  Google Scholar 

  2. Bansal, A., Sharma, R., Kathuria, M.: A systematic review on data scarcity problem in deep learning: solution and applications. ACM Comput. Surv. (CSUR) 54(10s), 1–29 (2022)

    Google Scholar 

  3. US Department of Health and Human Services. Hipaa (2020). https://www.hhs.gov/hipaa/index.html

  4. Van Panhuis, W.G., et al.: A systematic review of barriers to data sharing in public health. BMC Public Health 14(1), 1–9 (2014)

    Google Scholar 

  5. Kaushal, A., Altman, R., Langlotz, C.: Health care AI systems are biased. Sci. Am. 11, 17 (2020)

    Google Scholar 

  6. McMahan, B., Moore, E., Ramage, D., Hampson, S., Aguera y Arcas, B.: Communication-efficient learning of deep networks from decentralized data. In: Artificial Intelligence and Statistics, pp. 1273–1282. PMLR (2017)

    Google Scholar 

  7. Guan, H., Liu, M.: Federated learning for medical image analysis: a survey. arXiv preprint arXiv:2306.05980 (2023)

  8. Zhang, J., Li, C., Qi, J., He, J.: A survey on class imbalance in federated learning. arXiv preprint arXiv:2303.11673 (2023)

  9. Zhu, H., Jinjin, X., Liu, S., Jin, Y.: Federated learning on non-IID data: a survey. Neurocomputing 465, 371–390 (2021)

    Article  Google Scholar 

  10. Fu, S., Xie, C., Li, B., Chen, Q.: Attack-resistant federated learning with residual-based reweighting. arXiv preprint arXiv:1912.11464 (2019)

  11. Lamport, L.: The weak byzantine generals problem. J. ACM (JACM) 30(3), 668–676 (1983)

    Article  MathSciNet  Google Scholar 

  12. Li, T., Kumar Sahu, A., Talwalkar, A., Smith, V.: Federated learning: challenges, methods, and future directions. IEEE Signal Process. Mag. 37(3), 50–60 (2020)

    Article  Google Scholar 

  13. Wang, H., Yurochkin, H., Sun, Y., Papailiopoulos, D., Khazaeni, Y.: Federated learning with matched averaging. arXiv preprint arXiv:2002.06440 (2020)

  14. Wang, J., Liu, Q., Liang, H., Joshi, G., Poor, H.V.: Tackling the objective inconsistency problem in heterogeneous federated optimization. Adv. Neural. Inf. Process. Syst. 33, 7611–7623 (2020)

    Google Scholar 

  15. Blanchard, P., Mhamdi, El.M., Guerraoui, R., Stainer, J.: Machine learning with adversaries: Byzantine tolerant gradient descent. In: Advances in Neural Information Processing Systems, vol. 30 (2017)

    Google Scholar 

  16. Yin, D., Chen, Y., Kannan, R., Bartlett, P.: Byzantine-robust distributed learning: towards optimal statistical rates. In: International Conference on Machine Learning, pp. 5650–5659. PMLR, (2018)

    Google Scholar 

  17. Alkhunaizi, N., Kamzolov, D., Takáč, M., Nandakumar, K.: Suppressing poisoning attacks on federated learning for medical imaging. In: Medical Image Computing and Computer Assisted Intervention–MICCAI 2022: 25th International Conference, Singapore, September 18–22, 2022, Proceedings, Part VIII, pp. 673–683. Springer, Cham (2022). https://doi.org/10.1007/978-3-031-16452-1_64

  18. Li, Z., Zhao, Y., Botta, N., Ionescu, C., Hu, X.: COPOD: copula-based outlier detection. In: 2020 IEEE International Conference on Data Mining (ICDM), pp. 1118–1123. IEEE (2020)

    Google Scholar 

  19. Tschandl, P., Rosendahl, C., Kittler, H.: The ham10000 dataset, a large collection of multi-source dermatoscopic images of common pigmented skin lesions. Sci. Data 5(1), 1–9 (2018)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to Anees Ur Rehman Hashmi or Mohammed El-Amine Azz .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Hashmi, A.U.R., Azz, M.EA. (2024). TMN: An Efficient Robust Aggregator for Federated Learning. In: Su, R., Zhang, YD., Frangi, A.F. (eds) Proceedings of 2023 International Conference on Medical Imaging and Computer-Aided Diagnosis (MICAD 2023). MICAD 2023. Lecture Notes in Electrical Engineering, vol 1166. Springer, Singapore. https://doi.org/10.1007/978-981-97-1335-6_26

Download citation

  • DOI: https://doi.org/10.1007/978-981-97-1335-6_26

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-97-1334-9

  • Online ISBN: 978-981-97-1335-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics