Skip to main content

Federated Learning - Opportunities and Application Challenges

  • Conference paper
  • First Online:
Advances in Computational Collective Intelligence (ICCCI 2023)

Abstract

In this paper our intention was to present a brief literature review focused on the latest research of the Federated Learning paradigm in order to identify current research trends, possible future directions of development, and challenges in this area. Federated learning as a new, powerful distributed intelligent paradigm can take on various forms in order to fit a diverse set of problems in a wide range of domains, economy, finance, medicine, agriculture and other industrial sectors. Based on presented research results, several key opportunities for future work can be identified and some emerging are connected to communication costs and performance of federated models trained by different algorithms.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 89.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 119.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Armacki, A., Bajovic, D., Jakovetic, D., Kar, S.: One-shot federated learning for model clustering and learning in heterogeneous environments. arXiv preprint arXiv:2209.10866 (2022)

  2. Armacki, A., Bajovic, D., Jakovetic, D., Kar, S.: Personalized federated learning via convex clustering. In: 2022 IEEE International Smart Cities Conference (ISC2), pp. 1–7. IEEE (2022)

    Google Scholar 

  3. Bian, J., Fu, Z., Xu, J.: FedSEAL: semi-supervised federated learning with self-ensemble learning and negative learning. arXiv preprint arXiv:2110.07829 (2021)

  4. Chen, Y., Ning, Y., Slawski, M., Rangwala, H.: Asynchronous online federated learning for edge devices with non-IID data. In: 2020 IEEE International Conference on Big Data (Big Data), pp. 15–24. IEEE (2020)

    Google Scholar 

  5. Diao, E., Ding, J., Tarokh, V.: SemiFL: semi-supervised federated learning for unlabeled clients with alternate training. In: Advances in Neural Information Processing Systems, vol. 35, pp. 17871–17884 (2022)

    Google Scholar 

  6. Fallah, A., Mokhtari, A., Ozdaglar, A.: Personalized federated learning: a meta-learning approach. arXiv preprint arXiv:2002.07948 (2020)

  7. Feng, C., Liu, B., Yu, K., Goudos, S.K., Wan, S.: Blockchain-empowered decentralized horizontal federated learning for 5G-enabled UAVs. IEEE Trans. Ind. Inf. 18(5), 3582–3592 (2021)

    Article  Google Scholar 

  8. Froelicher, D., et al.: Truly privacy-preserving federated analytics for precision medicine with multiparty homomorphic encryption. Nat. Commun. 12(1), 5910 (2021)

    Article  Google Scholar 

  9. Gadekallu, T.R., Pham, Q.V., Huynh-The, T., Bhattacharya, S., Maddikunta, P.K.R., Liyanage, M.: Federated learning for big data: a survey on opportunities, applications, and future directions. arXiv preprint arXiv:2110.04160 (2021)

  10. Gao, Y., et al.: End-to-end evaluation of federated learning and split learning for internet of things. arXiv preprint arXiv:2003.13376 (2020)

  11. Ivanovic, M., Autexier, S., Kokkonidis, M., Rust, J.: Quality medical data management within an open AI architecture - cancer patients case. Connect. Sci. 35(1), 2194581 (2023). https://doi.org/10.1080/09540091.2023.2194581

    Article  Google Scholar 

  12. Jiang, Y., Konečnỳ, J., Rush, K., Kannan, S.: Improving federated learning personalization via model agnostic meta learning. arXiv preprint arXiv:1909.12488 (2019)

  13. Kairouz, P., et al.: Advances and open problems in federated learning. Found. Trends® Mach. Learn. 14(1–2), 1–210 (2021)

    Google Scholar 

  14. Kim, Y., Sun, J., Yu, H., Jiang, X.: Federated tensor factorization for computational phenotyping. In: Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 887–895 (2017)

    Google Scholar 

  15. Li, L., Fan, Y., Tse, M., Lin, K.Y.: A review of applications in federated learning. Comput. Ind. Eng. 149, 106854 (2020)

    Article  Google Scholar 

  16. Li, T., Sanjabi, M., Beirami, A., Smith, V.: Fair resource allocation in federated learning. arXiv preprint arXiv:1905.10497 (2019)

  17. Li, Y., Chen, C., Liu, N., Huang, H., Zheng, Z., Yan, Q.: A blockchain-based decentralized federated learning framework with committee consensus. IEEE Netw. 35(1), 234–241 (2020)

    Article  Google Scholar 

  18. Long, G., Tan, Y., Jiang, J., Zhang, C.: Federated learning for open banking. In: Yang, Q., Fan, L., Yu, H. (eds.) Federated Learning. LNCS (LNAI), vol. 12500, pp. 240–254. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-63076-8_17

    Chapter  Google Scholar 

  19. McMahan, B., Moore, E., Ramage, D., Hampson, S., Arcas, B.A.: Communication-efficient learning of deep networks from decentralized data. In: Artificial Intelligence and Statistics, pp. 1273–1282. PMLR (2017)

    Google Scholar 

  20. Melis, L., Song, C., De Cristofaro, E., Shmatikov, V.: Exploiting unintended feature leakage in collaborative learning. In: 2019 IEEE Symposium on Security and Privacy (SP), pp. 691–706. IEEE (2019)

    Google Scholar 

  21. Niknam, S., Dhillon, H.S., Reed, J.H.: Federated learning for wireless communications: motivation, opportunities, and challenges. IEEE Commun. Mag. 58(6), 46–51 (2020)

    Article  Google Scholar 

  22. Niknam, S., et al.: Intelligent O-RAN for beyond 5G and 6G wireless networks. In: 2022 IEEE Globecom Workshops (GC Wkshps), pp. 215–220. IEEE (2022)

    Google Scholar 

  23. Nilsson, A., Smith, S., Ulm, G., Gustavsson, E., Jirstrand, M.: A performance evaluation of federated learning algorithms. In: Proceedings of the Second Workshop on Distributed Infrastructures for Deep Learning, pp. 1–8 (2018)

    Google Scholar 

  24. Pang, J., Huang, Y., Xie, Z., Li, J., Cai, Z.: Collaborative city digital twin for the Covid-19 pandemic: a federated learning solution. Tsinghua Sci. Technol. 26(5), 759–771 (2021)

    Article  Google Scholar 

  25. Polese, M., Bonati, L., D’Oro, S., Basagni, S., Melodia, T.: ColO-RAN: developing machine learning-based xApps for open RAN closed-loop control on programmable experimental platforms. IEEE Trans. Mob. Comput. (2022)

    Google Scholar 

  26. Pylianidis, C., Osinga, S., Athanasiadis, I.N.: Introducing digital twins to agriculture. Comput. Electron. Agric. 184, 105942 (2021)

    Article  Google Scholar 

  27. Roy, A.G., Siddiqui, S., Pölsterl, S., Navab, N., Wachinger, C.: BrainTorrent: a peer-to-peer environment for decentralized federated learning. arXiv preprint arXiv:1905.06731 (2019)

  28. Sattler, F., Müller, K.R., Samek, W.: Clustered federated learning: model-agnostic distributed multitask optimization under privacy constraints. IEEE Trans. Neural Netw. Learn. Syst. 32(8), 3710–3722 (2020)

    Article  MathSciNet  Google Scholar 

  29. Savić, M., et al.: The application of machine learning techniques in prediction of quality of life features for cancer patients. Comput. Sci. Inf. Syst. 20(1), 381–404 (2023)

    Article  Google Scholar 

  30. Shejwalkar, V., Houmansadr, A., Kairouz, P., Ramage, D.: Back to the drawing board: a critical evaluation of poisoning attacks on production federated learning. In: 2022 IEEE Symposium on Security and Privacy (SP), pp. 1354–1371. IEEE (2022)

    Google Scholar 

  31. Sheller, M.J., et al.: Federated learning in medicine: facilitating multi-institutional collaborations without sharing patient data. Sci. Rep. 10(1), 1–12 (2020)

    Article  Google Scholar 

  32. Taïk, A., Cherkaoui, S.: Electrical load forecasting using edge computing and federated learning. In: 2020 IEEE International Conference on Communications (ICC), ICC 2020, pp. 1–6. IEEE (2020)

    Google Scholar 

  33. Tan, A.Z., Yu, H., Cui, L., Yang, Q.: Towards personalized federated learning. IEEE Trans. Neural Netw. Learn. Syst. (2022)

    Google Scholar 

  34. Tun, Y.L., Thar, K., Thwal, C.M., Hong, C.S.: Federated learning based energy demand prediction with clustered aggregation. In: 2021 IEEE International Conference on Big Data and Smart Computing (BigComp), pp. 164–167. IEEE (2021)

    Google Scholar 

  35. Wu, W., He, L., Lin, W., Mao, R., Maple, C., Jarvis, S.: SAFA: a semi-asynchronous protocol for fast federated learning with low overhead. IEEE Trans. Comput. 70(5), 655–668 (2020)

    Article  MathSciNet  MATH  Google Scholar 

  36. Yang, Q., Liu, Y., Chen, T., Tong, Y.: Federated machine learning: concept and applications. ACM Trans. Intell. Syst. Technol. (TIST) 10(2), 1–19 (2019)

    Article  Google Scholar 

  37. Yu, T., Bagdasaryan, E., Shmatikov, V.: Salvaging federated learning by local adaptation. arXiv preprint arXiv:2002.04758 (2020)

  38. Zhu, L., Liu, Z., Han, S.: Deep leakage from gradients. In: Advances in Neural Information Processing Systems, vol. 32 (2019)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to Mihailo Ilić or Mirjana Ivanović .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Ilić, M., Ivanović, M. (2023). Federated Learning - Opportunities and Application Challenges. In: Nguyen, N.T., et al. Advances in Computational Collective Intelligence. ICCCI 2023. Communications in Computer and Information Science, vol 1864. Springer, Cham. https://doi.org/10.1007/978-3-031-41774-0_38

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-41774-0_38

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-41773-3

  • Online ISBN: 978-3-031-41774-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics