Abstract
In this paper our intention was to present a brief literature review focused on the latest research of the Federated Learning paradigm in order to identify current research trends, possible future directions of development, and challenges in this area. Federated learning as a new, powerful distributed intelligent paradigm can take on various forms in order to fit a diverse set of problems in a wide range of domains, economy, finance, medicine, agriculture and other industrial sectors. Based on presented research results, several key opportunities for future work can be identified and some emerging are connected to communication costs and performance of federated models trained by different algorithms.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Armacki, A., Bajovic, D., Jakovetic, D., Kar, S.: One-shot federated learning for model clustering and learning in heterogeneous environments. arXiv preprint arXiv:2209.10866 (2022)
Armacki, A., Bajovic, D., Jakovetic, D., Kar, S.: Personalized federated learning via convex clustering. In: 2022 IEEE International Smart Cities Conference (ISC2), pp. 1–7. IEEE (2022)
Bian, J., Fu, Z., Xu, J.: FedSEAL: semi-supervised federated learning with self-ensemble learning and negative learning. arXiv preprint arXiv:2110.07829 (2021)
Chen, Y., Ning, Y., Slawski, M., Rangwala, H.: Asynchronous online federated learning for edge devices with non-IID data. In: 2020 IEEE International Conference on Big Data (Big Data), pp. 15–24. IEEE (2020)
Diao, E., Ding, J., Tarokh, V.: SemiFL: semi-supervised federated learning for unlabeled clients with alternate training. In: Advances in Neural Information Processing Systems, vol. 35, pp. 17871–17884 (2022)
Fallah, A., Mokhtari, A., Ozdaglar, A.: Personalized federated learning: a meta-learning approach. arXiv preprint arXiv:2002.07948 (2020)
Feng, C., Liu, B., Yu, K., Goudos, S.K., Wan, S.: Blockchain-empowered decentralized horizontal federated learning for 5G-enabled UAVs. IEEE Trans. Ind. Inf. 18(5), 3582–3592 (2021)
Froelicher, D., et al.: Truly privacy-preserving federated analytics for precision medicine with multiparty homomorphic encryption. Nat. Commun. 12(1), 5910 (2021)
Gadekallu, T.R., Pham, Q.V., Huynh-The, T., Bhattacharya, S., Maddikunta, P.K.R., Liyanage, M.: Federated learning for big data: a survey on opportunities, applications, and future directions. arXiv preprint arXiv:2110.04160 (2021)
Gao, Y., et al.: End-to-end evaluation of federated learning and split learning for internet of things. arXiv preprint arXiv:2003.13376 (2020)
Ivanovic, M., Autexier, S., Kokkonidis, M., Rust, J.: Quality medical data management within an open AI architecture - cancer patients case. Connect. Sci. 35(1), 2194581 (2023). https://doi.org/10.1080/09540091.2023.2194581
Jiang, Y., Konečnỳ, J., Rush, K., Kannan, S.: Improving federated learning personalization via model agnostic meta learning. arXiv preprint arXiv:1909.12488 (2019)
Kairouz, P., et al.: Advances and open problems in federated learning. Found. Trends® Mach. Learn. 14(1–2), 1–210 (2021)
Kim, Y., Sun, J., Yu, H., Jiang, X.: Federated tensor factorization for computational phenotyping. In: Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 887–895 (2017)
Li, L., Fan, Y., Tse, M., Lin, K.Y.: A review of applications in federated learning. Comput. Ind. Eng. 149, 106854 (2020)
Li, T., Sanjabi, M., Beirami, A., Smith, V.: Fair resource allocation in federated learning. arXiv preprint arXiv:1905.10497 (2019)
Li, Y., Chen, C., Liu, N., Huang, H., Zheng, Z., Yan, Q.: A blockchain-based decentralized federated learning framework with committee consensus. IEEE Netw. 35(1), 234–241 (2020)
Long, G., Tan, Y., Jiang, J., Zhang, C.: Federated learning for open banking. In: Yang, Q., Fan, L., Yu, H. (eds.) Federated Learning. LNCS (LNAI), vol. 12500, pp. 240–254. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-63076-8_17
McMahan, B., Moore, E., Ramage, D., Hampson, S., Arcas, B.A.: Communication-efficient learning of deep networks from decentralized data. In: Artificial Intelligence and Statistics, pp. 1273–1282. PMLR (2017)
Melis, L., Song, C., De Cristofaro, E., Shmatikov, V.: Exploiting unintended feature leakage in collaborative learning. In: 2019 IEEE Symposium on Security and Privacy (SP), pp. 691–706. IEEE (2019)
Niknam, S., Dhillon, H.S., Reed, J.H.: Federated learning for wireless communications: motivation, opportunities, and challenges. IEEE Commun. Mag. 58(6), 46–51 (2020)
Niknam, S., et al.: Intelligent O-RAN for beyond 5G and 6G wireless networks. In: 2022 IEEE Globecom Workshops (GC Wkshps), pp. 215–220. IEEE (2022)
Nilsson, A., Smith, S., Ulm, G., Gustavsson, E., Jirstrand, M.: A performance evaluation of federated learning algorithms. In: Proceedings of the Second Workshop on Distributed Infrastructures for Deep Learning, pp. 1–8 (2018)
Pang, J., Huang, Y., Xie, Z., Li, J., Cai, Z.: Collaborative city digital twin for the Covid-19 pandemic: a federated learning solution. Tsinghua Sci. Technol. 26(5), 759–771 (2021)
Polese, M., Bonati, L., D’Oro, S., Basagni, S., Melodia, T.: ColO-RAN: developing machine learning-based xApps for open RAN closed-loop control on programmable experimental platforms. IEEE Trans. Mob. Comput. (2022)
Pylianidis, C., Osinga, S., Athanasiadis, I.N.: Introducing digital twins to agriculture. Comput. Electron. Agric. 184, 105942 (2021)
Roy, A.G., Siddiqui, S., Pölsterl, S., Navab, N., Wachinger, C.: BrainTorrent: a peer-to-peer environment for decentralized federated learning. arXiv preprint arXiv:1905.06731 (2019)
Sattler, F., Müller, K.R., Samek, W.: Clustered federated learning: model-agnostic distributed multitask optimization under privacy constraints. IEEE Trans. Neural Netw. Learn. Syst. 32(8), 3710–3722 (2020)
Savić, M., et al.: The application of machine learning techniques in prediction of quality of life features for cancer patients. Comput. Sci. Inf. Syst. 20(1), 381–404 (2023)
Shejwalkar, V., Houmansadr, A., Kairouz, P., Ramage, D.: Back to the drawing board: a critical evaluation of poisoning attacks on production federated learning. In: 2022 IEEE Symposium on Security and Privacy (SP), pp. 1354–1371. IEEE (2022)
Sheller, M.J., et al.: Federated learning in medicine: facilitating multi-institutional collaborations without sharing patient data. Sci. Rep. 10(1), 1–12 (2020)
Taïk, A., Cherkaoui, S.: Electrical load forecasting using edge computing and federated learning. In: 2020 IEEE International Conference on Communications (ICC), ICC 2020, pp. 1–6. IEEE (2020)
Tan, A.Z., Yu, H., Cui, L., Yang, Q.: Towards personalized federated learning. IEEE Trans. Neural Netw. Learn. Syst. (2022)
Tun, Y.L., Thar, K., Thwal, C.M., Hong, C.S.: Federated learning based energy demand prediction with clustered aggregation. In: 2021 IEEE International Conference on Big Data and Smart Computing (BigComp), pp. 164–167. IEEE (2021)
Wu, W., He, L., Lin, W., Mao, R., Maple, C., Jarvis, S.: SAFA: a semi-asynchronous protocol for fast federated learning with low overhead. IEEE Trans. Comput. 70(5), 655–668 (2020)
Yang, Q., Liu, Y., Chen, T., Tong, Y.: Federated machine learning: concept and applications. ACM Trans. Intell. Syst. Technol. (TIST) 10(2), 1–19 (2019)
Yu, T., Bagdasaryan, E., Shmatikov, V.: Salvaging federated learning by local adaptation. arXiv preprint arXiv:2002.04758 (2020)
Zhu, L., Liu, Z., Han, S.: Deep leakage from gradients. In: Advances in Neural Information Processing Systems, vol. 32 (2019)
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Ilić, M., Ivanović, M. (2023). Federated Learning - Opportunities and Application Challenges. In: Nguyen, N.T., et al. Advances in Computational Collective Intelligence. ICCCI 2023. Communications in Computer and Information Science, vol 1864. Springer, Cham. https://doi.org/10.1007/978-3-031-41774-0_38
Download citation
DOI: https://doi.org/10.1007/978-3-031-41774-0_38
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-41773-3
Online ISBN: 978-3-031-41774-0
eBook Packages: Computer ScienceComputer Science (R0)