Abstract
In Internet of Vehicles (IoV) system, Federated Learning (FL) is a novel distributed approach to processing real-time vehicle data that enables training of shared learning models while ensuring data privacy. However, existing FL still face numerous challenges in IoV. Firstly, the fast convergence with FL models is difficult to achieve due to the high mobility of vehicles and the non-independent identical distribution (Non-IID) among data collected by vehicles. Moreover, the parameter aggregation process of FL incurs significant communication overhead, and the varying computing power of vehicles results in the straggler. To address these issues, this paper proposes a Cluster-based Semi-Asynchronous Federated Learning framework for IoV (CSA_FedVeh). Specifically, we propose a Space-Time and Weight DBSCAN density clustering algorithm (STW-DBSCAN) that relies on both the space-time location and model weight similarities of vehicles. Clustering of vehicles can alleviate the impact of Non-IID data, and the joint training of data vehicles can reduce resource consumption and mitigate the straggler effect. In addition, we adopt a semi-asynchronous FL aggregation mechanism to reduce communication time and improve FL efficiency. Experimental results show that compared with baselines under Non-IID datasets, CSA_FedVeh can reduce the running time by about 24.6% to 60.2%, and reduce communication consumption by 3.4% to 62.07% on MNIST dataset and 1.01% to 68.6% on GTSRD dataset.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Banabilah, S., Aloqaily, M., Alsayed, E., Malik, N., Jararweh, Y.: Federated learning review: fundamentals, enabling technologies, and future applications. Inf. Process. Manage. 59(6), 103061 (2022)
Chaudhry, S.A.: Designing an efficient and secure message exchange protocol for internet of vehicles. Secur. Commun. Netw. 2021, 1–9 (2021). https://doi.org/10.1155/2021/5554318
Liu, S., Liu, L., Tang, J., Yu, B., Wang, Y., Shi, W.: Edge computing for autonomous driving: opportunities and challenges. Proc. IEEE 107(8), 1697–1716 (2019). https://doi.org/10.1109/jproc.2019.2915983
McMahan, B., Moore, E., Ramage, D., Hampson, S., y Arcas, B.A.: Communication-efficient learning of deep networks from decentralized data. In: Artificial Intelligence and Statistics, pp. 1273–1282. PMLR (2017)
Cao, H., et al.: Prevention of GAN-based privacy inferring attacks towards federated learning. In: Gao, H., Wang, X., Wei, W., Dagiuklas, T. (eds.) Collaborative Computing: Networking, Applications and Worksharing. CollaborateCom 2022. LNICS, Social Informatics and Telecommunications Engineering, vol. 461, pp. 39–54. Springer, Cham (2022). https://doi.org/10.1007/978-3-031-24386-8_3
Pan, S.J., Yang, Q.: A survey on transfer learning. IEEE Trans. Knowl. Data Eng. 22(10), 1345–1359 (2009). https://doi.org/10.1109/tkde.2009.191
Li, Q., Diao, Y., Chen, Q., He, B.: Federated learning on non-iid data silos: an experimental study. In: 2022 IEEE 38th International Conference on Data Engineering (ICDE), pp. 965–978. IEEE (2022). https://doi.org/10.1109/icde53745.2022.00077
Huang, X., Li, P., Yu, R., Wu, Y., Xie, K., Xie, S.: Fedparking: a federated learning based parking space estimation with parked vehicle assisted edge computing. IEEE Trans. Veh. Technol. 70(9), 9355–9368 (2021). https://doi.org/10.1109/tvt.2021.3098170
Liang, F., Yang, Q., Liu, R., Wang, J., Sato, K., Guo, J.: Semi-synchronous federated learning protocol with dynamic aggregation in internet of vehicles. IEEE Trans. Veh. Technol. 71(5), 4677–4691 (2022). https://doi.org/10.1109/tvt.2022.3148872
Huang, J., Xu, C., Ji, Z., Xiao, S., Liu, T., Ma, N., Zhou, Q., et al.: AFLPC: an asynchronous federated learning privacy-preserving computing model applied to 5g–v2x. Security and Communication Networks 2022 (2022). https://doi.org/10.1155/2022/9334943
Ma, M., Wu, L., Liu, W., Chen, N., Shao, Z., Yang, Y.: Data-aware hierarchical federated learning via task offloading. In: GLOBECOM 2022–2022 IEEE Global Communications Conference, pp. 1–6. IEEE (2022). https://doi.org/10.1109/globecom48099.2022.10000924
Briggs, C., Fan, Z., Andras, P.: Federated learning with hierarchical clustering of local updates to improve training on non-iid data. In: 2020 International Joint Conference on Neural Networks (IJCNN), pp. 1–9. IEEE (2020). https://doi.org/10.1109/ijcnn48605.2020.9207469
Tan, Y., Long, G., Liu, L., Zhou, T., Lu, Q., Jiang, J., Zhang, C.: FedProto: federated prototype learning across heterogeneous clients. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 36, pp. 8432–8440 (2022). https://doi.org/10.1609/aaai.v36i8.20819
Xie, C., Koyejo, S., Gupta, I.: Asynchronous federated optimization. arXiv preprint arXiv:1903.03934 (2019)
Vu, T.T., Ngo, D.T., Ngo, H.Q., Dao, M.N., Tran, N.H., Middleton, R.H.: User selection approaches to mitigate the straggler effect for federated learning on cell-free massive MIMO networks. arXiv preprint arXiv:2009.02031 (2020)
Wu, W., He, L., Lin, W., Mao, R., Maple, C., Jarvis, S.: Safa: a semi-asynchronous protocol for fast federated learning with low overhead. IEEE Trans. Comput. 70(5), 655–668 (2020). https://doi.org/10.1109/tc.2020.2994391
Sun, J., et al.: FedSEA: a semi-asynchronous federated learning framework for extremely heterogeneous devices. In: Proceedings of the 20th ACM Conference on Embedded Networked Sensor Systems, pp. 106–119 (2022). https://doi.org/10.1145/3560905.3568538
Ma, Q., Xu, Y., Xu, H., Jiang, Z., Huang, L., Huang, H.: FedSA: a semi-asynchronous federated learning mechanism in heterogeneous edge computing. IEEE J. Sel. Areas Commun. 39(12), 3654–3672 (2021). https://doi.org/10.1109/jsac.2021.3118435
Xiao, H., Zhao, J., Pei, Q., Feng, J., Liu, L., Shi, W.: Vehicle selection and resource optimization for federated learning in vehicular edge computing. IEEE Trans. Intell. Transp. Syst. 23(8), 11073–11087 (2021)
Ester, M., Kriegel, H.P., Sander, J., Xu, X., et al.: A density-based algorithm for discovering clusters in large spatial databases with noise. In: kdd. vol. 96, pp. 226–231 (1996)
MacQueen, J., et al.: Some methods for classification and analysis of multivariate observations. In: Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability, vol. 1, pp. 281–297. Oakland, CA, USA (1967)
Hosmer Jr, D.W., Lemeshow, S., Sturdivant, R.X.: Applied Logistic Regression, vol. 398. Wiley, Hoboken (2013)
Shalev-Shwartz, S., Ben-David, S.: Understanding Machine Learning: From Theory to Algorithms. Cambridge University Press, Cambridge (2014)
LeCun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition. Proc. IEEE 86(11), 2278–2324 (1998). https://doi.org/10.1109/5.726791
Stallkamp, J., Schlipsing, M., Salmen, J., Igel, C.: Man vs. computer: Benchmarking machine learning algorithms for traffic sign recognition. Neural Netw. 32, 323–332 (2012). https://doi.org/10.1016/j.neunet.2012.02.016
Marfoq, O., Neglia, G., Bellet, A., Kameni, L., Vidal, R.: Federated multi-task learning under a mixture of distributions. Adv. Neural. Inf. Process. Syst. 34, 15434–15447 (2021)
Acknowledgment
This work was supported by the National Natural Science Foundation of China (No.62272063, No.62072056 and No.61902041), the Natural Science Foundation of Hunan Province (No.2022JJ30617 and No.2020JJ2029), open research fund of Key Lab of Broadband Wireless Communication and Sensor Network Technology, Nanjing University of Posts and Telecommunications (No.JZNY202102), Standardization Project of Transportation Department of Hunan Province (B202108), Hunan Provincial Key Research and Development Program (2022GK2019) and the Scientific Research Fund of Hunan Provincial Transportation Department (No.202143).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering
About this paper
Cite this paper
Cao, D., Xiong, J., Lei, N., Sherratt, R.S., Wang, J. (2024). CSA_FedVeh: Cluster-Based Semi-asynchronous Federated Learning Framework for Internet of Vehicles. In: Gao, H., Wang, X., Voros, N. (eds) Collaborative Computing: Networking, Applications and Worksharing. CollaborateCom 2023. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 563. Springer, Cham. https://doi.org/10.1007/978-3-031-54531-3_5
Download citation
DOI: https://doi.org/10.1007/978-3-031-54531-3_5
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-54530-6
Online ISBN: 978-3-031-54531-3
eBook Packages: Computer ScienceComputer Science (R0)