Abstract
Federated learning (FL) is an effective way to incorporate information provided by different clients when a single local client is unable to provide sufficient training samples for establishing a satisfactory deep learning model to diagnose rolling bearing faults, which plays an important role in ensuring the safe operations of motors. However, it is difficult to guarantee the effectiveness of FL when clients operating in different working conditions suffer from network attacks. This paper aims to study a new personalized FL (PFL) mechanism to secure each client’s maximum benefit from the federation process such that the negative effects of condition variations or network attacks can be effectively prevented. By designing the inconsistency between the local model and the inherited global model, the information screening process in PFL is guided to ensure that each local client receives the maximum benefit. The model inconsistency derived from a certain round of federation is characterized by the output of an attention mechanism. Since personalized client information is emphasized, the proposed method can build reliable FL fault diagnosis models from unreliable samples in cases with attacked client-side sample data. The effectiveness of the proposed method is validated by using the benchmark dataset provided by the Rolling Bearing Center of Case Western Reserve University. In the case when a certain client suffers from a strong network attack, the proposed method can achieve a fault diagnosis accuracy improvement of 27.11% over the existing FL fault diagnosis methods.
Graphical abstract










Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Fernandes M, Corchado JM, Marreiros G (2022) Machine learning techniques applied to mechanical fault diagnosis and fault prognosis in the context of real industrial manufacturing use-cases: a systematic literature review[J]. Appl Intell 52(12):14246–14280
Chen P, Zhao X, Zhu Q (2020) A novel classification method based on ICGOA-KELM for fault diagnosis of rolling bearing[J]. Appl Intell 50:2833–2847
Peng B, Xia H, Lv X et al (2022) An intelligent fault diagnosis method for rotating machinery based on data fusion and deep residual neural network[J]. Appl Intell 52(3):3051–3065
Jiaocheng M, Jinan S, Xin Z et al (2022) Bayes-DCGRU with bayesian optimization for rolling bearing fault diagnosis[J]. Appl Intell 52(10):11172–11183
Song Z, Wang Y, Qian P et al (2022) From deterministic to stochastic: an interpretable stochastic model-free reinforcement learning framework for portfolio optimization[J]. Appl Intell 1–16
Kong W, Luo Y, Qin Z et al (2019) Comprehensive fault diagnosis and fault-tolerant protection of in-vehicle intelligent electric power supply network[J]. IEEE Trans Veh Technol 68(11):10453–10464
Zhu Z, Lei Y, Qi G et al (2022) A review of the application of deep learning in intelligent fault diagnosis of rotating machinery[J]. Measurement 112346
Wu J, Tang T, Chen M et al (2020) A study on adaptation lightweight architecture based deep learning models for bearing fault diagnosis under varying working conditions[J]. Expert Syst Appl 160:113710
Zhao B, Zhang X, Zhan Z et al (2020) Deep multi-scale convolutional transfer learning network: A novel method for intelligent fault diagnosis of rolling bearings under variable working conditions and domains[J]. Neurocomputing 407:24–38
Zhao B, Zhang X, Li H et al (2020) Intelligent fault diagnosis of rolling bearings based on normalized CNN considering data imbalance and variable working conditions[J]. Knowl-Based Syst 199:105971
Wu X, Zhang Y, Shi M et al (2022) An adaptive federated learning scheme with differential privacy preserving[J]. Futur Gener Comput Syst 127:362–372
Zhang Z, Xu X, Gong W et al (2021) Efficient federated convolutional neural network with information fusion for rolling bearing fault diagnosis[J]. Control Eng Pract 116:104913
Ma X, Wen C, Wen T (2021) An asynchronous and real-time update paradigm of federated learning for fault diagnosis[J]. IEEE Trans Industr Inf 17(12):8531–8540
Zhang W, Li X, Ma H et al (2021) Federated learning for machinery fault diagnosis with dynamic validation and self-supervision[J]. Knowl-Based Syst 213:106679
Tan A Z, Yu H, Cui L et al (2022) Towards personalized federated learning[J]. IEEE Transactions on Neural Networks and Learning Systems
T Dinh C, Tran N, Nguyen J (2020) Personalized federated learning with Moreau envelopes[J]. Adv Neural Inf Process Syst 33:21394–21405
Li T, Sahu AK, Zaheer M et al (2020) Federated optimization in heterogeneous networks[J]. Proceedings of Machine learning and systems 2:429–450
Mills J, Hu J, Min G (2021) Multi-task federated learning for personalised deep neural networks in edge computing[J]. IEEE Trans Parallel Distrib Syst 33(3):630–641
Hu R, Guo Y, Li H et al (2020) Personalized federated learning with differential privacy[J]. IEEE Internet Things J 7(10):9530–9539
Singhal K, Sidahmed H, Garrett Z et al (2021) Federated reconstruction: Partially local federated learning[J]. Adv Neural Inf Process Syst 34:11220–11232
Zhu H, Xu J, Liu S et al (2021) Federated learning on non-IID data: A survey[J]. Neurocomputing 465:371–390
Pei J, Zhong K, Jan MA et al (2022) Personalized federated learning framework for network traffic anomaly detection[J]. Comput Netw 209:108906
McMahan B, Moore E, Ramage D et al (2017) Communication-efficient learning of deep networks from decentralized data[C]. Artificial Intelligence and Statistics. PMLR, pp 1273–1282
Zhao Z, Li T, An B et al (2022) Model-driven deep unrolling: Towards interpretable deep learning against noise attacks for intelligent fault diagnosis[J]. ISA Trans 129:644–662
Ghimire B, Rawat DB (2022) Recent advances on federated learning for cybersecurity and cybersecurity for federated learning for internet of things[J]. IEEE Internet Things J
Romano Y, Aberdam A, Sulam J et al (2020) Adversarial noise attacks of deep learning architectures: Stability analysis via sparse-modeled signals[J]. J Math Imag Vis 62:313–327
Zhu J, Cao J, Saxena D et al (2023) Blockchain-empowered federated learning: Challenges, solutions, and future directions[J]. ACM Comput Surv 55(11):1–31
Wu C, Wu F, Lyu L et al (2022) Communication-efficient federated learning via knowledge distillation[J]. Nat Commun 13(1):2032
Adnan M, Kalra S, Cresswell JC et al (2022) Federated learning and differential privacy for medical image analysis[J]. Sci Rep 12(1):1953
Boobalan P, Ramu SP, Pham QV et al (2022) Fusion of federated learning and industrial Internet of Things: A survey[J]. Comput Netw 212:109048
Zhang K, Song X, Zhang C et al (2022) Challenges and future directions of secure federated learning: a survey[J]. Front Comp Sci 16:1–8
Li T, Sahu AK, Talwalkar A et al (2020) Federated learning: Challenges, methods, and future directions[J]. IEEE Signal Process Mag 37(3):50–60
Wu Q, He K, Chen X (2020) Personalized federated learning for intelligent IoT applications: A cloud-edge based framework[J]. IEEE Open J Comput Soc 1:35–44
Banabilah S, Aloqaily M, Alsayed E et al (2022) Federated learning review: Fundamentals, enabling technologies, and future applications[J]. Inf Process Manage 59(6):103061
Cho YJ, Wang J, Chirvolu T et al (2023) Communication-efficient and model-heterogeneous personalized federated learning via clustered knowledge transfer[J]. IEEE J Select Topics Signal Process
Yang L, Huang J, Lin W et al (2023) Personalized federated learning on non-iid data via group-based meta-learning[J]. ACM Trans Knowl Discov Data 17(4):1–20
Wang J, Xu G, Lei W et al (2022) CPFL: an effective secure cognitive personalized federated learning mechanism for Industry 4.0[J]. IEEE Trans Industr Inf 18(10):7186–7195
Cao X, Sun G, Yu H et al (2022) PerFED-GAN: Personalized federated learning via generative adversarial networks[J]. IEEE Internet Things J
Zhang W, Chen X, He K et al (2022) Semi-asynchronous personalized federated learning for short-term photovoltaic power forecasting[J]. Digital Commun Netw
Case western reserve university bearing data center website: https://engineering.case.edu/bearingdatacenter/welcome
Acknowledgements
This work was supported by the National Natural Science Foundation of China (62073213), the Opening Project of Guangdong Provincial Key Lab of Robotics and Intelligent System and the Shanghai Maritime University Graduate Student Training Program for Top Innovative Talents (2022YBR016). The authors would like to thank Case Western Reserve University for providing motor bearing vibration data.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflicts of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Zhang, Z., Zhou, F., Zhang, C. et al. A personalized federated learning-based fault diagnosis method for data suffering from network attacks. Appl Intell 53, 22834–22849 (2023). https://doi.org/10.1007/s10489-023-04753-8
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10489-023-04753-8