Skip to main content

Advertisement

Log in

A personalized federated learning-based fault diagnosis method for data suffering from network attacks

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

Federated learning (FL) is an effective way to incorporate information provided by different clients when a single local client is unable to provide sufficient training samples for establishing a satisfactory deep learning model to diagnose rolling bearing faults, which plays an important role in ensuring the safe operations of motors. However, it is difficult to guarantee the effectiveness of FL when clients operating in different working conditions suffer from network attacks. This paper aims to study a new personalized FL (PFL) mechanism to secure each client’s maximum benefit from the federation process such that the negative effects of condition variations or network attacks can be effectively prevented. By designing the inconsistency between the local model and the inherited global model, the information screening process in PFL is guided to ensure that each local client receives the maximum benefit. The model inconsistency derived from a certain round of federation is characterized by the output of an attention mechanism. Since personalized client information is emphasized, the proposed method can build reliable FL fault diagnosis models from unreliable samples in cases with attacked client-side sample data. The effectiveness of the proposed method is validated by using the benchmark dataset provided by the Rolling Bearing Center of Case Western Reserve University. In the case when a certain client suffers from a strong network attack, the proposed method can achieve a fault diagnosis accuracy improvement of 27.11% over the existing FL fault diagnosis methods.

Graphical abstract

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  1. Fernandes M, Corchado JM, Marreiros G (2022) Machine learning techniques applied to mechanical fault diagnosis and fault prognosis in the context of real industrial manufacturing use-cases: a systematic literature review[J]. Appl Intell 52(12):14246–14280

    Article  Google Scholar 

  2. Chen P, Zhao X, Zhu Q (2020) A novel classification method based on ICGOA-KELM for fault diagnosis of rolling bearing[J]. Appl Intell 50:2833–2847

    Article  Google Scholar 

  3. Peng B, Xia H, Lv X et al (2022) An intelligent fault diagnosis method for rotating machinery based on data fusion and deep residual neural network[J]. Appl Intell 52(3):3051–3065

    Article  Google Scholar 

  4. Jiaocheng M, Jinan S, Xin Z et al (2022) Bayes-DCGRU with bayesian optimization for rolling bearing fault diagnosis[J]. Appl Intell 52(10):11172–11183

    Article  Google Scholar 

  5. Song Z, Wang Y, Qian P et al (2022) From deterministic to stochastic: an interpretable stochastic model-free reinforcement learning framework for portfolio optimization[J]. Appl Intell 1–16

  6. Kong W, Luo Y, Qin Z et al (2019) Comprehensive fault diagnosis and fault-tolerant protection of in-vehicle intelligent electric power supply network[J]. IEEE Trans Veh Technol 68(11):10453–10464

    Article  Google Scholar 

  7. Zhu Z, Lei Y, Qi G et al (2022) A review of the application of deep learning in intelligent fault diagnosis of rotating machinery[J]. Measurement 112346

  8. Wu J, Tang T, Chen M et al (2020) A study on adaptation lightweight architecture based deep learning models for bearing fault diagnosis under varying working conditions[J]. Expert Syst Appl 160:113710

    Article  Google Scholar 

  9. Zhao B, Zhang X, Zhan Z et al (2020) Deep multi-scale convolutional transfer learning network: A novel method for intelligent fault diagnosis of rolling bearings under variable working conditions and domains[J]. Neurocomputing 407:24–38

    Article  Google Scholar 

  10. Zhao B, Zhang X, Li H et al (2020) Intelligent fault diagnosis of rolling bearings based on normalized CNN considering data imbalance and variable working conditions[J]. Knowl-Based Syst 199:105971

    Article  Google Scholar 

  11. Wu X, Zhang Y, Shi M et al (2022) An adaptive federated learning scheme with differential privacy preserving[J]. Futur Gener Comput Syst 127:362–372

    Article  Google Scholar 

  12. Zhang Z, Xu X, Gong W et al (2021) Efficient federated convolutional neural network with information fusion for rolling bearing fault diagnosis[J]. Control Eng Pract 116:104913

    Article  Google Scholar 

  13. Ma X, Wen C, Wen T (2021) An asynchronous and real-time update paradigm of federated learning for fault diagnosis[J]. IEEE Trans Industr Inf 17(12):8531–8540

    Article  Google Scholar 

  14. Zhang W, Li X, Ma H et al (2021) Federated learning for machinery fault diagnosis with dynamic validation and self-supervision[J]. Knowl-Based Syst 213:106679

    Article  Google Scholar 

  15. Tan A Z, Yu H, Cui L et al (2022) Towards personalized federated learning[J]. IEEE Transactions on Neural Networks and Learning Systems

  16. T Dinh C, Tran N, Nguyen J (2020) Personalized federated learning with Moreau envelopes[J]. Adv Neural Inf Process Syst 33:21394–21405

    Google Scholar 

  17. Li T, Sahu AK, Zaheer M et al (2020) Federated optimization in heterogeneous networks[J]. Proceedings of Machine learning and systems 2:429–450

    Google Scholar 

  18. Mills J, Hu J, Min G (2021) Multi-task federated learning for personalised deep neural networks in edge computing[J]. IEEE Trans Parallel Distrib Syst 33(3):630–641

    Article  Google Scholar 

  19. Hu R, Guo Y, Li H et al (2020) Personalized federated learning with differential privacy[J]. IEEE Internet Things J 7(10):9530–9539

    Article  Google Scholar 

  20. Singhal K, Sidahmed H, Garrett Z et al (2021) Federated reconstruction: Partially local federated learning[J]. Adv Neural Inf Process Syst 34:11220–11232

    Google Scholar 

  21. Zhu H, Xu J, Liu S et al (2021) Federated learning on non-IID data: A survey[J]. Neurocomputing 465:371–390

    Article  Google Scholar 

  22. Pei J, Zhong K, Jan MA et al (2022) Personalized federated learning framework for network traffic anomaly detection[J]. Comput Netw 209:108906

    Article  Google Scholar 

  23. McMahan B, Moore E, Ramage D et al (2017) Communication-efficient learning of deep networks from decentralized data[C]. Artificial Intelligence and Statistics. PMLR, pp 1273–1282

  24. Zhao Z, Li T, An B et al (2022) Model-driven deep unrolling: Towards interpretable deep learning against noise attacks for intelligent fault diagnosis[J]. ISA Trans 129:644–662

    Article  Google Scholar 

  25. Ghimire B, Rawat DB (2022) Recent advances on federated learning for cybersecurity and cybersecurity for federated learning for internet of things[J]. IEEE Internet Things J

  26. Romano Y, Aberdam A, Sulam J et al (2020) Adversarial noise attacks of deep learning architectures: Stability analysis via sparse-modeled signals[J]. J Math Imag Vis 62:313–327

    Article  MathSciNet  MATH  Google Scholar 

  27. Zhu J, Cao J, Saxena D et al (2023) Blockchain-empowered federated learning: Challenges, solutions, and future directions[J]. ACM Comput Surv 55(11):1–31

    Article  Google Scholar 

  28. Wu C, Wu F, Lyu L et al (2022) Communication-efficient federated learning via knowledge distillation[J]. Nat Commun 13(1):2032

    Article  Google Scholar 

  29. Adnan M, Kalra S, Cresswell JC et al (2022) Federated learning and differential privacy for medical image analysis[J]. Sci Rep 12(1):1953

    Article  Google Scholar 

  30. Boobalan P, Ramu SP, Pham QV et al (2022) Fusion of federated learning and industrial Internet of Things: A survey[J]. Comput Netw 212:109048

  31. Zhang K, Song X, Zhang C et al (2022) Challenges and future directions of secure federated learning: a survey[J]. Front Comp Sci 16:1–8

  32. Li T, Sahu AK, Talwalkar A et al (2020) Federated learning: Challenges, methods, and future directions[J]. IEEE Signal Process Mag 37(3):50–60

    Article  Google Scholar 

  33. Wu Q, He K, Chen X (2020) Personalized federated learning for intelligent IoT applications: A cloud-edge based framework[J]. IEEE Open J Comput Soc 1:35–44

  34. Banabilah S, Aloqaily M, Alsayed E et al (2022) Federated learning review: Fundamentals, enabling technologies, and future applications[J]. Inf Process Manage 59(6):103061

    Article  Google Scholar 

  35. Cho YJ, Wang J, Chirvolu T et al (2023) Communication-efficient and model-heterogeneous personalized federated learning via clustered knowledge transfer[J]. IEEE J Select Topics Signal Process

  36. Yang L, Huang J, Lin W et al (2023) Personalized federated learning on non-iid data via group-based meta-learning[J]. ACM Trans Knowl Discov Data 17(4):1–20

    Article  Google Scholar 

  37. Wang J, Xu G, Lei W et al (2022) CPFL: an effective secure cognitive personalized federated learning mechanism for Industry 4.0[J]. IEEE Trans Industr Inf 18(10):7186–7195

    Article  Google Scholar 

  38. Cao X, Sun G, Yu H et al (2022) PerFED-GAN: Personalized federated learning via generative adversarial networks[J]. IEEE Internet Things J

  39. Zhang W, Chen X, He K et al (2022) Semi-asynchronous personalized federated learning for short-term photovoltaic power forecasting[J]. Digital Commun Netw

  40. Case western reserve university bearing data center website: https://engineering.case.edu/bearingdatacenter/welcome

Download references

Acknowledgements

This work was supported by the National Natural Science Foundation of China (62073213), the Opening Project of Guangdong Provincial Key Lab of Robotics and Intelligent System and the Shanghai Maritime University Graduate Student Training Program for Top Innovative Talents (2022YBR016). The authors would like to thank Case Western Reserve University for providing motor bearing vibration data.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Funa Zhou.

Ethics declarations

Conflict of interest

The authors declare that they have no conflicts of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhang, Z., Zhou, F., Zhang, C. et al. A personalized federated learning-based fault diagnosis method for data suffering from network attacks. Appl Intell 53, 22834–22849 (2023). https://doi.org/10.1007/s10489-023-04753-8

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-023-04753-8

Keywords

Navigation