Skip to main content
SpringerLink
Log in

Few-shot intelligent fault diagnosis based on an improved meta-relation network

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

In recent decades, fault diagnosis methods based on machine learning and deep learning have achieved excellent results in fault diagnosis and are characterized by powerful automatic feature extraction and accurate identification capabilities. In many real-world scenarios, gathering enough samples of each fault type can be time-consuming and difficult. The scarcity of samples may significantly degrade the performance of these learning-based methods, making it extremely challenging to train a robust fault diagnosis classifier. In this paper, a few-shot fault diagnosis method based on the improved meta-relation network (IMRN) model is proposed to overcome the challenge of implementing fault diagnosis with limited data samples. First, a multiscale feature encoder module that utilizes two one-dimensional convolutional neural networks with different kernel sizes is used to automatically extract signal features from the original support dataset and query dataset. Then, a metric meta-learner module is designed to obtain relation scores between support samples and query samples. Finally, the feature vector output by the feature encoder module is input to the metric meta-learner module to determine the category of query samples by comparing the relation scores between the query dataset and support dataset, thus implementing the classification of fault categories. Experiments are conducted on three public datasets (TE, PU and CWRU), and the experimental results show that the proposed method outperforms other benchmark few-shot learning methods in terms of accuracy and exhibits remarkable robustness and adaptability in fault diagnosis.

Graphical Abstract

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

Data availability and access

The datasets analysed during the current study are available from the corresponding author on reasonable request.

References

  1. Hu Z, Jiang P (2019) An Imbalance Modified Deep Neural Network With Dynamical Incremental Learning for Chemical Fault Diagnosis. IEEE Trans Ind Electron 66(1):540–550. https://doi.org/10.1109/tie.2018.2798633

    Article  Google Scholar 

  2. Yang B, Lei Y, Jia F, Xing S (2019) An Intelligent Fault Diagnosis Approach Based on Transfer Learning from Laboratory Bearings to Locomotive Bearings. Mech Syst Signal Process 122:692–706. https://doi.org/10.1016/j.ymssp.2018.12.051

    Article  Google Scholar 

  3. Zhu Z, Lei Y, Qi G, Chai Y, Mazur N, An Y, Huang X (2023) A Review of the Application of Deep Learning in Intelligent Fault Diagnosis of Rotating Machinery. Measurement. https://doi.org/10.1016/j.measurement.2022.112346

    Article  Google Scholar 

  4. Khan SH, Hayat M, Bennamoun M, Sohel FA, Togneri R (2018) Cost-Sensitive Learning of Deep Feature Representations from Imbalanced Data. IEEE Trans Neural Netwo Learn Syst 29(8):3573–3587. https://doi.org/10.1109/tnnls.2017.2732482

    Article  Google Scholar 

  5. Zhao Z, Li T, Wu J, Sun C, Wang S, Yan R, Chen X (2020) Deep Learning Algorithms for Rotating Machinery Intelligent Diagnosis: An Open Source Benchmark Study. ISA Trans 107:224–255. https://doi.org/10.1016/j.isatra.2020.08.010

    Article  Google Scholar 

  6. Yang Z, Xu B, Luo W, Chen F (2022) Autoencoder-based Representation Learning and Its Application in Intelligent Fault Diagnosis: A Review. Measurement 189:110460. https://doi.org/10.1016/j.measurement.2021.110460

    Article  Google Scholar 

  7. Gao Y, Gao L, Li X, Zheng Y (2020) A Zero-shot Learning Method for Fault Diagnosis Under Unknown Working Loads. J Int Manuf 31:899–909. https://doi.org/10.1007/s10845-019-01485-w

    Article  Google Scholar 

  8. Li X, Zhu Y (2019) Optimizing Depth Discrimination Restricted Boltzmann Machine Based on Genetic Algorithm for Fault Diagnosis of Transformer. Int Core J Eng 5(10):108–116

    Google Scholar 

  9. Lv D, Wang H, Che C (2021) Multiscale Convolutional Neural Network and Decision Fusion for Rolling Bearing Fault Diagnosis. Ind Lubr Tribol 73(3):516–522. https://doi.org/10.1108/ILT-09-2020-0335

    Article  Google Scholar 

  10. Han Y, Ding N, Geng Z, Wang Z, Chu C (2020) An Optimized Long Short-term Memory Network Based Fault Diagnosis Model for Chemical Processes. J Process Control 92:161–168. https://doi.org/10.1016/j.jprocont.2020.06.005

    Article  Google Scholar 

  11. Qian W, Li S, Jiang X (2019) Deep Transfer Network for Rotating Machine Fault Analysis. Pattern Recogn 96:106993. https://doi.org/10.1016/j.patcog.2019.106993

    Article  Google Scholar 

  12. Yang B, Lei Y, Jia F, Li N, Du Z (2020) A Polynomial Kernel Induced Distance Metric to Improve Deep Transfer Learning for Fault Diagnosis of Machines. IEEE Trans Ind Electron 67(11):9747–9757. https://doi.org/10.1109/TIE.2019.2953010

    Article  Google Scholar 

  13. Wang Y, Wu D, Yuan X (2020) LDA-based Deep Transfer Learning for Fault Diagnosis in Industrial Chemical Processes. Comput Chem Eng 140:106964. https://doi.org/10.1016/j.compchemeng.2020.106964

    Article  Google Scholar 

  14. Zhang L, Gao X (2022) Transfer Adaptation Learning: A Decade Survey. IEEE Trans Neural Netw Learn Syst. https://doi.org/10.1109/TNNLS.2022.3183326

    Article  Google Scholar 

  15. Feng L, Zhao C (2021) Fault Description Based Attribute Transfer for Zero-sample Industrial Fault Diagnosis. IEEE Trans Ind Inform 17(3):1852–1862. https://doi.org/10.1109/TII.2020.2988208

    Article  Google Scholar 

  16. Li C, Li S, Zhang A, He Q, Liao Z, Hu J (2021) Meta-learning for Few-shot Bearing Fault Diagnosis Under Complex Working Conditions. Neurocomputing 439:197–211. https://doi.org/10.1016/j.neucom.2021.01.099

    Article  Google Scholar 

  17. Hu T, Tang T, Lin R, Chen M, Han S, Wu J (2020) A Simple Data Augmentation Algorithm and a Self-adaptive Convolutional Architecture for Few-shot Fault Diagnosis Under Different Working Conditions. Measurement 156:107539. https://doi.org/10.1016/j.measurement.2020.107539

    Article  Google Scholar 

  18. Zhao R, Yan R, Chen Z, Mao K, Wang P, Gao RX (2019) Deep Learning and its Applications to Machine Health Monitoring. Mech Syst Signal Process 115:213–237. https://doi.org/10.1016/j.ymssp.2018.05.050

    Article  Google Scholar 

  19. Ren Z, Gao D, Zhu Y, Ni Q, Yan K, Hong J (2023) Generative Adversarial Networks Driven by Multi-domain Information for Improving the Quality of Generated Samples in Fault Diagnosis. Eng Appl Artif Int 124:106542. https://doi.org/10.1016/j.engappai.2023.106542

    Article  Google Scholar 

  20. Li C, Zhang S, Qin Y, Estupinan E (2020) A Systematic Review of Deep Transfer Learning for Machinery Fault Diagnosis. Neurocomputing 407:121–135. https://doi.org/10.1016/j.neucom.2020.04.045

    Article  Google Scholar 

  21. Chai Z, Zhao C (2020) A Fine-grained Adversarial Network Method for Cross-domain Industrial Fault Diagnosis. IEEE Trans Autom Sci Eng 17(3):1432–1442. https://doi.org/10.1109/TASE.2019.2957232

    Article  Google Scholar 

  22. Feng Y, Chen J, Xie J, Zhang T, Lv H, Pan T (2022) Meta-learning as a Promising Approach for Few-shot Cross-domain Fault Diagnosis: Algorithms, Applications, and Prospects. Knowl-Based Syst 235:107646. https://doi.org/10.1016/j.knosys.2021.107646

    Article  Google Scholar 

  23. Zhang S, Ye F, Wang B, Habetler TG (2021) Few-shot Bearing Fault Diagnosis Based on Model-agnostic Meta-learning. IEEE Trans Ind Appl 57(5):4754–4764. https://doi.org/10.1109/tia.2021.3091958

    Article  Google Scholar 

  24. Lin J, Shao H, Zhou X, Cai B, Liu B (2023) Generalized MAML for Few-shot Cross-domain Fault Diagnosis of Bearing Driven by Heterogeneous Signals. Expert Syst Appl. https://doi.org/10.1016/j.eswa.2023.120696

    Article  Google Scholar 

  25. Feng Y, Chen J, Yang Z, Song X, Chang Y, He S, Xu E, Zhou Z (2021) Similarity-based Meta-learning Network with Adversarial Domain Adaptation for Cross-domain Fault Identification. Knowl-Based Syst 217:106829. https://doi.org/10.1016/j.knosys.2021.106829

    Article  Google Scholar 

  26. Guarino A, Spagnuolo G (2021) Automatic Features Extraction of Faults in PEM Fuel Cells by a Siamese Artificial Neural Network. Int J Hydrogen Energy 46(70):34854–34866. https://doi.org/10.1016/j.ijhydene.2021.08.024

    Article  Google Scholar 

  27. Tang T, Wang J, Yang T, Qiu C, Zhao J, Chen M, Wang L (2023) An Improved Prototypical Network with L2 Prototype Correction for Few-shot Cross-domain Fault Diagnosis. Measurement 217:113065. https://doi.org/10.1016/j.measurement.2023.113065

    Article  Google Scholar 

  28. Hou R, Chen J, He S, Li F, Zhou Z (2022) Prototype Augmented Network with Metric-Mixed Under Limited Samples for Mechanical Intelligent Fault Recognition. Appl Soft Comput 130:109709. https://doi.org/10.1016/j.asoc.2022.109709

    Article  Google Scholar 

  29. Sung F, Yang Y, Zhang L, Xiang T, Torr PH, Hospedales TM (2018) Learning to Compare: Relation Network for Few-shot Learning. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1199–1208. https://doi.org/10.1109/cvpr.2018.00131

  30. Wang S, Wang D, Kong D, Wang J, Li W, Zhou S (2020) Few-shot Rolling Bearing Fault Diagnosis with Metric-Based Meta Learning. Sensors 20:6437. https://doi.org/10.3390/s20226437

    Article  Google Scholar 

  31. Zhang A, Li S, Cui Y, Yang W, Dong R, Hu J (2019) Limited Data Rolling Bearing Fault Diagnosis with Few-shot Learning. IEEE Access 7:110895–110904. https://doi.org/10.1109/ACCESS.2019.2934233

    Article  Google Scholar 

  32. Wang H, Bai X, Tan J, Yang J (2022) Deep Prototypical Networks Based Domain Adaptation for Fault Diagnosis. J Int Manuf 973–983. https://doi.org/10.1007/s10845-020-01709-4

  33. Feng Y, Chen J, Zhang T, He S, Xu E, Zhou Z (2022) Semi-supervised Meta-learning Networks with Squeeze-and-excitation Attention for Few-shot Fault Diagnosis. ISA Trans 120:383–401. https://doi.org/10.1016/j.isatra.2021.03.013

  34. Lao Z, He D, Jin Z, Liu C, Shang H, He Y (2023) Few-shot Fault Diagnosis of Turnout Switch Machine Based on Semi-supervised Weighted Prototypical Network. Knowl-Based Syst 274:110634

    Article  Google Scholar 

  35. Ma R, Han T, Lei W (2023) Cross-domain Meta Learning Fault Diagnosis Based on Multi-scale Dilated Convolution and Adaptive Relation Module. Knowl-Based Syst 261:110175. https://doi.org/10.1016/j.knosys.2022.110175

    Article  Google Scholar 

  36. Tang T, Qiu C, Yang T, Wang J, Zhao J, Chen M, Wu J, Wang L (2023) A Novel Lightweight Relation Network for Cross-domain Few-shot Fault Diagnosis. Measurement 213:112697. https://doi.org/10.1016/j.measurement.2023.112697

  37. Wu J, Zhao Z, Sun C, Yan R, Chen X (2020) Few-shot Transfer Learning for Intelligent Fault Diagnosis of Machine. Measurement 166:108202. https://doi.org/10.1016/j.measurement.2020.108202

    Article  Google Scholar 

  38. Jiang W, Huang K, Geng J, Deng X (2021) Multi-scale Metric Learning for Few-shot Learning. IEEE Trans Circ Syst Vid Technol 31(3):1091–1102. https://doi.org/10.1109/tcsvt.2020.2995754

    Article  Google Scholar 

  39. Downs JJ, Vogel EF (1993) A Plant-wide Industrial Process Control Problem. Comput Chem Eng 17(3):245–255. https://doi.org/10.1016/0098-1354(93)80018-i

    Article  Google Scholar 

  40. Lessmeier C, Kimotho JK, Zimmer D, Sextro W (2016) Condition Monitoring of Bearing Damage in Electromechanical Drive Systems by Using Motor Current Signals of Electric Motors: A Benchmark Data Set for Data–driven Classification. In: PHM Society European conference, vol 3

  41. Smith WA, Randall RB (2015) Rolling Element Bearing Diagnostics Using the Case Western Reserve University Data: A Benchmark Study. Mech Syst Signal Process 64:100–131. https://doi.org/10.1016/j.ymssp.2015.04.021

    Article  Google Scholar 

Download references

Funding

This work was supported by the Basic Public Welfare Research Project of Zhejiang Province under grant number LGG22F030005, the National Natural Science Foundation of China under grant number U22A2047, and the Zhejiang Provincial Science and Technology Project under grant number 2022C01095.

Author information

Authors and Affiliations

  1. Automation College, Hang Zhou Dianzi University, HangZhou, China

    Xiaoqing Zheng, Changyuan Yue, Jiang Wei, Anke Xue, Ming Ge & Yaguang Kong

Authors
  1. Xiaoqing Zheng
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Changyuan Yue
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jiang Wei
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Anke Xue
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Ming Ge
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Yaguang Kong
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

All authors contributed to the study conception and design, data analysis and writing. Data collection and analysis were performed mainly by Changyuan Yue. The first draft of the manuscript was written by Xiaoqing Zheng and Changyuan Yue.

Corresponding author

Correspondence to Xiaoqing Zheng.

Ethics declarations

Informed consent

The research does not involve any human participants or animals, and the authors don’t use any data that require informed consent.

Competing Interests

The authors have no competing interests to declare that are relevant to the content of this article.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zheng, X., Yue, C., Wei, J. et al. Few-shot intelligent fault diagnosis based on an improved meta-relation network. Appl Intell 53, 30080–30096 (2023). https://doi.org/10.1007/s10489-023-05128-9

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-023-05128-9

Keywords

Search

Navigation