Skip to main content

Advertisement

Log in

Few-shot RUL estimation based on model-agnostic meta-learning

  • Published:
Journal of Intelligent Manufacturing Aims and scope Submit manuscript

Abstract

Data-driven remaining useful life (RUL) estimation has been a research hotspot in the prognostic and health management (PHM) of industrial equipment and systems. It can achieve predictive maintenance of machinery and rarely require prior expertise in prognostics and signal processing. However, the data-driven methods require sufficient training data, which is difficult to acquire. In this paper, we employ the model-agnostic meta-learning (MAML) algorithm to seek suitable model parameter initialization that can rapidly adapt to the given test sample with few-shot training samples. We also propose to build pseudo-meta-RUL task sets for meta-learning by calculating time sequence similarities. To further improve the applicability of the model, we extend the proposed method from few-shot conditions to general conditions. We conduct experiments on the C-MAPSS dataset and the results show that the proposed algorithm can improve the prediction performance and enhance the generalization ability of the model in the context of few-shot conditions and general conditions.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  • Andrychowicz, M., Denil, M., Gomez, S., et al. (2016). Learning to learn by gradient descent by gradient descent. Advances in Neural Information Processing Systems, 29, 1–10.

    Google Scholar 

  • Ba, JL., Kiros, JR., & Hinton, GE. (2016). Layer normalization. arXiv:1607.06450.

  • Camci, F., & Chinnam, R. B. (2010). Health-state estimation and prognostics in machining processes. IEEE Transactions on Automation Science and Engineering, 7(3), 581–597.

    Article  Google Scholar 

  • Chen, J., Jing, H., Chang, Y., et al. (2019). Gated recurrent unit based recurrent neural network for remaining useful life prediction of nonlinear deterioration process. Reliability Engineering & System Safety, 185, 372–382.

    Article  Google Scholar 

  • Da Costa, PRd. O., Akçay, A., Zhang, Y., et al. (2020). Remaining useful lifetime prediction via deep domain adaptation. Reliability Engineering & System Safety, 195(106), 682.

    Google Scholar 

  • Diamanti, K., & Soutis, C. (2010). Structural health monitoring techniques for aircraft composite structures. Progress in Aerospace Sciences, 46(8), 342–352.

    Article  Google Scholar 

  • Eker, O. F., Camci, F., Guclu, A., et al. (2011). A simple state-based prognostic model for railway turnout systems. IEEE Transactions on Industrial Electronics, 58(5), 1718–1726.

    Article  Google Scholar 

  • Eker, OF., Camci, F., & Jennions, IK. (2012). Major challenges in prognostics: Study on benchmarking prognostics datasets. In PHM Society European Conference.

  • Esteban, C., Hyland, SL., & Rätsch, G. (2017). Real-valued (medical) time series generation with recurrent conditional gans. arXiv:1706.02633.

  • Fan, Y., Nowaczyk, S., & Rögnvaldsson, T. (2020). Transfer learning for remaining useful life prediction based on consensus self-organizing models. Reliability Engineering & System Safety, 203(107), 098.

    Google Scholar 

  • Finn, C., Abbeel, P., & Levine, S. (2017). Model-agnostic meta-learning for fast adaptation of deep networks. In International Conference on Machine Learning, PMLR, pp. 1126–1135.

  • Ganin, Y., Ustinova, E., Ajakan, H., et al. (2016). Domain-adversarial training of neural networks. The Journal of Machine Learning Research, 17(1), 2030–2096.

    Google Scholar 

  • Gebraeel, N., Elwany, A., & Pan, J. (2009). Residual life predictions in the absence of prior degradation knowledge. IEEE Transactions on Reliability, 58(1), 106–117.

    Article  Google Scholar 

  • Goodfellow, IJ., Shlens, J., & Szegedy, C. (2014). Explaining and harnessing adversarial examples. arXiv:1412.6572.

  • He, K., Zhang, X., & Ren, S., et al (2016). Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 770–778.

  • Heimes, FO. (2008). Recurrent neural networks for remaining useful life estimation. In 2008 International Conference on Prognostics and Health Management, IEEE, pp 1–6.

  • Kacprzynski, G., Sarlashkar, A., Roemer, M., et al. (2004). Predicting remaining life by fusing the physics of failure modeling with diagnostics. JOM, 56(3), 29–35.

    Article  Google Scholar 

  • Kingma, DP., & Ba, J. (2014). Adam: A method for stochastic optimization. arXiv:1412.6980.

  • Kothamasu, R., Huang, S. H., & VerDuin, W. H. (2006). System health monitoring and prognostics—A review of current paradigms and practices. The International Journal of Advanced Manufacturing Technology, 28(9), 1012–1024.

    Article  Google Scholar 

  • Li, Q., Gao, Z., Tang, D., et al. (2016). Remaining useful life estimation for deteriorating systems with time-varying operational conditions and condition-specific failure zones. Chinese Journal of Aeronautics, 29(3), 662–674.

    Article  Google Scholar 

  • Li, X., Ding, Q., & Sun, J. Q. (2018). Remaining useful life estimation in prognostics using deep convolution neural networks. Reliability Engineering & System Safety, 172, 1–11.

    Article  Google Scholar 

  • Malhi, A., Yan, R., & Gao, R. X. (2011). Prognosis of defect propagation based on recurrent neural networks. IEEE Transactions on Instrumentation and Measurement, 60(3), 703–711.

    Article  Google Scholar 

  • Mi, F., Huang, M., & Zhang, J., et al (2019). Meta-learning for low-resource natural language generation in task-oriented dialogue systems. arXiv:1905.05644.

  • Mo, Y., Wu, Q., Li, X., et al. (2021). Remaining useful life estimation via transformer encoder enhanced by a gated convolutional unit. Journal of Intelligent Manufacturing, 32(7), 1997–2006.

    Article  Google Scholar 

  • Naik, D. K., & Mammone, R. J. (1992). Meta-neural networks that learn by learning. In [Proceedings 1992] IJCNN International Joint Conference on Neural Networks, IEEE, pp. 437–442.

  • Nieto, P. G., García-Gonzalo, E., Lasheras, F. S., et al. (2015). Hybrid pso-svm-based method for forecasting of the remaining useful life for aircraft engines and evaluation of its reliability. Reliability Engineering & System Safety, 138, 219–231.

    Article  Google Scholar 

  • Oppenheimer, CH., & Loparo, KA. (2002). Physically based diagnosis and prognosis of cracked rotor shafts. In Component and Systems Diagnostics, Prognostics, and Health Management II, SPIE, pp 122–132.

  • Pan, S. J., & Yang, Q. (2009). A survey on transfer learning. IEEE Transactions on Knowledge and Data Engineering, 22(10), 1345–1359.

    Article  Google Scholar 

  • Pan, S. J., Tsang, I. W., Kwok, J. T., et al. (2010). Domain adaptation via transfer component analysis. IEEE Transactions on Neural Networks, 22(2), 199–210.

    Article  Google Scholar 

  • Peng, Y., Dong, M., & Zuo, M. J. (2010). Current status of machine prognostics in condition-based maintenance: A review. The International Journal of Advanced Manufacturing Technology, 50(1), 297–313.

    Article  Google Scholar 

  • Ragab, M., Chen, Z., Wu, M., & et al (2020). Adversarial transfer learning for machine remaining useful life prediction. In 2020 IEEE International Conference on Prognostics and Health Management (ICPHM), IEEE, pp. 1–7.

  • Ramasso, E. (2014). Investigating computational geometry for failure prognostics in presence of imprecise health indicator: Results and comparisons on c-mapss datasets. In PHM Society European Conference.

  • Ren, L., Sun, Y., Wang, H., et al. (2018). Prediction of bearing remaining useful life with deep convolution neural network. IEEE Access, 6, 13041–13049.

    Article  Google Scholar 

  • Sakoe, H. (1971). Dynamic-programming approach to continuous speech recognition. In 1971 Proceedings of the International Congress of Acoustics, Budapest.

  • Saxena, A., & Goebel, K. (2008). Turbofan engine degradation simulation data set. NASA Ames Prognostics Data Repository pp 1551–3203.

  • Saxena, A., Goebel, K., Simon, D., & et al. (2008). Damage propagation modeling for aircraft engine run-to-failure simulation. In 2008 International Conference on Prognostics and Health Management, IEEE, pp 1–9.

  • Shu, J., Xu, Z., & Meng, D. (2018). Small sample learning in big data era. arXiv:1808.04572.

  • Si, X. S., Wang, W., Hu, C. H., et al. (2011). Remaining useful life estimation: A review on the statistical data driven approaches. European Journal of Operational Research, 213(1), 1–14.

    Article  Google Scholar 

  • Soh, SS., Radzi, NH., & Haron, H. (2012). Review on scheduling techniques of preventive maintenance activities of railway. In 2012 Fourth International Conference on Computational Intelligence, Modelling and Simulation, IEEE, pp 310–315.

  • Sun, B., Feng, J., & Saenko, K. (2017). Correlation alignment for unsupervised domain adaptation. In: Domain Adaptation in Computer Vision Applications. Springer, p 153–171.

  • Tobon-Mejia, D. A., Medjaher, K., Zerhouni, N., et al. (2012). A data-driven failure prognostics method based on mixture of gaussians hidden Markov models. IEEE Transactions on Reliability, 61(2), 491–503.

    Article  Google Scholar 

  • Vaswani, A., Shazeer, N., Parmar, N., et al. (2017). Attention is all you need. Advances in Neural Information Processing Systems, 30, 1–10.

    Google Scholar 

  • Velichko, V., & Zagoruyko, N. (1970). Automatic recognition of 200 words. International Journal of Man-Machine Studies, 2(3), 223–234.

    Article  Google Scholar 

  • Vinyals, O., Blundell, C., Lillicrap, T., et al. (2016). Matching networks for one shot learning. Advances in Neural Information Processing Systems, 29, 1–10.

    Google Scholar 

  • Wang, C., Lu, N., Wang, S., et al. (2018). Dynamic long short-term memory neural-network-based indirect remaining-useful-life prognosis for satellite lithium-ion battery. Applied Sciences, 8(11), 2078.

    Article  Google Scholar 

  • Wang, Y., Yao, Q., Kwok, J. T., et al. (2020). Generalizing from a few examples: A survey on few-shot learning. ACM Computing Surveys (csur), 53(3), 1–34.

    Article  Google Scholar 

  • Wen, Q., Sun, L., & Yang, F., et al, (2020). Time series data augmentation for deep learning: A survey. arXiv:2002.12478.

  • Wen, T., & Keyes, R. (2019). Time series anomaly detection using convolutional neural networks and transfer learning. arXiv:1905.13628.

  • Wu, Q., Ding, K., & Huang, B. (2020). Approach for fault prognosis using recurrent neural network. Journal of Intelligent Manufacturing, 31(7), 1621–1633.

    Article  Google Scholar 

  • Xu, X., Wu, Q., Li, X., et al. (2020). Dilated convolution neural network for remaining useful life prediction. Journal of Computing and Information Science in Engineering, 20(2), 021004.

    Article  Google Scholar 

  • Yoon, J., Jarrett, D., & Vander Schaar, M. (2019). Time-series generative adversarial networks. Advances in Neural Information Processing Systems, 32, 1–10.

    Google Scholar 

  • Yu, J. (2017). Aircraft engine health prognostics based on logistic regression with penalization regularization and state-space-based degradation framework. Aerospace Science and Technology, 68, 345–361.

    Article  Google Scholar 

  • Yuan, M., Wu, Y., & Lin, L. (2016). Fault diagnosis and remaining useful life estimation of aero engine using lstm neural network. In 2016 IEEE international conference on aircraft utility systems (AUS), IEEE, pp 135–140

  • Zhang, A., Wang, H., Li, S., et al. (2018). Transfer learning with deep recurrent neural networks for remaining useful life estimation. Applied Sciences, 8(12), 2416.

    Article  Google Scholar 

  • Zhang, C., Lim, P., Qin, A. K., et al. (2016). Multiobjective deep belief networks ensemble for remaining useful life estimation in prognostics. IEEE Transactions on Neural Networks and Learning Systems, 28(10), 2306–2318.

    Article  Google Scholar 

  • Zheng, S., Ristovski, K., & Farahat, A., et al. (2017). Long short-term memory network for remaining useful life estimation. In 2017 IEEE International Conference on Prognostics and Health Management (ICPHM), IEEE, pp. 88–95.

Download references

Acknowledgements

This work was supported by the National Key R&D Program of China (No. 2021YFF0901304), and a grant from the Institute for Guo Qiang, Tsinghua University (No. 2019GQG0002).

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to Biqing Huang or Xiu Li.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Mo, Y., Li, L., Huang, B. et al. Few-shot RUL estimation based on model-agnostic meta-learning. J Intell Manuf 34, 2359–2372 (2023). https://doi.org/10.1007/s10845-022-01929-w

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10845-022-01929-w

Keywords

Navigation