Skip to main content
Springer Nature Link
Log in

Wasserstein distance based multi-scale adversarial domain adaptation method for remaining useful life prediction

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

Accurate remaining useful life (RUL) prediction can formulate timely maintenance strategies for mechanical equipment and reduce the costs of industrial production and maintenance. Although data-driven methods represented by deep learning have been successfully implemented for mechanical equipment RUL prediction, existing methods generally require test data to have a similar distribution to the training data. Due to the domain shift problem caused by the changes in equipment operating conditions and fault types, the previously trained models lose the accuracy of prediction under the new conditions. In response to this problem, we combined a deep learning model with domain adaptation and proposed a Wasserstein distance based multi-scale adversarial domain adaptation (WD-MSADA) method for complex machinery RUL prediction. The proposed WD-MSADA utilizes a discriminator to compute the Wasserstein distance to guide the adversarial domain adaptation process more stably to reduce the distribution differences between the source and target domains. Additionally, a multi-scale convolutional neural network (MSCNN) is proposed as a feature extractor to learn the common multi-scale features between two domains, improving the shortcomings of traditional CNNs and enhancing the domain adaptation capability. Experiments on the RUL prediction of turbofan engines in 12 cross-domain scenarios demonstrate that the proposed WD-MSADA performs reliable RUL prediction in unlabeled target domains, and the prediction results are compared with models without domain adaptation, other advanced domain adaptation methods, and the model without multi-scale, demonstrating the superiority and reliability of the proposed method.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

We’re sorry, something doesn't seem to be working properly.

Please try refreshing the page. If that doesn't work, please contact support so we can address the problem.

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  1. Samir K, Takehisa Y (2018) A review on the application of deep learning in system health management. Mech Syst Signal Pr 107:241–265

    Article  Google Scholar 

  2. Lei Y, Li N, Guo L, Li N, Yan T, Lin J (2018) Machinery health prognostics: A systematic review from data acquisition to rul prediction. Mech Syst Signal Pr 104:799–834

    Article  Google Scholar 

  3. Zhao R, Yan R, Wang J, Mao K (2018) Learning to monitor machine health with convolutional bi-directional lstm networks. Sensors 104:799–834

    Google Scholar 

  4. Chen Z, Li Y, Xia T, Pan E (2019) Hidden markov model with auto-correlated observations for remaining useful life prediction and optimal maintenance policy. Reliab Eng Syst Safe 184:123–136

    Article  Google Scholar 

  5. Li L-L, Liu Z-F, Tseng M-L, Chiu ASF (2019) Enhancing the lithium-ion battery life predictability using a hybrid method. Appl Soft Comput 74:110–121

    Article  Google Scholar 

  6. Hu C, He S, Wang Y (2021) A classification method to detect faults in a rotating machinery based on kernelled support tensor machine and multilinear principal component analysis. Appl Intell 51:2609–2621

    Article  Google Scholar 

  7. Li W, Wang G, Gandomi AH (2021) A survey of learning-based intelligent optimization algorithms analysis. Arch Computat Methods Eng 28:3781–3799

    Article  Google Scholar 

  8. Wang G-G, Tan Y (2019) Improving metaheuristic algorithms with information feedback models. IEEE Trans Cybern 49:542–555

    Article  Google Scholar 

  9. Babu GS, Zhao P, Li XL (2016) Deep convolutional neural network based regression approach for estimation of remaining useful life. Paper presented at the 21th international conference on database systems for advanced applications, Dallas, USA, 16–19 April 2016

  10. Li X, Ding Q, Sun JQ (2018) Remaining useful life estimation in prognostics using deep convolution neural networks. Reliab Eng Syst Saf 172:1–11

    Article  Google Scholar 

  11. Zhu J, Chen N, Peng W (2018) Estimation of bearing remaining useful life based on multiscale convolutional neural network. IEEE Trans Ind Electron 66:3208–3216

    Article  Google Scholar 

  12. Ren L, Sun Y, Cui J, Zhang L (2018) Bearing remaining useful life prediction based on deep autoencoder and deep neural networks. J Manuf Syst 48:71–77

    Article  Google Scholar 

  13. Guo L, Li N, Jia F, Lei Y, Lin J (2017) A recurrent neural network based health indicator for remaining useful life prediction of bearings. Neurocomputing 240:98–109

    Article  Google Scholar 

  14. Wu Y, Yuan M, Dong S, Lin L, Liu Y (2018) Remaining useful life estimation of engineered systems using vanilla lstm neural networks. Neurocomputing 275:167–179

    Article  Google Scholar 

  15. Huang CG, Huang HZ, Li YF (2019) A bidirectional lstm prognostics method under multiple operational conditions. IEEE Trans Ind Electron 66:8792–8802

    Article  Google Scholar 

  16. Kaixiang P, Ruihua J, Jie D, Yanting P (2019) A deep belief network based health indicator construction and remaining useful life prediction using improved particle filter. Neurocomputing 361:19–28

    Article  Google Scholar 

  17. LeCun Y, Bottou L, Bengio Y, Haffner P (1998) Gradient-based learning applied to document recognition. Proc IEEE 86:2278–2324

    Article  Google Scholar 

  18. Mao W, He J, Zuo MJ (2019) Predicting remaining useful life of rolling bearings based on deep feature representation and transfer learning. IEEE Trans Instrum Meas 69:1594–1608

    Article  Google Scholar 

  19. Farahani A, Voghoei S, Rasheed K, Arabnia HR (2021) A brief review of domain adaptation. In: Stahlbock R, Weiss Gm, Abou-Nasr M, Yang C-Y, Arabnia HR, Deligiannidis L (eds) Advances in data science and information engineering, pp 877– 894

  20. Chen Z, He G, Li J, Liao Y, Gryllias K, Li W (2020) Domain adversarial transfer network for cross-domain fault diagnosis of rotary machinery. IEEE Trans Instrum Meas 69:8702–8712

    Article  Google Scholar 

  21. Yang B, Lei Y, Jia F, Xing S (2019) An intelligent fault diagnosis approach based on transfer learning from laboratory bearings to locomotive bearings. Mech Syst Signal Pr 122:692–706

    Article  Google Scholar 

  22. Hu C, Wang Y, Gu J (2020) Cross-domain intelligent fault classification of bearings based on tensor-aligned invariant subspace learning and two-dimensional convolutional neural networks. Knowl-Based Syst 209:106214

    Article  Google Scholar 

  23. Tang Z, Bo L, Liu X, Wei D (2022) A semi-supervised transferable lstm with feature evaluation for fault diagnosis of rotating machinery. Appl Intell 52:1703–1717

    Article  Google Scholar 

  24. Zhao D, Liu F (2022) Cross-condition and cross-platform remaining useful life estimation via adversarial-based domain adaptation. Sci Rep 12:878

    Article  Google Scholar 

  25. Zhang A, Wang H, Li S, Cui Y, Liu Z, Yang G, Hu J (2018) Transfer learning with deep recurrent neural networks for remaining useful life estimation. Appl Sci-Basel 8:2416

    Article  Google Scholar 

  26. da Costa PRDO, Akçay A, Zhang Y, Kaymak U (2020) Remaining useful lifetime prediction via deep domain adaptation. Reliab Eng Syst Safe 195:106682

    Article  Google Scholar 

  27. Ragab M, Chen Z, Wu M, Kwoh CK, Li X (2020) Adversarial transfer learning for machine remaining useful life prediction. 2020 IEEE international conference on prognostics and health management, detroit, USA, 8-10 June 2020

  28. Arjovsky M, Chintala S, Bottou L (2017) Wasserstein generative adversarial networks. In: Precup D, Teh YW (eds) Proceedings of the 34th international conference on machine learning, vol 70, pp 214–223

  29. Yanchun L, Qiuzhen W, Jie Z, Lingzhi H, Wanli O (2021) The theoretical research of generative adversarial networks: an overview. Neurocomputing 435:26–41

    Article  Google Scholar 

  30. Gulrajani I, Ahmed F, Arjovsky M, Dumoulin V, Courville AC (2017) Improved training of wasserstein gans. In: Guyon I, Luxburg UV, Bengio S, Wallach H, Fergus R, Vishwanathan S, Garnett R (eds) Advances in neural information processing systems, vol 30

  31. Saxena A, Goebel K, Simon D, Eklund N (2008) Damage propagation modeling for aircraft engine run-to-failure simulation. 2008 international conference on prognostics and health management, Denver. USA, 6-9 October 2008

  32. Bektas O, Jones JA, Sankararaman S, Roychoudhury I, Goebel K (2019) A neural network filtering approach for similarity-based remaining useful life estimation. Int J Adv Manuf Technol 101:87–103

    Article  Google Scholar 

  33. Sheng X, Yi Q, Jun L, Huayan P, Baoping T (2021) Multicellular lstm-based deep learning model for aero-engine remaining useful life prediction. Reliab Eng Syst Safe 216:107927

    Article  Google Scholar 

  34. Ganin Y, Ustinova E, Ajakan H, Germain P, Larochelle H, Laviolette F, Lempitsky V (2016) Domain-adversarial training of neural networks. J Mach Learn Res 17:2096–2030

    MathSciNet  MATH  Google Scholar 

  35. Ragab M, Chen Z, Wu M, Foo CS, Kwoh CK, Yan R, Li X (2020) Contrastive adversarial domain adaptation for machine remaining useful life prediction. IEEE Trans Industr Inform 17:5239–5249

    Article  Google Scholar 

  36. Pan SJ, Tsang IW, Kwok JT, Yang Q (2010) Domain adaptation via transfer component analysis. IEEE Trans Neural Netw 22:199–210

    Article  Google Scholar 

  37. Sun B, Saenko K (2016) Deep coral: Correlation alignment for deep domain adaptation. 14th European Conference on Computer Vision, Amsterdam, The Netherlands, 11–14 October 2016

  38. Wang G, Deb S, Cui Z (2019) Monarch butterfly optimization. Neural Comput & Applic 31:1995–2014

    Article  Google Scholar 

  39. Wang G (2018) Moth search algorithm: a bio-inspired metaheuristic algorithm for global optimization problems. Memetic Comp 10:151–164

    Article  Google Scholar 

Download references

Acknowledgements

This research is supported by the National Natural Science Foundation of China (grant numbers 52075348 and 52005352); the Key Laboratory of Vibration and Control of Aero-Propulsion System Ministry of Education, Northeastern University (grant number VCAME202001); the Liaoning Revitalization Talents Program (grant number XLYC2007031) and the Key innovate R&D Program of Shenyang (grant number Y19-1-004).

Author information

Authors and Affiliations

  1. School of Mechanical Engineering, Shenyang Jianzhu University, No.25 Hunnan Middle Road, Shenyang, 110168, Liaoning, China

    Huaitao Shi, Chengzhuang Huang, Xiaochen Zhang, Jinbao Zhao & Sihui Li

Authors
  1. Huaitao Shi
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Chengzhuang Huang
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Xiaochen Zhang
    View author publications

    You can also search for this author inPubMed Google Scholar

  4. Jinbao Zhao
    View author publications

    You can also search for this author inPubMed Google Scholar

  5. Sihui Li
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Xiaochen Zhang.

Ethics declarations

Conflict of Interests

The authors declare that they have no conflict of interest.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Shi, H., Huang, C., Zhang, X. et al. Wasserstein distance based multi-scale adversarial domain adaptation method for remaining useful life prediction. Appl Intell 53, 3622–3637 (2023). https://doi.org/10.1007/s10489-022-03670-6

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-022-03670-6

Keywords