Abstract
The plentiful labeled data is indispensable for data-driven intelligent fault diagnosis of rolling bearings. But in the real world, it is difficult to gather sufficient vibration signals in advance when faults occur. Selecting an intelligent model trained by other datasets to diagnose the target signals is an effective strategy in response to the data scarcity. In this paper, a guided deep subdomain adaptation network (GDSAN) is proposed to align the feature distributions across different datasets efficiently by minimizing the discrepancy between the distributions of relevant subdomains. Specifically, the proposed method realizes alignment by comparing the consistency of source labels and target pseudo labels predicted by the source classifier. The guided learning reduces the misjudgment of target pseudo labels, which helps the subdomain with identical label finding the proper common subspace more accurately. To evaluate the superiority of the proposed model, this paper conducts transfer experiments on six rolling bearing datasets and selects four mainstream deep transfer learning networks to compare with GDSAN. The results show the fault recognition accuracy of GDSAN is prominently higher than other approaches, meanwhile verify the need of using guided subdomain adaptation.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Ben-David, S., Blitzer, J., Crammer, K., Kulesza, A., Pereira, F., & Vaughan, J. W. (2010). A theory of learning from different domains. Machine Learning, 79(1–2), 151–175. https://doi.org/10.1007/s10994-009-5152-4
Borgwardt, K. M., Gretton, A., Rasch, M. J., Kriegel, H.-P., Schoelkopf, B., & Smola, A. J. (2006). Integrating structured biological data by kernel maximum mean discrepancy. Bioinformatics, 22(14), 49–57. https://doi.org/10.1093/bioinformatics/btl242
Cai, G., Wang, Y., He, L., & Zhou, M. (2020). Unsupervised domain adaptation with adversarial residual transform networks. IEEE Transactions on Neural Networks and Learning Systems, 31(8), 3073–3086. https://doi.org/10.1109/tnnls.2019.2935384
Chen, X., Zhang, B., & Gao, D. (2020a). Bearing fault diagnosis base on multi-scale CNN and LSTM model. Journal of Intelligent Manufacturing, 32(4), 971–987. https://doi.org/10.1007/s10845-020-01600-2
Chen, Z., He, G., Li, J., Liao, Y., Gryllias, K., & Li, W. (2020b). Domain adversarial transfer network for cross-domain fault diagnosis of rotary machinery. IEEE Transactions on Instrumentation and Measurement, 69(11), 8702–8712. https://doi.org/10.1109/tim.2020.2995441
Cheng, C., Zhou, B., Ma, G., Wu, D., & Yuan, Y. (2020). Wasserstein distance based deep adversarial transfer learning for intelligent fault diagnosis with unlabeled or insufficient labeled data. Neurocomputing, 409, 35–45. https://doi.org/10.1016/j.neucom.2020.05.040
Ganin, Y., Ustinova, E., Ajakan, H., Germain, P., Larochelle, H., Laviolette, F., & Lempitsky, V. (2016). Domain-adversarial training of neural networks. Journal of Machine Learning Research, 17.
Goodfellow, I. J., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., & Bengio, Y. (2014). Generative adversarial nets. Advances in Neural Information Processing Systems, 27, 2672–2680.
Han, B., Ji, S., Wang, J., Bao, H., & Jiang, X. (2021). An intelligent diagnosis framework for roller bearing fault under speed fluctuation condition. Neurocomputing, 420, 171–180. https://doi.org/10.1016/j.neucom.2020.09.022
Han, N., Wu, J., Fang, X., Xie, S., Zhan, S., Xie, K., & Li, X. (2020). Latent elastic-net transfer learning. IEEE Transactions on Image Processing, 29, 2820–2833. https://doi.org/10.1109/tip.2019.2952739
Heng, A., Zhang, S., Tan, A. C. C., & Mathew, J. (2009). Rotating machinery prognostics: State of the art, challenges and opportunities. Mechanical Systems and Signal Processing, 23(3), 724–739. https://doi.org/10.1016/j.ymssp.2008.06.009
Jalayer, M., Orsenigo, C., & Vercellis, C. (2021). Fault detection and diagnosis for rotating machinery: A model based on convolutional LSTM, fast fourier and continuous wavelet transforms. Computers in Industry. https://doi.org/10.1016/j.compind.2020.103378
Jia, F., Lei, Y. G., Lin, J., Zhou, X., & Lu, N. (2016). Deep neural networks: A promising tool for fault characteristic mining and intelligent diagnosis of rotating machinery with massive data. Mechanical Systems and Signal Processing, 72–73, 303–315. https://doi.org/10.1016/j.ymssp.2015.10.025
Jiang, C. C., Chen, H., Xu, Q. F., & Wang, X. X. (2022). Few-shot fault diagnosis of rotating machinery with two-branch prototypical networks. Journal of Intelligent Manufacturing. https://doi.org/10.1007/s10845-021-01904-x
Jiao, J., Zhao, M., Lin, J., Liang, K., & Ding, C. (2021). A mixed adversarial adaptation network for intelligent fault diagnosis. Journal of Intelligent Manufacturing. https://doi.org/10.1007/s10845-021-01777-0
Kulkarni, U., Meena, S. M., Gurlahosur, S. V., & Bhogar, G. (2021). Quantization friendly mobileNet (QF-MobileNet) architecture for vision based applications on embedded platforms. Neural Networks, 136, 28–39. https://doi.org/10.1016/j.neunet.2020.12.022
Lee, D., Siu, V., Cruz, R., & Yetman, C. (2016). Convolutional neural net and bearing fault analysis. In Proceedings of the international conference on data mining (DMIN).
Lee, J., Wu, F. J., Zhao, W. Y., Ghaffari, M., Liao, L. X., & Siegel, D. (2014). Prognostics and health management design for rotary machinery systems-reviews, methodology and applications. Mechanical Systems and Signal Processing, 42(1–2), 314–334. https://doi.org/10.1016/j.ymssp.2013.06.004
Lessmeier, C., Kimotho, J. K., Zimmer, D., & Sextro, W. (2016). Condition monitoring of bearing damage in electromechanical drive systems by using motor current signals of electric motors: a benchmark data set for data-driven classification. In European conference of the prognostics and health management society.
Li, C., Zhang, S., Qin, Y., & Estupinan, E. (2020a). A systematic review of deep transfer learning for machinery fault diagno-sis. Neurocomputing, 407, 121–135. https://doi.org/10.1016/j.neucom.2020.04.045
Li, S., Liu, C. H., Su, L., Xie, B., Ding, Z., Chen, C. L. P., & Wu, D. (2020b). Discriminative transfer feature and label consistency for cross-domain image classification. IEEE Transactions on Neural Networks and Learning Systems, 31(11), 4842–4856. https://doi.org/10.1109/tnnls.2019.2958152
Li, S., Song, S., Huang, G., Ding, Z., & Wu, C. (2018). Domain invariant and class discriminative feature learning for visual domain adaptation. IEEE Transactions on Image Processing, 27(9), 4260–4273. https://doi.org/10.1109/tip.2018.2839528
Li, T. F., Zhao, Z. B., Sun, C., Yan, R. Q., & Chen, X. F. (2021a). Multireceptive field graph convolutional networks for machine fault diagnosis. IEEE Transactions on Industrial Electronics, 68(12), 12739–12749. https://doi.org/10.1109/tie.2020.3040669
Li, T. F., Zhao, Z. B., Sun, C., Yan, R. Q., & Chen, X. F. (2021b). Domain adversarial graph convolutional network for fault diagnosis under variable working conditions. IEEE Transactions on Instrumentation and Measurement. https://doi.org/10.1109/tim.2021.3075016
Li, X. Y., Kong, X. W., Zhang, J. Q., Hu, Z. Y., & Shi, C. (2021c). A study on fault diagnosis of bearing pitting under different speed condition based on an improved inception capsule network. Measurement. https://doi.org/10.1016/j.measurement.2021.109656
Li, X., Zhang, W., & Ding, Q. (2019). Cross-domain fault diagnosis of rolling element bearings using deep generative neural networks. IEEE Transactions on Industrial Electronics, 66(7), 5525–5534. https://doi.org/10.1109/tie.2018.2868023
Liang, P., Deng, C., Wu, J., Li, G., Yang, Z., & Wang, Y. (2019). Intelligent fault diagnosis via semi-supervised generative adversarial nets and wavelet transform. IEEE Transactions on Instrumentation and Measurement, 69, 4659–4671. https://doi.org/10.1109/TIM.2019.2956613
Lin, J., & Qu, L. S. (2000). Feature extraction based on Morlet wavelet and its application for mechanical fault diagnosis. Journal of Sound and Vibration, 234(1), 135–148. https://doi.org/10.1006/jsvi.2000.2864
Long, M., Cao ,Y., Wang, J., & Jordan, M. (2015). Learning transferable features with deep adaptation networks. In Proc. ICML (pp. 97–105).
Lu, N., Xiao, H., Sun, Y., Han, M., & Wang, Y. (2021). A new method for intelligent fault diagnosis of machines based on unsupervised domain adaptation. Neurocomputing, 427, 96–109. https://doi.org/10.1016/j.neucom.2020.10.039
Lu, W., Liang, B., Cheng, Y., Meng, D., Yang, J., & Zhang, T. (2017). Deep model based domain adaptation for fault diagnosis. IEEE Transactions on Industrial Electronics, 64(3), 2296–2305. https://doi.org/10.1109/tie.2016.2627020
Pan, S. J., & Yang, Q. (2010). A survey on transfer learning. IEEE Transactions on Knowledge and Data Engineering, 22(10), 1345–1359. https://doi.org/10.1109/tkde.2009.191
Qiu, H., Lee, J., Lin, J., & Yu, G. (2006). Wavelet filter-based weak signature detection method and its application on rolling element bearing prognostics. Journal of Sound and Vibration, 289(4–5), 1066–1090. https://doi.org/10.1016/j.jsv.2005.03.007
Schölkopf, B., Platt, J., & Hofmann, T. (2006). Analysis of representations for domain adaptation. Advances in Neural Information Processing Systems, 19, 137–144.
Singh, V., Gangsar, P., Porwal, R., & Atulkar, A. (2021). Artificial intelligence application in fault diagnostics of rotating industrial machines: a state-of-the-art review. Journal of Intelligent Manufacturing. https://doi.org/10.1007/s10845-021-01861-5
Smith, W. A., & Randall, R. B. (2015). Rolling element bearing diagnostics using the Case Western Reserve University data: A benchmark study. Mechanical Systems and Signal Processing, 64–65, 100–131. https://doi.org/10.1016/j.ymssp.2015.04.021
Tan, Y., Guo, L., Gao, H., & Zhang, L. (2021). Deep coupled joint distribution adaptation network: A method for intelligent fault diagnosis between artificial and real damages. IEEE Transactions on Instrumentation and Measurement. https://doi.org/10.1109/tim.2020.3043510
Tzeng, E., Hoffman, J., Zhang, N., Saenko, K., & Darrell T. (2014). Deep domain confusion: maximizing for domain invariance. arXiv:1412.3474.
van der Maaten, L., & Hinton, G. (2008). Visualizing data using t-SNE. Journal of Machine Learning Research, 9, 2579–2605.
Viola, J., Chen, Y., & Wang, J. (2021). FaultFace: Deep convolutional generative adversarial network (DCGAN) based ball-bearing failure detection method. Information Sciences, 542, 195–211. https://doi.org/10.1016/j.ins.2020.06.060
Wang, J., Ji, S., Han, B., Bao, H., & Jiang, X. (2020). Deep adaptive adversarial network-based method for mechanical fault diagnosis under different working conditions. Complexity. https://doi.org/10.1155/2020/6946702
Wen, L., Gao, L., & Li, X. (2019). A new deep transfer learning based on sparse auto-encoder for fault diagnosis. IEEE Transactions on Systems Man Cybernetics-Systems, 49(1), 136–144. https://doi.org/10.1109/tsmc.2017.2754287
Wu, Z., Jiang, H., Zhao, K., & Li, X. (2020). An adaptive deep transfer learning method for bearing fault diagnosis. Measurement. https://doi.org/10.1016/j.measurement.2019.107227
Yan, R., Gao, R. X., & Chen, X. (2014). Wavelets for fault diagnosis of rotary machines: A review with applications. Signal Processing, 96, 1–15. https://doi.org/10.1016/j.sigpro.2013.04.015
Ye, R., & Dai, Q. (2021). Implementing transfer learning across different datasets for time series forecasting. Pattern Recognition. https://doi.org/10.1016/j.patcog.2020.107617
Zhang, L., Fu, J., Wang, S., Zhang, D., Dong, Z., & Chen, C. L. P. (2020a). Guide subspace learning for unsupervised domain adaptation. IEEE Transactions on Neural Networks and Learning Systems, 31(9), 3374–3388. https://doi.org/10.1109/tnnls.2019.2944455
Zhang, Y., Ren, Z., Zhou, S., & Yu, T. (2021). Adversarial domain adaptation with classifier alignment for cross-domain intelligent fault diagnosis of multiple source domains. Measurement Science and Technology. https://doi.org/10.1088/1361-6501/abcad4
Zhang, Z., Chen, H., Li, S., & An, Z. (2020b). Unsupervised domain adaptation via enhanced transfer joint matching for bearing fault diagnosis. Measurement. https://doi.org/10.1016/j.measurement.2020.108071
Zhao, K., Jiang, H., Wu, Z., & Lu, T. (2022). A novel transfer learning fault diagnosis method based on manifold embedded distribution alignment with a little labeled data. Journal of Intelligent Manufacturing, 33(1), 151–165. https://doi.org/10.1007/s10845-020-01657-z
Zhu, L., Ding, H., & Zhu, X. (2008). Extraction of periodic signal without external reference by time-domain average scanning. IEEE Transactions on Industrial Electronics, 55(2), 918–927. https://doi.org/10.1109/tie.2007.909056
Zhu, L., Ding, H., & Zhu, X. Y. (2007). Synchronous averaging of time-frequency distribution with application to machine condition monitoring. Journal of Vibration and Acoustics-Transactions of the ASME, 129(4), 441–447. https://doi.org/10.1115/1.2748466
Zhu, Y., Zhuang, F., Wang, J., Ke, G., Chen, J., Bian, J., & He, Q. (2021). Deep subdomain adaptation network for image classification. IEEE Transactions on Neural Networks and Learning Systems, 32(4), 1713–1722. https://doi.org/10.1109/tnnls.2020.2988928
Acknowledgements
This work is partially funded by China Postdoctoral Science Foundation (No. 2020M673279), National Natural Science Foundation of China (NSFC) (No. 51675450), Sichuan Science and Technology Program (No. 2020JDTD0012).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Hu, R., Zhang, M., Xiang, Z. et al. Guided deep subdomain adaptation network for fault diagnosis of different types of rolling bearings. J Intell Manuf 34, 2225–2240 (2023). https://doi.org/10.1007/s10845-022-01910-7
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10845-022-01910-7