Abstract
Deep learning-based fault diagnosis models achieve great success with sufficient balanced data, but the imbalanced dataset in real industrial scenarios will seriously affect the performance of various popular deep learning models. Data generation-based strategy provides a solution by expanding the number of minority samples. However, many data-generation methods cannot generate high-quality samples when the imbalanced ratio is high. To address these problems, a dual-attention feature fusion network (DAFFN) with two-stream hybrid-generated data is proposed. First, the two-stream hybrid generator including a generative model and an oversampling technique is adopted to generate minority fault data. Then, the convolutional neural network is used to extract features from hybrid-generated data. In particular, a feature fusion network with a dual-attention mechanism, i.e., a channel attention mechanism and a layer attention mechanism are designed to learn channel-level and layer-level weights of the features. Extensive results on two bearing datasets indicate that the proposed framework achieves outstanding performance in various high imbalanced-ratio cases.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Arjovsky, M., Chintala, S., & Bottou, L. (2017) . Wasserstein gan. In: Proceedings of the 34th international conference on machine learning research (Vol. 70, pp. 214–223). https://doi.org/10.48550/arXiv.1701.07875
Chawla, N.V., Bowyer, K.W., Hall, L.O., & Kegelmeyer, W. P. (2002) Smote: Synthetic minority over-sampling technique. Journal of Artificial Intelligence Research, 16(1), 321–357. https://doi.org/10.48550/arXiv.1106.1813
Chen, J., Lin, C., Peng, D., & Ge, H. (2020). Fault diagnosis of rotating machinery: A review and bibliometric analysis. IEEE Access, 8, 224985–225003. https://doi.org/10.1109/ACCESS.2020.3043743
Chen, Q., Zhang, Z. L., Huang, W. P., Wu, J., & Luo, X.-G. (2022). Pf-smote: A novel parameter-free smote for imbalanced datasets. Neurocomputing, 498, 75–88. https://doi.org/10.1016/j.neucom.2022.05.017
Deng, W., Liu, H., Xu, J., Zhao, H., & Song, Y. (2020). An improved quantum-inspired differential evolution algorithm for deep belief network. IEEE Transactions on Instrumentation and Measurement, 69(10), 7319–7327. https://doi.org/10.1109/TIM.2020.2983233
Dixit, S., & Verma, N. K. (2020). Intelligent condition-based monitoring of rotary machines with few samples. IEEE Sensors Journal, 20(23), 14337–14346. https://doi.org/10.1109/JSEN.2020.3008177
Douzas, G., Bacao, F., & Last, F. (2018). Improving imbalanced learning through a heuristic oversampling method based on k-means and smote. Information Sciences, 465, 1–20. https://doi.org/10.1016/j.ins.2018.06.056
Fan, Z., Xu, X., Wang, R., & Wang, H. (2022). Fan fault diagnosis based on lightweight multiscale multiattention feature fusion network. IEEE Transactions on Industrial Informatics, 18(7), 4542–4554. https://doi.org/10.1109/TII.2021.3121294
Goodfellow, I. J., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., & Bengio, Y. (2014). Generative adversarial networks. Paper presented at the international conference on neural information processing systems (Vol. 3, pp. 2672–2680), June 2014. https://doi.org/10.48550/arXiv.1406.2661
Gulrajani, I., Ahmed, F., Arjovsky, M., Dumoulin, V., & Courville, A. C. (2017) Improved training of wasserstein gans. CoRR. https://doi.org/10.48550/arXiv.1704.00028
Hao, W., & Liu, F. (2020). Imbalanced data fault diagnosis based on an evolutionary online sequential extreme learning machine. Symmetry. https://doi.org/10.3390/sym12081204
Jia, L., Chow, T. W. S., Wang, Y., & Yuan, Y. (2022). Multiscale residual attention convolutional neural network for bearing fault diagnosis. IEEE Transactions on Instrumentation and Measurement, 71, 1–13. https://doi.org/10.1109/TIM.2022.3196742
Kong, X., Li, X., Zhou, Q., Hu, Z., & Shi, C. (2021). Attention recurrent autoencoder hybrid model for early fault diagnosis of rotating machinery. IEEE Transactions on Instrumentation and Measurement, 70, 1–10. https://doi.org/10.1109/TIM.2021.3051948
Li, Y., Wang, X., Si, S., & Huang, S. (2020). Entropy based fault classification using the case western reserve university data: A benchmark study. IEEE Transactions on Reliability, 69(2), 754–767. https://doi.org/10.1109/TR.2019.2896240
Liu, Q., Liu, M., Zhou, H., Yan, F., Ma, Y., & Shen, W. (2022). Intelligent manufacturing system with human-cyber-physical fusion and collaboration for process fine control. Journal of Manufacturing Systems, 64, 149–169. https://doi.org/10.1016/j.jmsy.2022.06.004
Luo, J., Huang, J., & Li, H. (2021). A case study of conditional deep convolutional generative adversarial networks in machine fault diagnosis. Journal of Intelligent Manufacturing. https://doi.org/10.1007/s10845-020-01579-w
Mao, W., Feng, W., Liu, Y., Zhang, D., & Liang, X. (2021). A new deep auto-encoder method with fusing discriminant information for bearing fault diagnosis. Mechanical Systems and Signal Processing, 150(107), 233. https://doi.org/10.1016/j.ymssp.2020.107233
Martins, D. H. C. D. S., Lima, A., Faria Pinto, M., Hemerly, D., Prego, T., Silva, F., Tarrataca, L., Monteiro, U., Gutierrez, R., & Haddad, D. (2022). Hybrid data augmentation method for combined failure recognition in rotating machines. Journal of Intelligent Manufacturing. https://doi.org/10.1007/s10845-021-01873-1
Niu, Z., Zhong, G., & Yu, H. (2021). A review on the attention mechanism of deep learning. Neurocomputing, 452, 48–62. https://doi.org/10.1016/j.neucom.2021.03.091
Radford, A., Metz, L., & Chintala, S. (2016). Unsupervised representation learning with deep convolutional generative adversarial networks. Paper presented at the 2016 ICLR conference on computer vision and pattern recognition (CVPR), 7 January 2016. https://doi.org/10.48550/arXiv.1511.06434
Shao, H., Xia, M., Han, G., Zhang, Y., & Wan, J. (2021). Intelligent fault diagnosis of rotor-bearing system under varying working conditions with modified transfer convolutional neural network and thermal images. IEEE Transactions on Industrial Informatics, 17(5), 3488–3496. https://doi.org/10.1109/TII.2020.3005965
Wang, G., Zhang, F., Cheng, B., & Fang, F. (2021). Damer: a novel diagnosis aggregation method with evidential reasoning rule for bearing fault diagnosis. Journal of Intelligent Manufacturing. https://doi.org/10.1007/s10845-020-01554-5
Wang, H., Liu, Z., Peng, D., & Qin, Y. (2020). Understanding and learning discriminant features based on multiattention 1dcnn for wheelset bearing fault diagnosis. IEEE Transactions on Industrial Informatics, 16(9), 5735–5745. https://doi.org/10.1109/TII.2019.2955540
Wang, L., Han, M., Li, X., Zhang, N., & Cheng, H. (2021b) Review of classification methods on unbalanced data sets. IEEE Access 9:64,606–64,628. https://doi.org/10.1109/ACCESS.2021.3074243
Wang, Q., Wu, B., Zhu, P., Li, P., Zuo, W., & Hu, Q. (2020b). Eca-net: Efficient channel attention for deep convolutional neural networks. Paper presented at the 2020 IEEE/CVF conference on computer vision and pattern recognition (CVPR), 13–19 June 2020. https://doi.org/10.1109/CVPR42600.2020.01155
Xin, Z., Wang, H., Wu, B., Zhou, Q., & Youmin, H. (2022). A novel data-driven method based on sample reliability assessment and improved CNN for machinery fault diagnosis with non-ideal data. Journal of Intelligent Manufacturing. https://doi.org/10.1007/s10845-022-01944-x
Xing, S., Lei, Y., Wang, S., & Jia, F. (2021). Distribution-invariant deep belief network for intelligent fault diagnosis of machines under new working conditions. IEEE Transactions on Industrial Electronics, 68(3), 2617–2625. https://doi.org/10.1109/TIE.2020.2972461
Xu, Q., Lu, S., Jia, W., & Jiang, C. (2020). Imbalanced fault diagnosis of rotating machinery via multi-domain feature extraction and cost-sensitive learning. Journal of Intelligent Manufacturing, 31, 1–15. https://doi.org/10.1007/s10845-019-01522-8
Yan, X., She, D., Xu, Y., & Jia, M. (2021). Deep regularized variational autoencoder for intelligent fault diagnosis of rotor-bearing system within entire life-cycle process. Knowledge-Based Systems, 226(107), 142. https://doi.org/10.1016/j.knosys.2021.107142
Yang, G., Zhong, Y., Yang, L., Tao, H., Li, J., & Du, R. (2021). Fault diagnosis of harmonic drive with imbalanced data using generative adversarial network. IEEE Transactions on Instrumentation and Measurement, 70, 1–11. https://doi.org/10.1109/TIM.2021.3089240
Yi, H., Jiang, Q., Yan, X., & Wang, B. (2021). Imbalanced classification based on minority clustering synthetic minority oversampling technique with wind turbine fault detection application. IEEE Transactions on Industrial Informatics, 17(9), 5867–5875. https://doi.org/10.1109/TII.2020.3046566
Zhang, D., Dongru, H., Kang, L., & Zhang, W. (2022). The generative adversarial networks and its application in machine vision. Enterprise Information Systems, 16(2), 326–346. https://doi.org/10.1080/17517575.2019.1701714
Zhang, H., Wang, R., Pan, R., & Pan, H. (2020). Imbalanced fault diagnosis of rolling bearing using enhanced generative adversarial networks. IEEE Access. https://doi.org/10.1109/ACCESS.2020.3030058
Zhang, J., Zou, J., Su, Z., Tang, J., Kang, Y., Xu, H., Liu, Z., & Fan, S. (2022). A class-aware supervised contrastive learning framework for imbalanced fault diagnosis. Knowledge-Based Systems, 252(109), 437. https://doi.org/10.1016/j.knosys.2022.109437
Zhang, L., Zhang, H., & Cai, G. (2022). The multiclass fault diagnosis of wind turbine bearing based on multisource signal fusion and deep learning generative model. IEEE Transactions on Instrumentation and Measurement, 71, 1–12. https://doi.org/10.1109/TIM.2022.3178483
Zhang, T., Chen, J., Li, F., Zhang, K., Lv, H., He, S., & Xu, E. (2022). Intelligent fault diagnosis of machines with small & imbalanced data: A state-of-the-art review and possible extensions. ISA Transactions, 119, 152–171. https://doi.org/10.1016/j.isatra.2021.02.042
Zhang, T., He, S., Chen, J., Pan, T., & Zhou, Z. (2022). Toward small sample challenge in intelligent fault diagnosis: Attention-weighted multidepth feature fusion net with signals augmentation. IEEE Transactions on Instrumentation and Measurement, 71, 1–13. https://doi.org/10.1109/TIM.2021.3134999
Zhao, B., Zhang, X., Li, H., & Yang, Z. (2020). Intelligent fault diagnosis of rolling bearings based on normalized CNN considering data imbalance and variable working conditions. Knowledge-Based Systems, 199(105), 971. https://doi.org/10.1016/j.knosys.2020.105971
Acknowledgements
This work was supported by the National Natural Science Foundation of China (Grant No. 62273261 and No. 62133011).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Wang, C., Wang, H. & Liu, M. A dual-attention feature fusion network for imbalanced fault diagnosis with two-stream hybrid generated data. J Intell Manuf 35, 1707–1719 (2024). https://doi.org/10.1007/s10845-023-02131-2
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10845-023-02131-2