Abstract
Recently, numerous new data-driven methods have been proposed. But most of them focused on the innovation of models and algorithms, and rarely discussed and optimized from the perspective of data and samples. However, the reliability of sample quality directly determines the effectiveness of machine learning models. In this paper, a novel data-driven method based on sample reliability assessment (SRA) and improved convolutional neural network (ICNN) for mechanical fault diagnosis was designed. First, multinomial logistic regression (MLR) was conducted to construct the assessment model and a statistical approach named influence function was used to compute the sample weights efficiently. Then, ICNN with the improved loss function was proposed based on the strategies of sample weights, class weights and early-stopping. Compared with traditional deep learning models, ICNN can better eliminate the negative impact of the problems during the model training including sample quality imbalance, class imbalance, and overfitting phenomenon. Therefore, the fault diagnosis performance can be improved. Finally, the trained ICNN can automatically extract the fault characteristics and achieve the fault diagnosis with the input of compressed time–frequency images. Experiments on a benchmarking dataset and a gear dataset from a practical experimental platform verified the superiority of the proposed fault diagnosis method.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Angelos, K., & Fleuret, F. (2018, Feb). Not all samples are created equal: Deep learning with importance sampling. In International conference on machine learning. <Go to ISI>://WOS:000585302200012
Cannarile, F., Compare, M., Baraldi, P., Diodati, G., Quaranta, V., & Zio, E. (2019). Elastic net multinomial logistic regression for fault diagnostics of on-board aeronautical systems. Aerospace Science and Technology. https://doi.org/10.1016/j.ast.2019.105392
Cao, S., Hu, Z., Luo, X., & Wang, H. (2021). Research on fault diagnosis technology of centrifugal pump blade crack based on PCA and GMM. Measurement. https://doi.org/10.1016/j.measurement.2020.108558
Chen, H., Jiang, B., Chen, W., & Yi, H. (2019). Data-driven detection and diagnosis of incipient faults in electrical drives of high-speed trains. IEEE Transactions on Industrial Electronics, 66(6), 4716–4725. https://doi.org/10.1109/tie.2018.2863191
Cook, R. D., & Weisberg, S. (1980). Characterizations of an empirical influence function for detecting influential cases in regression. Technometrics, 22(4), 495–508. https://doi.org/10.1080/00401706.1980.10486199
Cui, M., Wang, Y., Lin, X., & Zhong, M. (2021). Fault diagnosis of rolling bearings based on an improved stack autoencoder and support vector machine. IEEE Sensors Journal, 21(4), 4927–4937. https://doi.org/10.1109/jsen.2020.3030910
Debruyne, M., Hubert, M., & Suykens, J. A. (2008). Model selection in kernel based regression using the influence function. Journal of Machine Learning Research, 9, 2377–2400.
Gong, W., Chen, H., Zhang, Z., Zhang, M., Wang, R., Guan, C., & Wang, Q. (2019). A novel deep learning method for intelligent fault diagnosis of rotating machinery based on improved CNN-SVM and multichannel data fusion. Sensors (basel). https://doi.org/10.3390/s19071693
Gou, L., Li, H., Zheng, H., Li, H., & Pei, X. (2020). Aeroengine control system sensor fault diagnosis based on CWT and CNN. Mathematical Problems in Engineering, 2020, 1–12. https://doi.org/10.1155/2020/5357146
Gu, X., Yang, S., Liu, Y., Deng, F., & Ren, B. (2017). Compound faults detection of the rolling element bearing based on the optimal complex Morlet wavelet filter. Proceedings of the Institution of Mechanical Engineers, Part c: Journal of Mechanical Engineering Science, 232(10), 1786–1801. https://doi.org/10.1177/0954406217710673
Guo, S., Yang, T., Gao, W., & Zhang, C. (2018). A novel fault diagnosis method for rotating machinery based on a convolutional neural network. Sensors (basel). https://doi.org/10.3390/s18051429
Hoang, D.-T., & Kang, H.-J. (2019). A survey on deep learning based bearing fault diagnosis. Neurocomputing, 335, 327–335. https://doi.org/10.1016/j.neucom.2018.06.078
Hu, Z., Lv, C., Hang, P., Huang, C., & Xing, Y. (2022). Data-driven estimation of driver attention using calibration-free eye gaze and scene features. IEEE Transactions on Industrial Electronics, 69(2), 1800–1808. https://doi.org/10.1109/tie.2021.3057033
Hu, Z.-X., Wang, Y., Ge, M.-F., & Liu, J. (2019). Data-driven fault diagnosis method based on compressed sensing and improved multi-scale network. IEEE Transactions on Industrial Electronics. https://doi.org/10.1109/tie.2019.2912763
Hu, Z. X., Xing, Y., Lv, C., Hang, P., & Liu, J. (2021). Deep convolutional neural network-based Bernoulli heatmap for head pose estimation. Neurocomputing, 436, 198–209. https://doi.org/10.1016/j.neucom.2021.01.048
Jing, L., Zhao, M., Li, P., & Xu, X. (2017). A convolutional neural network based feature learning and fault diagnosis method for the condition monitoring of gearbox. Measurement, 111, 1–10. https://doi.org/10.1016/j.measurement.2017.07.017
Johnson, T. B., & Guestrin, C. (2018). Training deep models faster with robust, approximate importance sampling. Advances in Neural Information Processing Systems 31 (Nips 2018), 31, 7265–7275. <Go to ISI>://WOS:000461852001079
Kim, K.-H., Shim, P.-S., & Shin, S. (2019). An alternative bilinear interpolation method between spherical grids. Atmosphere. https://doi.org/10.3390/atmos10030123
Kiranyaz, S., Avci, O., Abdeljaber, O., Ince, T., Gabbouj, M., & Inman, D. J. (2021). 1D convolutional neural networks and applications: A survey. Mechanical Systems and Signal Processing. https://doi.org/10.1016/j.ymssp.2020.107398
Kumar, A., Vashishtha, G., Gandhi, C. P., Zhou, Y., Glowacz, A., & Xiang, J. (2021). Novel convolutional neural network (NCNN) for the diagnosis of bearing defects in rotary machinery. IEEE Transactions on Instrumentation and Measurement, 70, 1–10. https://doi.org/10.1109/tim.2021.3055802
Lei, Y., Yang, B., Jiang, X., Jia, F., Li, N., & Nandi, A. K. (2020). Applications of machine learning to machine fault diagnosis: A review and roadmap. Mechanical Systems and Signal Processing, 138, 106587. https://doi.org/10.1016/j.ymssp.2019.106587
Li, F., Li, R., Tian, L., Chen, L., & Liu, J. (2019a). Data-driven time-frequency analysis method based on variational mode decomposition and its application to gear fault diagnosis in variable working conditions. Mechanical Systems and Signal Processing, 116, 462–479. https://doi.org/10.1016/j.ymssp.2018.06.055
Li, H., Huang, J., & Ji, S. (2019b). Bearing fault diagnosis with a feature fusion method based on an ensemble convolutional neural network and deep neural network. Sensors (basel). https://doi.org/10.3390/s19092034
Li, X., Zhang, W., Ding, Q., & Sun, J.-Q. (2018). Intelligent rotating machinery fault diagnosis based on deep learning using data augmentation. Journal of Intelligent Manufacturing, 31(2), 433–452. https://doi.org/10.1007/s10845-018-1456-1
Liu, R., Yang, B., Zio, E., & Chen, X. (2018). Artificial intelligence for fault diagnosis of rotating machinery: A review. Mechanical Systems and Signal Processing, 108, 33–47. https://doi.org/10.1016/j.ymssp.2018.02.016
Mao, W., Feng, W., Liu, Y., Zhang, D., & Liang, X. (2021). A new deep auto-encoder method with fusing discriminant information for bearing fault diagnosis. Mechanical Systems and Signal Processing, 150, 107233. https://doi.org/10.1016/j.ymssp.2020.107233
Pang Wei Koh, P. L. (2017). Understanding Black-box Predictions via Influence Functions. In International conference on machine learning, Sydney, Australia.
Qu, J., Zhang, Z., & Gong, T. (2016). A novel intelligent method for mechanical fault diagnosis based on dual-tree complex wavelet packet transform and multiple classifier fusion. Neurocomputing, 171, 837–853. https://doi.org/10.1016/j.neucom.2015.07.020
Santiago, C., Barata, C., Sasdelli, M., Carneiro, G., & Nascimento, J. C. (2021). LOW: Training deep neural networks by learning optimal sample weights. Pattern Recognition. https://doi.org/10.1016/j.patcog.2020.107585
Smith, W. A., & Randall, R. B. (2015). Rolling element bearing diagnostics using the Case Western Reserve University data: A benchmark study. Mechanical Systems and Signal Processing, 64–65, 100–131. https://doi.org/10.1016/j.ymssp.2015.04.021
Wang, D., Zhao, Y., Yi, C., Tsui, K.-L., & Lin, J. (2018). Sparsity guided empirical wavelet transform for fault diagnosis of rolling element bearings. Mechanical Systems and Signal Processing, 101, 292–308. https://doi.org/10.1016/j.ymssp.2017.08.038
Wang, Y., Pan, Z., & Pan, Y. (2020). A training data set cleaning method by classification ability ranking for the k-nearest neighbor classifier. IEEE Transactions on Neural Networks and Learning Systems, 31(5), 1544–1556. https://doi.org/10.1109/TNNLS.2019.2920864
Wen, L., Li, X., & Gao, L. (2019). A transfer convolutional neural network for fault diagnosis based on ResNet-50. Neural Computing and Applications, 32(10), 6111–6124. https://doi.org/10.1007/s00521-019-04097-w
Wen, L., Li, X., Gao, L., & Zhang, Y. (2018). A new convolutional neural network-based data-driven fault diagnosis method. IEEE Transactions on Industrial Electronics, 65(7), 5990–5998. https://doi.org/10.1109/tie.2017.2774777
Xiang, S., Qin, Y., Zhu, C., Wang, Y., & Chen, H. (2020). Long short-term memory neural network with weight amplification and its application into gear remaining useful life prediction. Engineering Applications of Artificial Intelligence. https://doi.org/10.1016/j.engappai.2020.103587
Xu, X., Lei, Y., & Li, Z. (2020). An incorrect data detection method for big data cleaning of machinery condition monitoring. IEEE Transactions on Industrial Electronics, 67(3), 2326–2336. https://doi.org/10.1109/tie.2019.2903774
Yang, C., Zhou, K., & Liu, J. (2022). SuperGraph: Spatial-temporal graph-based feature extraction for rotating machinery diagnosis. IEEE Transactions on Industrial Electronics, 69(4), 4167–4176. https://doi.org/10.1109/tie.2021.3075871
Yin, Z., & Hou, J. (2016). Recent advances on SVM based fault diagnosis and process monitoring in complicated industrial processes. Neurocomputing, 174, 643–650. https://doi.org/10.1016/j.neucom.2015.09.081
Zhang, K., Tang, B., Deng, L., Tan, Q., & Yu, H. (2021a). A fault diagnosis method for wind turbines gearbox based on adaptive loss weighted meta-ResNet under noisy labels. Mechanical Systems and Signal Processing. https://doi.org/10.1016/j.ymssp.2021.107963
Zhang, X., Guo, S., Li, Y., & Jiang, L. (2020a). Semi-supervised fault identification based on Laplacian eigenmap and deep belief networks. Jixie Gongcheng Xuebao/journal of Mechanical Engineering, 56(1), 69–81. https://doi.org/10.3901/JME.2020.01.069
Zhang, X., Huang, T., Wu, B., Hu, Y., Huang, S., Zhou, Q., & Zhang, X. (2021b). Multi-model ensemble deep learning method for intelligent fault diagnosis with high-dimensional samples. Frontiers of Mechanical Engineering, 16(2), 340–352. https://doi.org/10.1007/s11465-021-0629-3
Zhang, Y., Li, X., Gao, L., Chen, W., & Li, P. (2020b). Intelligent fault diagnosis of rotating machinery using a new ensemble deep auto-encoder method. Measurement. https://doi.org/10.1016/j.measurement.2019.107232
Zhao, K., Jiang, H., Wu, Z., & Lu, T. (2020). A novel transfer learning fault diagnosis method based on Manifold Embedded Distribution Alignment with a little labeled data. Journal of Intelligent Manufacturing. https://doi.org/10.1007/s10845-020-01657-z
Zhao, M., Zhong, S., Fu, X., Tang, B., Dong, S., & Pecht, M. (2021). Deep residual networks with adaptively parametric rectifier linear units for fault diagnosis. IEEE Transactions on Industrial Electronics, 68(3), 2587–2597. https://doi.org/10.1109/tie.2020.2972458
Zhao, R., Yan, R., Chen, Z., Mao, K., Wang, P., & Gao, R. X. (2019). Deep learning and its applications to machine health monitoring. Mechanical Systems and Signal Processing, 115, 213–237. https://doi.org/10.1016/j.ymssp.2018.05.050
Zhou, K., Yang, C., Liu, J., & Xu, Q. (2021). Dynamic graph-based feature learning with few edges considering noisy samples for rotating machinery fault diagnosis. IEEE Transactions on Industrial Electronics. https://doi.org/10.1109/tie.2021.3121748
Zhou, Q., Li, Y., Tian, Y., & Jiang, L. (2020). A novel method based on nonlinear auto-regression neural network and convolutional neural network for imbalanced fault diagnosis of rotating machinery. Measurement, 161, 107880. https://doi.org/10.1016/j.measurement.2020.107880
Acknowledgements
This study was financially supported by the National Key R&D Program of China (No. 2017YFD0400405).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Zhang, X., Wang, H., Wu, B. et al. A novel data-driven method based on sample reliability assessment and improved CNN for machinery fault diagnosis with non-ideal data. J Intell Manuf 34, 2449–2462 (2023). https://doi.org/10.1007/s10845-022-01944-x
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10845-022-01944-x