Abstract
Fault diagnosis plays an important role in actual production activities. As large amounts of data can be collected efficiently and economically, data-driven methods based on deep learning have achieved remarkable results of fault diagnosis of complex systems due to their superiority in feature extraction. However, existing techniques rarely consider time delay of occurrence of faults, which affects the performance of fault diagnosis. In this paper, by synthetically considering feature extraction and time delay of occurrence of faults, we propose a novel fault diagnosis method that consists of two parts, namely, sliding window processing and CNN-LSTM model based on a combination of Convolutional Neural Network (CNN) and Long Short-Term Memory Network (LSTM). Firstly, samples obtained from multivariate time series by the sliding window processing integrates feature information and time delay information. Then, the obtained samples are fed into the proposed CNN-LSTM model including CNN layers and LSTM layers. The CNN layers perform feature learning without relying on prior knowledge. Time delay information is captured with the use of the LSTM layers. The fault diagnosis of the Tennessee Eastman chemical process is addressed, and it is verified that the predictive accuracy and noise sensitivity of fault diagnosis can be greatly improved when the proposed method is applied. Comparisons with five existing fault diagnosis methods show the superiority of the proposed method.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Aydin I, Karakose M, Akin E (2012) An adaptive artificial immune system for fault classification. J Intell Manuf 23(5):1489–1499
Cai B, Liu H, Xie M (2016) A real-time fault diagnosis methodology of complex systems using object-oriented Bayesian networks. Mech Syst Signal Process 80:31–44
Cai B, Liu Y, Xie M (2017a) A dynamic-bayesian-network-based fault diagnosis methodology considering transient and intermittent faults. IEEE Trans Autom Sci Eng 14(1):276–285
Cai B, Zhao Y, Liu H, Xie M (2017b) A data-driven fault diagnosis methodology in three-phase inverters for pmsm drive systems. IEEE Trans Power Electron 32(7):5590–5600
Cai B, Shao X, Liu Y, Kong X, Wang H, Xu H, Ge W (2020) Remaining useful life estimation of structure systems under the influence of multiple causes: subsea pipelines as a case study. IEEE Trans Industr Electron 67(7):5737–5747
Casimir R, Boutleux E, Clerc G, Yahoui A (2006) The use of features selection and nearest neighbors rule for faults diagnostic in induction motors. Eng Appl Artif Intell 19(2):169–177
de Bruin, T., Verbert, K., & Babuška, R (2017) Railway track circuit fault diagnosis using recurrent neural networks. IEEE Trans Neural Netw Learn Syst 28(3), 523–533
Downs JJ, Vogel EF (1993) A plant-wide industrial process control problem. Comput Chem Eng 17(3):245–255
Du Y, Zhou S, Jing X, Peng Y, Wu H, Kwok N (2020) Damage detection techniques for wind turbine blades: a review. Mech Syst Signal Process 141:106445
El-Koujok M, Benammar M, Meskin N, Al-Naemi M, Langari R (2014) Multiple sensor fault diagnosis by evolving data-driven approach. Inf Sci 259:346–358
Feng J, Yao Y, Lu S, Liu Y (2021) Domain knowledge-based deep-broad learning framework for fault diagnosis. IEEE Trans Industr Electron 68(4):3454–3464
Gao X, Hou J (2016) An improved SVM integrated GS-PCA fault diagnosis approach of tennessee eastman process. Neurocomputing 174:906–911
Gers FA, Schraudolph NN, Schmidhuber J (2002) Learning precise timing with LSTM recurrent networks. J Mach Learn Res 3:115–143
Goyal D, Choudhary A, Pabla BS, Dhami SS (2020) Support vector machines based non-contact fault diagnosis system for bearings. J Intell Manuf 31:1275–1289
Guo X, Chen L, Shen C (2016) Hierarchical adaptive deep convolution neural network and its application to bearing fault diagnosis. Measurement 93:490–502
Hong L, Dhupia JS (2014) A time domain approach to diagnose gearbox fault based on measured vibration signals. J Sound Vib 333(7):2164–2180
Hughes B (1991) On the error probability of signals in additive white Gaussian noise. IEEE Trans Inf Theory 37(1):151–155
Janssens O, Slavkovikj V, Vervisch B, Stockman K, Loccufier M, Verstockt S, Van de Walle R, Van Hoecke S (2016) Convolutional neural network based fault detection for rotating machinery. J Sound Vib 377:331–345
Jing C, Hou J (2015) SVM and PCA based fault classification approaches for complicated industrial process. Neurocomputing 167:636–642
Kabir S (2017) An overview of fault tree analysis and its application in model based dependability analysis. Expert Syst Appl 77:114–135
Khalil K, Eldash O, Kumar A, Bayoumi M (2020) Machine Learning-Based Approach for Hardware Faults Prediction. Regular Papers, IEEE Transactions on Circuits and Systems I, pp 1–13
Kolen JF, Kremer SC (2009) Gradient Flow in Recurrent Nets: The Difficulty of Learning Long-Term Dependencies. Wiley-IEEE Press, In A Field Guide to Dynamical Recurrent Networks
Krizhevsky A, Sutskever I, Hinton GE (2017) ImageNet classification with deep convolutional neural networks. Commun ACM 60(6):84–90
Lei Y, Zuo MJ (2009) Gear crack level identification based on weighted K nearest neighbor classification algorithm. Mech Syst Signal Process 23(5):1535–1547
Lei Y, Jia F, Lin J, Xing S, Ding S (2016) An intelligent fault diagnosis method using unsupervised feature learning towards mechanical big data. IEEE Trans Industr Electron 63(5):3137–3147
Li C (2018) Improving forecasting accuracy of daily enterprise electricity consumption using a random forest based on ensemble empirical mode decomposition. Energy 165:1220–1227
Li C, Cerrada M, Cabrera D, Sanchez RV, Pacheco F, Ulutagay G, Valente de Oliveira J (2018a) A comparison of fuzzy clustering algorithms for bearing fault diagnosis. Journal of Intelligent and Fuzzy Systems 34(6):3565–3580
Li H, Huang H, Li Y, Zhou J, Mi J (2018b) Physics of failure-based reliability prediction of turbine blades using multi-source information fusion. Appl Soft Comput 72:624–635
Li C, de Oliveira JV, Cerrada M, Cabrera D, Sanchez RV, Zurita G (2019a) A systematic review of fuzzy formalisms for bearing fault diagnosis. IEEE Trans Fuzzy Syst 27(7):1362–1382
Li X, Zhang W, Ding Q (2019b) Understanding and improving deep learning-based rolling bearing fault diagnosis with attention mechanism. Signal Process 161:136–154
Liu H, Zhou J, Zheng Y, Jiang W, Zhang Y (2018) Fault diagnosis of rolling bearings with recurrent neural network-based autoencoders. ISA Trans 77:167–178
Liu C, Hsaio WH, Tu Y (2019) Time series classification with multivariate convolutional neural network. IEEE Trans Industr Electron 66(6):4788–4797
Murata, M., Kuroda, R., Fujihara, Y., Otsuka, Y., Shibata, H., Shibaguchi, T., et al. (2020) A high near-infrared sensitivity over 70-dB SNR CMOS image sensor with lateral overflow integration trench capacitor. IEEE Trans Electron Devices 67(4), 1653–1659
Nath AG, Udmale SS, Singh SK (2020) Role of artificial intelligence in rotor fault diagnosis: a comprehensive review. Artif Intell Rev. https://doi.org/10.1007/s10462-020-09910-w
Rai VK, Mohanty AR (2007) Bearing fault diagnosis using FFT of intrinsic mode functions in Hilbert-Huang transform. Mech Syst Signal Process 21(6):2607–2615
Razavian, A. S., Azizpour, H., Sullivan, J., and Carlsson, S. (2014). CNN Features Off-the-Shelf: An Astounding Baseline for Recognition. 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops, 512–519
Rodríguez Ramos A, Domínguez Acosta C, Rivera Torres PJ, Serrano Mercado EI, Beauchamp Baez G, Rifón LA, Llanes-Santiago O (2019) An approach to multiple fault diagnosis using fuzzy logic. J Intell Manuf 30(1):429–439
Seera M, Lim CP, Loo CK (2016) Motor fault detection and diagnosis using a hybrid FMM-CART model with online learning. J Intell Manuf 27(6):1273–1285
Serdio F, Lughofer E, Pichler K, Pichler M, Buchegger T, Efendic H (2015) Fuzzy fault isolation using gradient information and quality criteria from system identification models. Inf Sci 316:18–39
Sivaraman M, Strojwas AJ (2001) Path delay fault diagnosis and coverage-a metric and an estimation technique. IEEE Trans Comput Aided Des Integr Circuits Syst 20(3):440–457
Wang, Y., Pan, Z., Yuan, X., Yang, C., & Gui, W (2020) A novel deep learning based fault diagnosis approach for chemical process with extended deep belief network. ISA Transactions 96, 457–467
Wang Z, Marek-Sadowska MM, Tsai KH, Rajski J (2005) Delay-fault diagnosis using timing information. IEEE Trans Comput Aided Des Integr Circuits Syst 24(9):1315–1325
Wen L, Li X, Gao L, Zhang Y (2018) A New Convolutional neural network-based data-driven fault diagnosis method. IEEE Trans Industr Electron 65(7):5990–5998
Wu H, Zhao J (2018) Deep convolutional neural network model based chemical process fault diagnosis. Comput Chem Eng 115:185–197
Wu Q, Guo Y, Chen H, Qiang X, Wang W (2019) Establishment of a deep learning network based on feature extraction and its application in gearbox fault diagnosis. Artif Intell Rev 52(1):125–149
Yan R, Gao R, Chen X (2014) Wavelets for fault diagnosis of rotary machines: a review with applications. Signal Process 96:1–15
Yang L, Agyakwa PA, Johnson CM (2013) Physics-of-failure lifetime prediction models for wire bond interconnects in power electronic modules. IEEE Trans Device Mater Reliab 13(1):9–17
Yu J, Liu G (2020) Knowledge extraction and insertion to deep belief network for gearbox fault diagnosis. Knowl-Based Syst 197:105883
Zhang W, Peng G, Li C, Chen Y, Zhang Z (2017) A new deep learning model for fault diagnosis with good anti-noise and domain adaptation ability on raw vibration signals. Sensors 17(2):425
Zhang C, Guo Q, Li Y (2020) Fault detection in the tennessee eastman benchmark process using principal component difference based on k-nearest neighbors. IEEE Access 8:49999–50009
Zhu S, Huang H, Peng W, Wang H, Mahadevan S (2016) Probabilistic physics of failure-based framework for fatigue life prediction of aircraft gas turbine discs under uncertainty. Reliab Eng Syst Saf 146:1–12
Acknowledgements
This research was supported by the Foundation for Innovative Research Groups of the National Natural Science Foundation of China (No. 71521001), and the National Natural Science Foundation of China (Nos. 71690230, 71690235, 71501056, 71601066, 71901086, 71501055, 71571060, 71501054 and 71571166).
Author information
Authors and Affiliations
Corresponding authors
Rights and permissions
About this article
Cite this article
Huang, T., Zhang, Q., Tang, X. et al. A novel fault diagnosis method based on CNN and LSTM and its application in fault diagnosis for complex systems. Artif Intell Rev 55, 1289–1315 (2022). https://doi.org/10.1007/s10462-021-09993-z
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10462-021-09993-z