Abstract
In general, fault prognosis research usually leads to the research of remaining useful life prediction and performance prediction (prediction of target feature), which can be regarded as a sequence learning problem. Considering the significant success achieved by the recurrent neural network in sequence learning problems such as precise timing, speech recognition, and so on, this paper proposes a novel approach for fault prognosis with the degradation sequence of equipment based on the recurrent neural network. Long short-term memory (LSTM) network is utilized due to its capability of learning long-term dependencies, which takes the concatenated feature and operation state indicator of the equipment as the input. Note that the indicator is a one-hot vector, and based on it, the remaining useful life can be estimated without any pre-defined threshold. The outputs of the LSTM networks are connected to a fully-connected layer to map the hidden state into the parameters of a Gaussian mixture model and a categorical distribution so that the predicted output sequence can be sampled from them. The performance of the proposed method is verified by the health monitoring data of aircraft turbofan engines. The result shows that the proposed approach is able to achieve significant performance whether in one-step prediction task, in long-term prediction task, or in remaining useful life prediction task.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Ba, J. L., Kiros, J. R., Hinton, G. E. (2016). Layer normalization. arXiv:1607.06450.
Dong, M., & Peng, Y. (2011). Equipment phm using non-stationary segmental hidden semi-markov model. Robotics and Computer Integrated Manufacturing, 27(3), 581–590.
Elman, J. L. (1990). Finding structure in time, vol. 14. pp. 179–211.
Gebraeel, N. Z., & Lawley, M. A. (2008). A neural network degradation model for computing and updating residual life distributions. IEEE Transactions on Automation Science & Engineering, 5(1), 154–163.
Gers, F. A., & Schraudolph, N. N. (2003). Learning precise timing with lstm recurrent networks. JMLR.org
Gers, F. A., Schmidhuber, J., & Cummins, F. (2000). Learning to forget: Continual prediction with lstm. Neural Computation, 12(10), 2451–2471.
Graves, A., Mohamed, A. R., & Hinton, G. (2013). Speech recognition with deep recurrent neural networks. In Acoustics, speech and signal processing (ICASSP), 2013 IEEE international conference on. IEEE, vol. 38, pp. 6645–6649.
Guo, L., Li, N., Jia, F., Lei, Y., & Lin, J. (2017). A recurrent neural network based health indicator for remaining useful life prediction of bearings. Neurocomputing, 240, 98–109.
Ha, D., Eck, D. (2017). A neural representation of sketch drawings. CoRR, arXiv:1603.05118.
Hochreiter, S., & Schmidhuber, J. (1997). Long short-term memory. Neural computation, 9, 1735–1780.
Huang, R., Xi, L., & Li, X., Liu, C. R., Qiu, H., & Lee, J. (2007). Residual life predictions for ball bearings based on self-organizing map and back propagation neural network methods. Mechanical Systems and Signal Processing, 21(1), 193–207.
Javed, K., Gouriveau, R., Zerhouni, N., & Nectoux, P. (2013). A feature extraction procedure based on trigonometric functions and cumulative descriptors to enhance prognostics modeling. In Prognostics and health management, pp. 1–7.
Kinga, D., & Ba, J. (2015). Adam. A method for stochastic optimization. In International conference on learning representations (ICLR).
Kothamasu, R., Huang, S. H., & VerDuin, W. H. (2006). System health monitoring and prognostics a review of current paradigms and practices. The International Journal of Advanced Manufacturing Technology, 28(9–10), 1012–1024.
Kusiak, A. (2017). Smart manufacturing must embrace big data. Nature, 544(7648), 23–25.
Malhi, A., Yan, R., & Gao, R. X. (2011). Prognosis of defect propagation based on recurrent neural networks. IEEE Transactions on Instrumentation & Measurement, 60(3), 703–711.
Mikolov, T., Kombrink, S., Burget, L., Cernocky, J., & Khudanpur, S. (2011). Extensions of recurrent neural network language model. In IEEE International conference on acoustics, speech and signal processing, pp. 5528–5531.
Mosallam, A., Medjaher, K., & Zerhouni, N. (2016). Data-driven prognostic method based on bayesian approaches for direct remaining useful life prediction. Journal of Intelligent Manufacturing, 27(5), 1–12.
Peng, Y., Dong, M., & Zuo, M. J. (2010). Current status of machine prognostics in condition-based maintenance: A review. International Journal of Advanced Manufacturing Technology, 50(1–4), 297–313.
Saxena, A., Goebel, K., Simon, D., & Eklund, N. (2008). Damage propagation modeling for aircraft engine run-to-failure simulation. In Prognostics and Health Management, 2008. PHM 2008. International conference on, pp. 1–9. IEEE.
Semeniuta, S., Severyn, A., & Barth, E. (2016). Recurrent dropout without memory loss. arXiv:1704.03477
Shen, Z., He, Z., Chen, X., Sun, C., & Liu, Z. (2012). A monotonic degradation assessment index of rolling bearings using fuzzy support vector data description and running time. Sensors, 12(8), 10109–10135.
Sloukia, F., El Aroussi, M., Medromi, H., & Wahbi, M. (2013). Bearings prognostic using mixture of gaussians hidden markov model and support vector machine. In ACS international conference on computer systems and applications, pp. 1–4.
Soh, S. S., Radzi, N. H. M., & Haron, H. (2012). Review on scheduling techniques of preventive maintenance activities of railway. In International conference on computational intelligence, pp. 310–315.
Tao, F., & Qi, Q. (2017). New it driven service-oriented smart manufacturing: Framework and characteristics. IEEE Transactions on Systems Man and Cybernetics Systems, 99, 1–11.
Tao, F., Qi, Q., Liu, A., & Kusiak, A. (2018). Data-driven smart manufacturing. Journal of Manufacturing Systems. https://doi.org/10.1016/j.jmsy.2018.01.006.
Tobon-Mejia, D. A., Medjaher, K., Zerhouni, N., & Tripot, G. (2011). Hidden markov models for failure diagnostic and prognostic. In Prognostics and system health management conference, pp. 1–8.
Tobon-Mejia, D. A., Medjaher, K., Zerhouni, N., & Tripot, G. (2012). A data-driven failure prognostics method based on mixture of gaussians hidden markov models. IEEE Transactions on Reliability, 61(2), 491–503.
Wang, H., & Chen, J. (2013). Performance degradation assessment of rolling bearing based on bispectrum and support vector data description. Journal of Vibration & Control, 20(13), 2032–2041.
Wang, Y., Deng, C., Jun, W., & Xiong, Y. (2015). Failure time prediction for mechanical device based on the degradation sequence. Journal of Intelligent Manufacturing, 26(6), 1181–1199.
Yuting, W., Yuan, M., Dong, S., Lin, L., & Liu, Y. (2018). Remaining useful life estimation of engineered systems using vanilla LSTM neural networks. Neurocomputing, 275, 167–179.
Zhang, X., Kang, J., & Jin, T. (2014). Degradation modeling and maintenance decisions based on bayesian belief networks. IEEE Transactions on Reliability, 63(2), 620–633.
Zhang, Z., Wang, Y., & Wang, K. (2013). Fault diagnosis and prognosis using wavelet packet de- composition, fourier transform and artificial neural network. Journal of Intelligent Manufacturing, 24(6), 1213–1227.
Acknowledgements
This work was supported by the National Key R & D Program of China (No. 2018YFF0214705). Management and Control System of Health Status for Typical Industrial Equipments Driven by Big Data.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Wu, Q., Ding, K. & Huang, B. Approach for fault prognosis using recurrent neural network. J Intell Manuf 31, 1621–1633 (2020). https://doi.org/10.1007/s10845-018-1428-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10845-018-1428-5