Abstract
Process fault detection and diagnosis (FDD) is a predominant task to ensure product quality and process reliability in modern industrial systems. Those traditional FDD techniques are largely based on diagnostic experience. These methods have met significant challenges with immense expansion of plant scale and large numbers of process variables. Recently, deep learning has become the newest trends in process control. The upsurge of deep neural networks (DNNs) in leaning highly discriminative features from complicated process data has provided practitioners with effective process monitoring tools. This paper is to present a review and full developing route of deep learning-based FDD in complex process industries. Firstly, the nature of traditional data projection-based and machine learning-based FDD methods is discussed in process FDD. Secondly, the characteristics of deep learning and their applications in process FDD are illustrated. Thirdly, these typical deep learning techniques, e.g., transfer learning, generative adversarial network, capsule network, graph neural network, are presented for process FDD. These DNNs will effectively solve these problems of fault detection, fault classification, and fault isolation in process. Finally, the developing route of DNN-based process FDD techniques is highlighted for future work.


























Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Data availability
Data sharing is not applicable to this article as no datasets were generated or analyzed during the current study.
References
Wang J, Ma Y, Zhang L, Gao RX, Wu D (2018) Deep learning for smart manufacturing: methods and applications. J Manuf Syst 48:144–156
Ge Z, Song Z, Gao F (2013) Review of recent research on data-based process monitoring. Ind Eng Chem Res 52:3543–3562
Rathinasabapathy R, Elsass MJ, Josephson JR, Davis JF (2016) A smart manufacturing methodology for real time chemical process diagnosis using causal link assessment. Aiche J 62:3420–3431
Montmain J, Labreuche C, Imoussaten A, Trousset F (2015) Multi-criteria improvement of complex systems. Inform Sci 291:61–84
Butte VK, Tang LC (2010) Multivariate charting techniques: a review and a line-column approach. Qual Reliab Eng Int 26:443–451
Kang JH, Kim SB (2015) False alarm classification for multivariate manufacturing processes of thin film transistor-liquid crystal displays. J Process Contr 35:21–29
Peres FAP, Fogliatto FS (2018) Variable selection methods in multivariate statistical process control: a systematic literature review. Comput Ind Eng 115:603–619
Jiang QC, Huang B (2016) Distributed monitoring for large-scale processes based on multivariate statistical analysis and Bayesian method. J Process Contr 46:75–83
Bakshi BR (1998) Multiscale PCA with application to multivariate statistical process monitoring. Aiche J 44:1596–1610
Lee JM, Yoo CK, Lee IB (2004) Statistical process monitoring with independent component analysis. J Process Contr 14:467–485
Jiang QC, Yan XF, Lv ZM, Guo MJ (2014) Independent component analysis-based non-Gaussian process monitoring with preselecting optimal components and support vector data description. Int J Prod Res 52:3273–3286
Nomikos P, MacGregor JF (1995) Multi-way partial least squares in monitoring batch processes. Chemometr Intell Lab 30:97–108
He QP, Qin SJ, Wang J (2005) A new fault diagnosis method using fault directions in fisher discriminant analysis. Aiche J 51:555–571
Ding SX, Zhang P, Naik A, Ding EL, Huang B (2009) Subspace method aided data-driven design of fault detection and isolation systems. J Process Contr 19:1496–1510
Dong D, McAvoy TJ (1996) Nonlinear principal component analysis - Based on principal curves and neural networks. Comput Chem Eng 20:65–78
Lee JM, Yoo CK, Choi SW, Vanrolleghem PA, Lee IB (2004) Nonlinear process monitoring using kernel principal component analysis. Chem Eng Sci 59:223–234
Xi Z, Weiwu Y, Xu Z, Huihe S (2007) Nonlinear biological batch process monitoring and fault identification based on kernel fisher discriminant analysis. Process Biochem 42:1200–1210
Deng XG, Tian XM, Chen S, Harris CJ (2017) Fault discriminant enhanced kernel principal component analysis incorporating prior fault information for monitoring nonlinear processes. Chemometr Intell Lab 162:21–34
Chiang LH, Russell EL, Braatz RD (2000) Fault diagnosis in chemical processes using Fisher discriminant analysis, discriminant partial least squares, and principal component analysis. Chemometr Intell Lab 50:243–252
Ding SX, Zhang P, Jeinsch T, Ding EL, Gui W (2011) A Survey of the Application of Basic Data-Driven and Model-Based Methods in Process Monitoring and Fault Diagnosis. IFAC Proc 44:12380–12388
Yin S, Ding SX, Haghani A, Hao HY, Zhang P (2012) A comparison study of basic data-driven fault diagnosis and process monitoring methods on the benchmark Tennessee Eastman process. J Process Contr 22:1567–1581
Yin S, Ding SX, Xie XC, Luo H (2014) A review on basic data-driven approaches for industrial process monitoring. Ieee T Ind Electron 61:6418–6428
He XF, Cai D, Shao YL, Bao HJ, Han JW (2011) Laplacian regularized Gaussian mixture model for data clustering. IEEE Trans Knowl Data En 23:1406–1418
Tenenbaum JB, de Silva V, Langford JC (2000) A global geometric framework for nonlinear dimensionality reduction. Science 290:2319–2323
Roweis ST, Saul LK (2000) Nonlinear dimensionality reduction by locally linear embedding. Science 290:2323–2326
Belkin M, Niyogi P (2003) Laplacian eigenmaps for dimensionality reduction and data representation. Neural Comput 15:1373–1396
Zhang ZY, Zha HY (2004) Principal manifolds and nonlinear dimensionality reduction via tangent space alignment, Siam. J Sci Comput 26:313–338
Peng X, Tang Y, Du WL, Qian F (2017) Multimode Process Monitoring and Fault Detection: A Sparse Modeling and Dictionary Learning Method. IEEE Trans Ind Electron 64:4866–4875
Zhou YJ, Xu K, He F, He D (2020) Nonlinear fault detection for batch processes via improved chordal kernel tensor locality preserving projections. Control Eng Pract 101:1–14
Yu JB (2010) Hidden Markov models combining local and global information for nonlinear and multimodal process monitoring. J Process Contr 20:344–359
Yu JB (2012) Local and global principal component analysis for process monitoring. J Process Contr 22:1358–1373
Yu JB (2016) Process monitoring through manifold regularization-based GMM with global/local information. J Process Contr 45:84–99
Li N, Yan WW, Yang YP (2015) Spatial-statistical local approach for improved manifold-based process monitoring. Ind Eng Chem Res 54:8509–8519
Lunga D, Prasad S, Crawford MM, Ersoy O (2014) Manifold-learning-based feature extraction for classification of hyperspectral data. Ieee Signal Proc Mag 31:55–66
Tong CD, Shi XH, Lan T (2016) Statistical process monitoring based on orthogonal multi-manifold projections and a novel variable contribution analysis. ISA Trans 65:407–417
Yang J, Zhang MS, Shi HB, Tan S (2017) Dynamic learning on the manifold with constrained time information and its application for dynamic process monitoring. Chemometr Intell Lab 167:179–189
Sharifian S, Sotudeh-Gharebagh R, Zarghami R, Tanguy P, Mostoufi N (2021) Uncertainty in chemical process systems engineering: a critical review. Rev Chem Eng 37:687–714
Vincent P, Larochelle H, Lajoie I, Bengio Y, Manzagol PA (2010) Stacked denoising autoencoders: learning useful representations in a deep network with a local denoising criterion. J Mach Learn Res 11:3371–3408
Krizhevsky A, Sutskever I, Hinton GE (2017) ImageNet classification with deep convolutional neural networks. Commun Acm 60:84–90
Hinton GE, Salakhutdinov RR (2006) Reducing the dimensionality of data with neural networks. Science 313:504–507
Lipton ZC, Berkowitz J, Elkan C (2015) A critical review of recurrent neural networks for sequence learning. Comput Sci 1:1–38
Boroumand M, Chen M, Fridrich J (2019) Deep residual network for steganalysis of digital images. IEEE Trans Inf Foren Sec 14:1181–1193
Das A, Maiti J, Banerjee RN (2012) Process monitoring and fault detection strategies: a review. Int J Qual Reliabil Manag 29:720–752
Qin SJ (2012) Survey on data-driven industrial process monitoring and diagnosis. Annu Rev Control 36:220–234
Ge ZQ, Song ZH, Deng SX, Huang B (2017) Data mining and analytics in the process industry: the role of machine learning. IEEE Access 5:20590–20616
Nor NM, Hassan CRC, Hussain MA (2020) A review of data-driven fault detection and diagnosis methods: applications in chemical process systems. Rev Chem Eng 36:513–553
Taqvi SAA, Zabiri H, Tufa LD, Uddin F, Fatima SA, Maulud AS (2021) A review on data-driven learning approaches for fault detection and diagnosis in chemical processes. Chembioeng Rev 8:239–259
Lei YG, Yang B, Jiang XW, Jia F, Li NP, Nandi AK (2020) Applications of machine learning to machine fault diagnosis: a review and roadmap. Mech Syst Signal Pr 138:1–39
Onel M, Kieslich CA, Guzman YA, Pistikopoulos EN (2018) Simultaneous fault detection and identification in continuous processes via nonlinear support vector machine based feature selection. Comput Aided Chem Eng 44:2077–2082
Yao Y, Gao FR (2009) A survey on multistage/multiphase statistical modeling methods for batch processes. Annu Rev Control 33:172–183
Tong CD, Palazoglu A, Yan XF (2013) An adaptive multimode process monitoring strategy based on mode clustering and mode unfolding. J Process Contr 23:1497–1507
Wang F, Zhu HL, Tan S, Shi HB (2016) Orthogonal nonnegative matrix factorization based local hidden Markov model for multimode process monitoring. Chin J Chem Eng 24:856–860
Afzal MS, Tan W, Chen TW (2017) Process monitoring for multimodal processes with mode-reachability constraints. IEEE Trans Ind Electron 64:4325–4335
Lou Z, Wang Y (2017) Hidden semi-Markov model based monitoring algorithm for multimode processes. In: 2017 6th Data driven control and learning systems (DDCLS), pp 66–71.
Yang CM, Hou J (2016) Fed-batch fermentation penicillin process fault diagnosis and detection based on support vector machine. Neurocomputing 190:117–123
Yu J, Qin SJ (2008) Multimode process monitoring with Bayesian inference-based finite Gaussian mixture models. Aiche J 54:1811–1829
He QP, Wang J (2007) Fault detection using the k-nearest neighbor rule for semiconductor manufacturing processes. IEEE Trans Semicond Manuf 20:345–354
Sun K, Liu JL, Kang JL, Jang SS, Wong DSH, Chen DS (2014) Development of a variable selection method for soft sensor using artificial neural network and nonnegative garrote. J Process Contr 24:1068–1075
Pani AK, Mohanta HK (2015) Online monitoring and control of particle size in the grinding process using least square support vector regression and resilient back propagation neural network. Isa T 56:206–221
Liu TI, Jolley B (2015) Tool condition monitoring (TCM) using neural networks. Int J Adv Manuf Tech 78:1999–2007
Pian JX, Zhu YL (2015) A hybrid soft sensor for measuring hot-rolled strip temperature in the laminar cooling process. Neurocomputing 169:457–465
Du SC, Xi LF (2011) Fault diagnosis in assembly processes based on engineering-driven rules and PSOSAEN algorithm. Comput Ind Eng 60:77–88
Majid N, Young BR, Taylor MP, Chen J (2012) K-means clustering pre-analysis for fault diagnosis in an aluminium smelting process. In: 2012 4th Conference on Data Mining and Optimization (DMO), 2012, pp 43–46
Ku WF, Storer RH, Georgakis C (1995) Disturbance detection and isolation by dynamic principal component analysis. Chemometr Intell Lab 30:179–196
Luo RF, Misra M, Himmelblau DM (1999) Sensor fault detection via multiscale analysis and dynamic PCA. Ind Eng Chem Res 38:1489–1495
Russell EL, Chiang LH, Braatz RD (2000) Fault detection in industrial processes using canonical variate analysis and dynamic principal component analysis. Chemometr Intell Lab 51:81–93
Mina J, Verde C (2005) Fault detection using dynamic principal component analysis by average estimation. In: 2005 2nd International conference on electrical and electronics engineering, 2005, pp 374–377
Choi SW, Lee IB (2005) Multiblock PLS-based localized process diagnosis. J Process Contr 15:295–306
Ding SX, Yin S, Peng KX, Hao HY, Shen B (2013) A novel scheme for key performance indicator prediction and diagnosis with application to an industrial hot strip mill. IEEE Trans Ind Inform 9:2239–2247
Shen Y, Wei Z, Gao H, Peng K (2012) Data-driven quality related prediction and monitoring. Conference of the IEEE Industrial Electronics Society 2012, pp 3874–3879
Peng K, Zhang K, You B, Dong JJCT, Iet A (2015) Quality-relevant fault monitoring based on efficient projection to latent structures with application to hot strip mill process 9:1135–1145
He QP, Wang J (2010) Large-scale semiconductor process fault detection using a fast pattern recognition-based method. IEEE Trans Semicond Manuf 23:194–200
Guo XP, Jie Y, Yuan L (2013) KPCS-kNN based fault detection for batch processes. In: International conference on machine learning and cybernetics (ICMLC), pp 698–703
Li Y, Zhang XM (2014) Diffusion maps based k-nearest-neighbor rule technique for semiconductor manufacturing process fault detection. Chemometr Intell Lab 136:47–57
Zhang C, Gao XW, Li Y, Feng LW (2019) Fault detection strategy based on weighted distance of k nearest neighbors for semiconductor manufacturing processes. IEEE Trans Semiconduct Manuf 32:75–81
Chen Y, Du R (1998) An improved artificial neural network method for monitoring and diagnosis of engineering processes with applications. J Vib Control 4:635–650
Iliyas SA, Elshafei M, Habib MA, Adeniran AA (2013) RBF neural network inferential sensor for process emission monitoring. Control Eng Pract 21:962–970
Yu JB, Xi LF, Zhou XJ (2009) Identifying source(s) of out-of-control signals in multivariate manufacturing processes using selective neural network ensemble. Eng Appl Artif Intel 22:141–152
Yu JB, Xi LF (2007) A Neural Network ensemble for classifying source(s) in multivariate manufacturing processes. In: IEEE international conference on industrial engineering and engineering management, pp 1246–1250
Maleki MR, Sahraeian R (2015) Online monitoring and fault diagnosis of multivariate-attribute process mean using neural networks and discriminant analysis technique. Int J Eng 28:1634–1643
Liu X, Kang L, Li S, Fei M (2012) Input selection for dynamic RBF models in process monitoring. In: Proceedings of the 10th world congress on intelligent control and automation, pp 3037–3042
Bo C, Li J, Lu A, Zhuang G (2007) Nonlinear process monitors method based on kernel function and PNN. Chinese control conference, pp 511–515
Wu SX (2012) Simultaneous process mean and variance monitoring using wavelet transform and probabilistic neural network. Appl Mech Mater 157–158:11–15
Simon L, Karim MN (2001) Probabilistic neural networks using Bayesian decision strategies and a modified Gompertz model for growth phase classification in the batch culture of Bacillus subtilis. Biochem Eng J 7:41–48
Peng Y, Chen XG, Ye QX, Jiao JB (2014) Fault detection and classification in chemical processes using NMFSC and structural SVMs. Can J Chem Eng 92:1016–1023
Yin Z, Hou J (2016) Recent advances on SVM based fault diagnosis and process monitoring in complicated industrial processes. Neurocomputing 174:643–650
Onel M, Kieslich CA, Guzman YA, Floudas CA, Pistikopoulos EN (2018) Big data approach to batch process monitoring: simultaneous fault detection and diagnosis using nonlinear support vector machine-based feature selection(Reprinted from Computers and Chemical Engineering, vol 115, pg 46–63. Comput Chem Eng 116(2018):503–520
Yu J (2011) Localized fisher discriminant analysis based complex chemical process monitoring. Aiche J 57:1817–1828
Yu J (2011) Nonlinear bioprocess monitoring using multiway kernel localized Fisher discriminant analysis. Ind Eng Chem Res 50:3390–3402
Zhao Z, Zhang J, Sun YG, Tian HX (2016) Fault detection and diagnosis method for batch process based on ELM-based fault feature phase identification. Neural Comput Appl 27:167–173
Nor NM, Hussain MA, Hassan CRC (2017) Fault diagnosis and classification framework using multiscale classification based on kernel fisher discriminant analysis for chemical process system. Appl Soft Comput 61:959–972
Tang Q, Chai Y, Qu JF, Fang XY (2019) Industrial process monitoring based on Fisher discriminant global-local preserving projection. J Process Contr 81:76–86
Yang XH, Rui SH, Zhang XL, Xu SP, Yang CS, Liu PX (2019) Fault diagnosis in chemical processes based on class-incremental FDA and PCA. IEEE Access 7:18164–18171
Nor NM, Hussain MA, Hassan CRC (2020) Multi-scale kernel Fisher discriminant analysis with adaptive neuro-fuzzy inference system (ANFIS) in fault detection and diagnosis framework for chemical process systems. Neural Comput Appl 32:9283–9297
Ren SJ, Song ZH, Yang MY, Ren JG (2015) A novel multimode process monitoring method integrating LCGMM with modified LFDA. Chin J Chem Eng 23:1970–1980
Nomikos P, Macgregor JF (1994) Monitoring batch processes using multiway principal component analysis. Aiche J 40:1361–1375
Dong D, McAvoy TJ (1996) Batch tracking via nonlinear principal component analysis. Aiche J 42:2199–2208
Macgregor JF, Kourti T (1995) Statistical process-control of multivariate processes. Control Eng Pract 3:403–414
Dunia R, Qin SJ (1998) Joint diagnosis of process and sensor faults using principal component analysis. Control Eng Pract 6:457–469
Raich A, Cinar A (1996) Statistical process monitoring and disturbance diagnosis in multivariable continuous processes. Aiche J 42:995–1009
Mujica LE, Vehi J, Ruiz M, Verleysen M, Staszewski W, Worden K (2008) Multivariate statistics process control for dimensionality reduction in structural assessment. Mech Syst Signal Pr 22:155–171
Ivosev G, Burton L, Bonner R (2008) Dimensionality reduction and visualization in principal component analysis. Anal Chem 80:4933–4944
Dunia R, Edgar TF, Nixon M (2013) Process monitoring using principal components in parallel coordinates. Aiche J 59:445–456
Wang RC, Edgar TF, Baldea M, Nixon M, Wojsznis W, Dunia R (2015) Process fault detection using time-explicit Kiviat diagrams. Aiche J 61:4277–4293
Jiang QC, Yan XF (2019) Quality-driven kernel projection to latent structure model for nonlinear process monitoring. IEEE Access 7:74450–74458
Li Z, Yan Z, Jiang L (2009) Fault detection and diagnosis based on KPCA-LSSVM Model. Int Conf Measur Technol Mechat Autom 2009:634–638
Xu J, Hu S, Shen Z (2010) Fault detection and diagnosis of chemical process based on an improved multi-scale KPCA. Chin J Sci Instrum 31:51–55
Lee JM, Qin SJ, Lee IB (2006) Fault detection and diagnosis based on modified independent component analysis. Aiche J 52:3501–3514
Zhang YW, Zhang Y (2010) Fault detection of non-Gaussian processes based on modified independent component analysis. Chem Eng Sci 65:4630–4639
Hsu CC, Chen MC, Chen LS (2010) Integrating independent component analysis and support vector machine for multivariate process monitoring. Comput Ind Eng 59:145–156
Zhang X, Wang X, Fan Y, Wu J (2014) Fault diagnosis of industrial process based on KICA and LSSVM. In: The 26th Chinese control and decision conference, pp 3802–3807
Li S, Zhou XF, Pan FC, Shi HB, Li KT, Wang ZW (2017) Correlated and weakly correlated fault detection based on variable division and ICA. Comput Ind Eng 112:320–335
Wang B, Yan XF, Jiang QC (2016) Independent component analysis model utilizing de-mixing information for improved non-Gaussian process monitoring. Comput Ind Eng 94:188–200
Yu JB (2011) Fault detection using principal components-based gaussian mixture model for semiconductor manufacturing processes. IEEE Trans Semicond Manuf 24:432–444
Yu JB (2012) Semiconductor manufacturing process monitoring using Gaussian Mixture model and Bayesian method with local and nonlocal information. Ieee T Semiconduct M 25:480–493
Yu JB (2011) Pattern recognition of manufacturing process signals using Gaussian mixture models-based recognition systems. Comput Ind Eng 61:881–890
Jie Y (2012) A nonlinear kernel Gaussian mixture model based inferential monitoring approach for fault detection and diagnosis of chemical processes. Chem Eng Sci 68:506–519
Peng P, Zhao J, Zhang Y, Zhang H (2019) Hidden Markov model combined with kernel principal component analysis for nonlinear multimode process fault detection. In: 2019 IEEE 15th International conference on automation science and engineering (CASE), pp 1586–1591
Ge ZQ, Xie L, Kruger U, Lamont L, Song ZH, Wang SQ (2009) Sensor fault identification and isolation for multivariate non-Gaussian processes. J Process Contr 19:1707–1715
Yao M, Wang HG, Xu WL (2014) Batch process monitoring based on functional data analysis and support vector data description. J Process Contr 24:1085–1097
Chen MC, Hsu CC, Malhotra B, Tiwari MK (2016) An efficient ICA-DW-SVDD fault detection and diagnosis method for non-Gaussian processes. Int J Prod Res 54:5208–5218
Lv ZM, Yan XF, Jiang QC (2014) Batch process monitoring based on just-in-time learning and multiple-subspace principal component analysis. Chemometr Intell Lab 137:128–139
Zhou J, Guo AH, Celler B, Su S (2014) Fault detection and identification spanning multiple processes by integrating PCA with neural network. Appl Soft Comput 14:4–11
Yu JB, Xi LF (2008) Using an MQE chart based on a self-organizing map NN to monitor out-of-control signals in manufacturing processes. Int J Prod Res 46:5907–5933
Corona F, Mulas M, Baratti R, Romagnoli JA (2010) On the topological modeling and analysis of industrial process data using the SOM. Comput Chem Eng 34:2022–2032
Yu HY, Khan F, Garaniya V, Ahmad A (2014) Self-organizing map based fault diagnosis technique for non-Gaussian processes. Ind Eng Chem Res 53:8831–8843
Song Y, Jiang QC, Yan XF, Guo MJ (2014) A multi-SOM with canonical variate analysis for chemical process monitoring and fault diagnosis. J Chem Eng Jpn 47:40–51
Chen XY, Yan XF (2012) Using improved self-organizing map for fault diagnosis in chemical industry process. Chem Eng Res Des 90:2262–2277
Bolon-Canedo V, Sanchez-Marono N, Alonso-Betanzos A (2013) A review of feature selection methods on synthetic data. Knowl Inf Syst 34:483–519
Geladi P, Kowalski BR (1986) Partial least-squares regression—a tutorial. Anal Chim Acta 185:1–17
Höskuldsson A (1988) PLS regression methods. J Chemometr 2:211–228
Dejong S (1993) Simpls—an alternative approach to partial least-squares regression. Chemometr Intell Lab 18:251–263
Zhou DH, Li G, Qin SJ (2010) Total projection to latent structures for process monitoring. Aiche J 56:168–178
Qin SJ, Zheng YY (2013) Quality-relevant and process-relevant fault monitoring with concurrent projection to latent structures. Aiche J 59:496–504
Das A, Maiti J, Banerjee RN (2010) A hierarchical process monitoring strategy for a serial multi-stage manufacturing system. Int J Prod Res 48:2459–2479
Cover TM, Hart PE (1953) Nearest neighbor pattern classification. IEEE Trans Inf Theory 13:21–27
Ghosh A, Wang GN, Lee J (2020) A novel automata and neural network based fault diagnosis system for PLC controlled manufacturing systems. Comput Ind Eng 139:1
Taqvi SA, Tufa LD, Zabiri H, Maulud AS, Uddin F (2020) Fault detection in distillation column using NARX neural network. Neural Comput Appl 32:3503–3519
Bienkowski M, Gasieniec L, Klonowski M, Korzeniowski M, Mans B, Schmid S, Wattenhofer R (2005) Handbook of neural network signal processing. Ieee T Neural Networ 16:780–780
Meireles MRG, Almeida PEM, Simoes MG (2003) A comprehensive review for industrial applicability of artificial neural networks. Ieee T Ind Electron 50:585–601
Specht DF (1990) Probabilistic neural networks. Neural Netw 3:109–118
Shin HJ, Eom DH, Kim SS (2005) One-class support vector machines - an application in machine fault detection and classification. Comput Ind Eng 48:395–408
Ma MD, Wong DSH, Jang SS, Tseng ST (2010) Fault detection based on statistical multivariate analysis and microarray visualization. IEEE Trans Ind Inform 6:18–24
MacGregor JF, Marlin TE, Kresta J, Skagerberg B (1991) Multivariate statistical methods in process analysis and control. Chemical process control 1:79–100
Qin SJ, Mcavoy TJ (1992) Nonlinear Pls modeling using neural networks. Comput Chem Eng 16:379–391
Chaouch H, Charfedine S, Ouni K, Jerbi H, Nabli L (2019) Intelligent supervision approach based on multilayer neural PCA and nonlinear gain scheduling. Neural Comput Appl 31:1153–1163
Qiang G, Wang G, Hao X (2012) A hybrid fault detection and diagnosis system based on KPCA and DDAG. Adv Intell Soft Comput 125:549–555
Hsu CC, Chen LS, Liu CH (2010) A process monitoring scheme based on independent component analysis and adjusted outliers. Int J Prod Res 48:1727–1743
Cho HW (2009) Data description and noise filtering based detection with its application and performance comparison. Expert Syst Appl 36:434–441
Schmidhuber J (2015) Deep learning in neural networks: An overview. Neural Netw 61:85–117
Abid A, Khan MT, Iqbal J (2021) A review on fault detection and diagnosis techniques: basics and beyond. Artif Intell Rev 54:3639–3664
Issa NT, Byers SW, Dakshanamurthy S (2014) Big data: the next frontier for innovation in therapeutics and healthcare. Expert Rev Clin Phar 7:293–298
Hoyt D (2015) Big data: a revolution that will transform how we live, work, and think. Res Technol Manag 58:66–67
Lavasani MS, Ardali NR, Sotudeh-Gharebagh R, Zarghami R, Abonyi J, Mostoufi N (2021) Big data analytics opportunities for applications in process engineering. Rev Chem Eng 1:1
Shu YD, Ming L, Cheng FF, Zhang ZP, Zhao JS (2016) Abnormal situation management: challenges and opportunities in the big data era. Comput Chem Eng 91:104–113
Yao L, Ge ZQ (2021) Industrial big data modeling and monitoring framework for plant-wide processes. IEEE T Ind Inform 17:6399–6408
Jiang QC, Yan SF, Cheng H, Yan XF (2021) Local-global modeling and distributed computing framework for nonlinear plant-wide process monitoring with industrial big data. IEEE Trans Neur Net Lear 32:3355–3365
Guo JY, Wang X, Li Y (2019) Fault detection based on improved local entropy locality preserving projections in multimodal processes. J Chemometr 33:1–18
Geng ZQ, Duan XY, Han YM, Liu FF, Xu W (2021) Novel variation mode decomposition integrated adaptive sparse principal component analysis and it application in fault diagnosis. ISA Trans 1:1–11
Alrifaey M, Lim WH, Ang CK, Natarajan E, Solihin MI, Juhari MRM, Tiang SS (2022) Hybrid deep learning model for fault detection and classification of grid-connected photovoltaic system. IEEE Access 10:13852–13869
Xu S, Lu B, Baldea M, Edgar TF, Wojsznis W, Blevins T, Nixon M (2015) Data cleaning in the process industries. Rev Chem Eng 31:453–490
Allison PD (2012) Handling missing data by maximum likelihood. SAS Glob Forum Stat Data Anal 1:1–21
Ding XO, Wang HZ, Su JX, Li ZJ, Li JZ, Gao H (2019) Cleanits: a data cleaning system for industrial time series. Proc Vldb Endow 12:1786–1789
Wang X, Wang C (2020) Time series data cleaning: a survey. IEEE Access 8:1866–1881
Rumelhart DE, Hinton GE, Williams RJ (1986) Learning representations by back-propagating errors. Nature 323:533–536
Chadha GS, Schwung A (2017) Comparison of deep neural network architectures for fault detection in tennessee eastman process. In: IEEE international conference on emerging technologies & factory automation, 2017, pp 1–8
Yan SF, Yan XF (2019) Design teacher and supervised dual stacked auto-encoders for quality-relevant fault detection in industrial process. Appl Soft Comput 81:1
Yu JB, Zheng XY, Wang SJ (2019) A deep autoencoder feature learning method for process pattern recognition. J Process Contr 79:1–15
Yu JB, Zheng XY, Wang SJ (2019) Stacked denoising autoencoder-based feature learning for out-of-control source recognition in multivariate manufacturing process. Qual Reliab Eng Int 35:204–223
Zhang CY, Yu JB, Wang SJ (2021) Fault detection and recognition of multivariate process based on feature learning of one-dimensional convolutional neural network and stacked denoised autoencoder. Int J Prod Res 59:2426–2449
Li ZC, Tian L, Jiang QC, Yan XF (2021) Distributed-ensemble stacked autoencoder model for nonlinear process monitoring. Inform Sciences 542:302–316
Liu X, Yu J, Ye L (2021) Residual attention convolutional autoencoder for feature learning and fault detection in nonlinear industrial processes. Neural Comput Appl 33:3085–3104
Yu JB, Liu X (2021) One-dimensional residual convolutional auto-encoder for fault detection in complex industrial processes. Int J Prod Res 1:1–20
Li SP, Luo JX, Hu YM (2022) Toward interpretable process monitoring: slow feature analysis-aided autoencoder for spatiotemporal process feature learning. IEEE Trans Instrum Meas 71:1–11
Yu JB, Zhang CY (2020) Manifold regularized stacked autoencoders-based feature learning for fault detection in industrial processes. J Process Contr 92:119–136
Gu JX, Wang ZH, Kuen J, Ma LY, Shahroudy A, Shuai B, Liu T, Wang XX, Wang G, Cai JF, Chen T (2018) Recent advances in convolutional neural networks. Pattern Recogn 77:354–377
Zhang HL, Wang P, Gao XJ, Qi YS, Gao HH (2019) Amplitude-frequency images-based ConvNet: applications of fault detection and diagnosis in chemical processes. J Chemometr 33:1–18
Kim E, Cho S, Lee B, Cho M (2019) Fault detection and diagnosis using self-attentive convolutional neural networks for variable-length sensor data in semiconductor manufacturing. IEEE Trans Semiconduct Manuf 32:302–309
Chen S, Yu J (2020) Convolution neural network multivariable process feature learning and fault diagnosis. J Harb Inst Technol 52:1
Lee KB, Cheon S, Kim CO (2017) A convolutional neural network for fault classification and diagnosis in semiconductor manufacturing processes. IEEE Trans Semicond Manuf 30:135–142
Wu H, Zhao JS (2018) Deep convolutional neural network model based chemical process fault diagnosis. Comput Chem Eng 115:185–197
Chen S, Yu J, Wang S (2020) One-dimensional convolutional auto-encoder-based feature learning for fault diagnosis of multivariate processes. J Process Contr 87:54–67
Zheng X, Yu J (2019) Multivariate process monitoring and fault identification using convolutional neural networks. In: 24th International conference on industrial engineering and engineering management, proceeding of the 24th international conference on industrial engineering and engineering management 2018, 2019, pp 197–208
Yu J, Liu X (2020) A fault detection method based on convolutional gated recurrent unit auto-encoder for tennessee eastman process. Chin Autom Cong (CAC) 2020:1234–1238
Hsu CY, Liu WC (2021) Multiple time-series convolutional neural network for fault detection and diagnosis and empirical study in semiconductor manufacturing. J Intell Manuf 32:823–836
Yu WK, Zhao CH (2020) Broad convolutional neural network based industrial process fault diagnosis with incremental learning capability. IEEE Trans Ind Electron 67:5081–5091
Yu JB, Zhang CY, Wang SJ (2021) Multichannel one-dimensional convolutional neural network-based feature learning for fault diagnosis of industrial processes. Neural Comput Appl 33:3085–3104
Bengio Y, Simard P, Frasconi P (1994) Learning long-term dependencies with gradient descent is difficult. IEEE Trans Neural Networ 5:157–166
Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9:1735–1780
Chadha GS, Panambilly A, Schwung A, Ding SX (2020) Bidirectional deep recurrent neural networks for process fault classification. Isa T 106:330–342
Cheng FF, He EE, Zhao JS (2019) A novel process monitoring approach based on variational recurrent autoencoder. Comput Chem Eng 129:1–14
Ouyang H, Zeng JS, Li YF, Luo SH (2020) Fault Detection and Identification of Blast Furnace Ironmaking Process Using the Gated Recurrent Unit Network. Processes 8:1–15
Wang Q, Luo L (2021) Sequential fault detection and classification in chemical process using a deep convolutional encoder–decoder architecture based on system dynamics. IOP Conf Ser Earth Environ Sci 696:1–7
Chen SM, Yu JB (2019) Deep recurrent neural network-based residual control chart for autocorrelated processes. Qual Reliab Eng Int 35:2687–2708
Zhang SY, Bi KX, Qiu T (2020) Bidirectional recurrent neural network-based chemical process fault diagnosis. Ind Eng Chem Res 59:824–834
Liu F, Wang P, Cai Z, Zhou Z, Yang Z (2019) Batch process fault diagnosis based on the combination of deep belief network and long short-term memory network. In: 2019 CAA symposium on fault detection, supervision and safety for technical processes (SAFEPROCESS), pp 208-214
Yu J, Liu X, Ye L (2020) Convolutional long short-term memory autoencoder-based feature learning for fault detection in industrial processes. IEEE Trans Instrum Measur 70:3505615
Hinton GE (2002) Training products of experts by minimizing contrastive divergence. Neural Comput 14:1771–1800
Zhang ZP, Zhao JS (2017) A deep belief network based fault diagnosis model for complex chemical processes. Comput Chem Eng 107:395–407
Peng T, Peng K, Kai Z, Chen Z, Yang X, Li L (2018) A deep belief network-based fault detection method for nonlinear processes. IFAC-PapersOnLine 51:9–14
Kim JK, Lee JS, Han YS (2019) Fault detection prediction using a deep belief network-based multi-classifier in the semiconductor manufacturing process. Int J Softw Eng Know 29:1125–1139
Yu JB, Yan XF (2019) Active features extracted by deep belief network for process monitoring. Isa T 84:247–261
Yu JB, Yan XF (2020) Whole process monitoring based on unstable neuron output information in hidden layers of deep belief network. IEEE Trans Cybern 50:3998–4007
Wang YL, Pan ZF, Yuan XF, Yang CH, Gui WH (2020) A novel deep learning based fault diagnosis approach for chemical process with extended deep belief network. ISA Trans 96:457–467
Yu JB, Yan XF (2020) Modeling large-scale industrial processes by multiple deep belief networks with lower-pressure and higher-precision for status monitoring. IEEE Access 8:20439–20448
Zhang LW, Lin J, Liu B, Zhang ZC, Yan XH, Wei MH (2019) A Review on deep learning applications in prognostics and health management. IEEE Access 7:162415–162438
Zhu JL, Yao Y, Gao FR (2018) Transfer of qualitative and quantitative knowledge for similar batch process monitoring. Ieee Access 6:73856–73870
Wu H, Zhao JS (2020) Fault detection and diagnosis based on transfer learning for multimode chemical processes. Comput Chem Eng 135:1–13
Chai Z, Zhao CH, Huang B (2021) Multisource-refined transfer network for industrial fault diagnosis under domain and category inconsistencies. IEEE Trans Cybern 1–13
Gao X, Deng F, Yue XH (2020) Data augmentation in fault diagnosis based on the Wasserstein generative adversarial network with gradient penalty. Neurocomputing 396:487–494
Yang X, Feng D (2019) Generative adversarial network based anomaly detection on the benchmark tennessee eastman process. In: 2019 5th International conference on control, automation and robotics (ICCAR), pp 644–648
Huang YF, Chen X, Xu L, Li KY (2021) Single image desmoking via attentive generative adversarial network for smoke detection process. Fire Technol 57:3021–3040
Yan K (2021) Chiller fault detection and diagnosis with anomaly detective generative adversarial network. Build Environ 201:1–9
Feng L, Zhao C, Li YL, Zhou M, Fu C (2020) Multichannel diffusion graph convolutional network for the prediction of end-point composition in the converter steelmaking process. IEEE Trans Instrum Measur 1:1
Zhao MH, Zhong SS, Fu XY, Tang BP, Pecht M (2020) Deep Residual Shrinkage Networks for Fault Diagnosis, Ieee T Ind. Inform 16:4681–4690
Li S, Li W, Cook C, Zhu C, Gao Y (2018) Independently recurrent neural network (IndRNN): building a longer and deeper rnN. IEEE/CVF Conference on Computer Vision and Pattern Recognition 2018:5457–5467
Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L (2017) Attention is All You Need. Comput Lang 1:1–15
Xu GW, Liu M, Jiang ZF, Shen WM, Huang CX (2020) Online Fault Diagnosis Method Based on Transfer Convolutional Neural Networks. Ieee T Instrum Meas 69:509–520
Wang ZJ, Zheng LK, Du WH, Cai WN, Zhou J, Wang JT, Han XF, He GF (2019) A novel method for intelligent fault diagnosis of bearing based on capsule neural network. Complexity 2019:1–17
Chen TY, Wang ZH, Yang X, Jiang K (2019) A deep capsule neural network with stochastic delta rule for bearing fault diagnosis on raw vibration signals. Measurement 148:1–15
Chen LL, Qin N, Dai X, Huang DQ (2020) Fault diagnosis of high-speed train bogie based on capsule network. IEEE Trans Instrum Meas 69:6203–6211
Kipf TN, Welling M (2017) Semi-supervised classification with graph convolutional networks. In: International conference on learning representations, pp 1–14
Henaff M, Bruna J, Lecun Y (2015) Deep convolutional networks on graph-structured data. Comput Sci 1–10
Damianou AC, Lawrence ND (2012) Deep Gaussian processes. Comput Sci 207–215
Havasi M, Hernández-Lobato J, Murillo-Fuentes JJ (2018) Inference in deep Gaussian processes using stochastic gradient hamiltonian Monte Carlo. arXiv e-prints 7517–7527
Santiago TC, Melissa DL, Oscar P, Fabio GA (2020) Hybrid deep learning gaussian process for diabetic retinopathy diagnosis and uncertainty quantification. Ophthalmic Med Image Anal 12069:206–215
Tagade P, Hariharan KS, Ramachandran S, Khandelwal A, Naha A, Kolake SM, Han SH (2020) Deep Gaussian process regression for lithium-ion battery health prognosis and degradation mode diagnosis. J Power Sources 445:1–14
Viroli C, McLachlan GJ (2019) Deep Gaussian mixture models. Stat Comput 29:43–51
Purohit H, Tanabe R, Endo T, Suefusa K, Nikaido Y, Kawaguchi Y (2020) Deep autoencoding GMM-based unsupervised anomaly detection in acoustic signals and its hyper-parameter optimization. arXiv e-prints arXiv:1806.01551.
Ji R, Lin S, Chao F, Wu Y, Huang F (2018) Deep neural network compression and acceleration: a review. J Comput Res Dev 55:1871–1888
Deng XG, Tian XM, Chen S, Harris CJ (2017) Deep learning based nonlinear principal component analysis for industrial process fault detection. IEEE Int Jt Conf Neural Netw (IJCNN) 1237–1243
Deng XG, Zhang Z (2020) Nonlinear chemical process fault diagnosis using ensemble deep support vector data description. Sensors 20:1–19
He K, Zhang X, Ren S, Sun J (2015) Delving deep into rectifiers: surpassing human-level performance on ImageNet classification. In: Proceedings of the international conference on computer vision, pp 1026–1034
Ioffe S, Szegedy C (2015) Batch normalization: accelerating deep network training by reducing internal covariate shift. arXiv e-prints (2015) arXiv:1502.03167v03163.
Sun C, Ma M, Zhao ZB, Tian SH, Yan RD, Chen XF (2019) Deep transfer learning based on sparse autoencoder for remaining useful life prediction of tool in manufacturing. IEEE T Ind Inform 15:2416–2425
Yu J, Xi L (2008) Intelligent monitoring and diagnosis of manufacturing process using an integrated approach of neural network ensemble and genetic algorithm. Int J Comput Appl Technol 33:109–119
Yu JB, Xi LF, Zhou XJ (2008) Intelligent monitoring and diagnosis of manufacturing processes using an integrated approach of KBANN and GA. Comput Ind 59:489–501
Liu G, Yu J (2019) Machining roughness prediction based on knowledge-based deep belief network. J Mech Eng 55:94–106
Liu G, Yu J (2020) Application of neural-symbol model based on stacked denoising auto-encoders in wafer map defect recognition. J Autom 1–18
Acknowledgements
This research was supported by National Key Research and Development Program (No. 2022YFF0605702, 2022YFF0605704), the National Natural Science Foundation of China (92167107, 71771173), and Fundamental Research Funds for the Central Universities.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
None declared.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Yu, J., Zhang, Y. Challenges and opportunities of deep learning-based process fault detection and diagnosis: a review. Neural Comput & Applic 35, 211–252 (2023). https://doi.org/10.1007/s00521-022-08017-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00521-022-08017-3