Skip to main content
SpringerLink
Log in

Root cause analysis of an out-of-control process using a logical analysis of data regression model and exponential weighted moving average

  • Published:
Journal of Intelligent Manufacturing Aims and scope Submit manuscript

Abstract

Control charts are widely used as a tool in process quality monitoring to detect anomalies and to improve the quality of a process and product. Nevertheless, their limitations have increased in the face of increasingly complex manufacturing processes. They do not have capability of handling large streams of non-normal and autocorrelated multivariate data, which is in most real applications. This may lead to an increase in false alarm signals and/or missed detection of anomalies. They are not designed to automatically identify the root causes of an anomaly when the process is out-of-control. Several machine-learning techniques were integrated with control charts to improve the sensitivity and specificity of anomaly detection. Nevertheless, some existing techniques still produce a high false alarm rate and/or missed detection. The root cause analysis is seldom performed. In this paper, we propose a new integration that combines the logical analysis of data regression technique (LADR) and the exponential weighted moving average (EWMA) as a new model-based control chart. LADR is based on the traditional LAD methodology, which is a supervised data mining technique for pattern generation. LADR transforms the original independent variables into pattern variables by using cbmLAD software to develop a regression model. The LADR–EWMA increases the sensitivity of anomaly detection in the process and uses the patterns to perform root cause analysis of that anomaly. We applied LADR–EWMA to a real application: a concrete manufacturing process. We compared its performance with Linear regression, Support vector regression, Partial Least Square regression, and Multivariate adaptive regression Spline. The results demonstrate that the LADR–EWMA, which is based on pattern recognition, performs better compared to the other techniques in terms of a reduction of false alarms and missed detection. In addition, LADR–EWMA facilitates interpretation and identification of the root cause of the detected anomaly.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  • Ahsan, M., Mashuri, M., Kuswanto, H., Prastyo, D. D., et al. (2018). Intrusion detection system using multivariate control chart hotelling’s T2 based on PCA. International Journal on Advanced Science, Engineering and Information Technology, 8(5), 1905–1911.

    Article  Google Scholar 

  • Alcala, C. F., & Qin, S. J. (2009). Reconstruction-based contribution for process monitoring. Automatica, 45(7), 1593–1600.

    Article  MathSciNet  Google Scholar 

  • Atashgar, K., & Noorossana, R. (2011). An integrating approach to root cause analysis of a bivariate mean vector with a linear trend disturbance. The International Journal of Advanced Manufacturing Technology, 52(1), 407–420.

    Article  Google Scholar 

  • Atienza, O. O., Tang, L. C., & Ang, B. W. (1998). Quality notes: Simultaneous monitoring of univariate and multivariate SPC information using boxplots. International Journal of Quality Science, 3(2), 194–204.

    Article  Google Scholar 

  • Bakdi, A., & Kouadri, A. (2017). A new adaptive PCA based thresholding scheme for fault detection in complex systems. Chemometrics and Intelligent Laboratory Systems, 162, 83–93.

    Article  CAS  Google Scholar 

  • Bhamare, D., & Suryawanshi, P. (2018). Review on reliable pattern recognition with machine learning techniques. Fuzzy Information and Engineering, 10(3), 362–377.

    Article  Google Scholar 

  • Blazek, L. W., Novic, B., & Scott, D. M. (1987). Displaying multivariate data using polyplots. Journal of Quality Technology, 19(2), 69–74.

    Article  Google Scholar 

  • Cheng, C. S., & Cheng, H. P. (2008). Identifying the source of variance shifts in the multivariate process using neural networks and support vector machines. Expert Systems with Applications, 35(1–2), 198–206.

    Article  Google Scholar 

  • Chiarini, A. (2020). Industry 4.0, quality management and TQM world. A systematic literature review and a proposed agenda for further research. The TQM Journal, 32(4), 603–616.

    Article  Google Scholar 

  • Chua, M., & Montgomery, D. C. (1992). Investigation and characterization of a control scheme for multivariate quality control. Quality and Reliability Engineering International, 8(1), 37–44.

    Article  Google Scholar 

  • Connell, S. (2017). As industry 4.0 continues to evolve, what can quality professionals do to ensure they will be an integral asset throughout this industrial revolution? Quality in Mind.

  • Cuentas, S., Peñabaena-Niebles, R., & Garcia, E. (2017). Support vector machine in statistical process monitoring: A methodological and analytical review. The International Journal of Advanced Manufacturing Technology, 91(1), 485–500.

    Article  Google Scholar 

  • Diren, D. D., Boran, S., Selvi, I. H., & Hatipoglu, T. (2019). Root cause detection with an ensemble machine learning approach in the multivariate manufacturing process (pp. 163–174). Springer.

  • Dou, Y., & Sa, P. (2002). One-sided control charts for the mean of positively skewed distributions. Total Quality Management, 13(7), 1021–1033.

    Article  Google Scholar 

  • Du, S., Lv, J., & Xi, L. (2012). On-line classifying process mean shifts in multivariate control charts based on multiclass support vector machines. International Journal of Production Research, 50(22), 6288–6310.

    Article  Google Scholar 

  • Dua, D., & Graff, C. (2019). UCI machine learning repository. University of California, Irvine, School of Information and Computer Sciences. http://archive.ics.uci.edu/ml

  • Escobar, C. A., McGovern, M. E., & Morales-Menendez, R. (2021). Quality 4.0: A review of big data challenges in manufacturing. Journal of Intelligent Manufacturing, 32, 2319–2334.

    Article  Google Scholar 

  • Farokhnia, M., & Niaki, S. T. A. (2020). Principal component analysis-based control charts using support vector machines for multivariate non-normal distributions. Communications in Statistics-Simulation and Computation, 49(17), 1815–1838.

    Article  MathSciNet  Google Scholar 

  • Friedman, J. H. (1991). Multivariate adaptive regression splines. The Annals of Statistics, 19, 1–67.

    MathSciNet  Google Scholar 

  • Fuchs, C., & Benjamini, Y. (1994). Multivariate profile charts for statistical process control. Technometrics, 36(2), 182–195.

    Article  Google Scholar 

  • Gani, W., Taleb, H., & Limam, M. (2010). Support vector regression based residual control charts. Journal of Applied Statistics, 37(2), 309–324.

    Article  MathSciNet  Google Scholar 

  • Guh, R. S., & Shiue, Y. R. (2008). An effective application of decision tree learning for on-line detection of mean shifts in multivariate control charts. Computers & Industrial Engineering, 55(2), 475–493.

    Article  Google Scholar 

  • Haq, A., Gulzar, R., & Khoo, M. B. C. (2018). An efficient adaptive EWMA control chart for monitoring the process mean. Quality and Reliability Engineering International, 34(4), 563–571.

    Article  Google Scholar 

  • Harrou, F., Nounou, M. N., Nounou, H. N., & Madakyaru, M. (2015). PLS-based EWMA fault detection strategy for process monitoring. Journal of Loss Prevention in the Process Industries, 36, 108–119.

    Article  Google Scholar 

  • Hawkins, D. M. (1991). Multivariate quality control based on regression-adjusted variables. Technometrics, 33(1), 61–75.

    Google Scholar 

  • He, Q. P., & Wang, J. (2007). Fault detection using the k-nearest neighbor rule for semiconductor manufacturing processes. IEEE Transactions on Semiconductor Manufacturing, 20(4), 345–354.

    Article  Google Scholar 

  • He, S., Wang, G. A., Zhang, M., & Cook, D. F. (2013). Multivariate process monitoring and fault identification using multiple decision tree classifiers. International Journal of Production Research, 51(11), 3355–3371.

    Article  Google Scholar 

  • Jacob, D. (2017). Quality 4.0 impact and strategy handbook: Getting digitally connected to transform quality management. LNS Research.

  • Jian, Z., Xia, B., Wang, C., & Li, Z. (2018). Diagnosis of out-of-control signals in multivariate manufacturing processes with random forests. In International workshop of advanced manufacturing and automation (pp. 262–267). Springer.

  • Jiang, W., Wang, K., & Tsung, F. (2012). A variable-selection-based multivariate EWMA chart for process monitoring and diagnosis. Journal of Quality Technology, 44(3), 209–230.

    Article  Google Scholar 

  • Khalifa, R.M., Yacout, S., & Bassetto, S. (2021a). Quality 4.0: Entity relationship model for inspection and repair processes in aerospace domain. In Proceedings of the international conference on industrial engineering and operations management, Monterrey, Mexico (November 3–5)

  • Khalifa, R. M., Yacout, S., & Bassetto, S. (2021b). Developing machine-learning regression model with logical analysis of data (LAD). Computers & Industrial Engineering, 151, 106947.

  • Kharbach, M., Cherrah, Y., Vander Heyden, Y., & Bouklouze, A. (2017). Multivariate statistical process control in product quality review assessment—A case study. Annales Pharmaceutiques Françaises, 75(6), 446–454.

  • Kim, J., Jeong, M. K., Elsayed, E. A., Al-Khalifa, K. N., & Hamouda, A. M. S. (2016). An adaptive step-down procedure for fault variable identification. International Journal of Production Research, 54(11), 3187–3200.

    Article  Google Scholar 

  • Kim, S. B., Jitpitaklert, W., Chen, V. C., Lee, J., & Park, S. K. (2013). Data mining model adjustment control charts for cascade processes. European Journal of Industrial Engineering, 7(4), 442–455.

    Article  Google Scholar 

  • Kim, S. B., Jitpitaklert, W., Park, S., & Hwang, S. J. (2012a). Data mining model-based control charts for multivariate and autocorrelated processes. Expert Systems with Applications, 39(2), 2073–2081.

  • Kim, S. B., Jitpitaklert, W., Park, S. K., & Hwang, S. J. (2012b). Data mining model-based control charts for multivariate and autocorrelated processes. Expert Systems with Applications, 39(2), 2073–2081.

  • Kuang, T. H., Yan, Z., & Yao, Y. (2015). Multivariate fault isolation via variable selection in discriminant analysis. Journal of Process Control, 35, 30–40.

    Article  CAS  Google Scholar 

  • Lucas, J. M., & Saccucci, M. S. (1990). Exponentially weighted moving average control schemes: Properties and enhancements. Technometrics, 32(1), 1–12.

    Article  MathSciNet  Google Scholar 

  • Mandel, B. J. (1969). The regression control chart. Journal of Quality Technology, 1(1), 1–9.

    Article  Google Scholar 

  • Mason, R. L., Tracy, N. D., & Young, J. C. (1995). Decomposition of T2 for multivariate control chart interpretation. Journal of Quality Technology, 27(2), 99–108.

    Article  Google Scholar 

  • Mehta, P. K., & Monteiro, P. J. M. (2014). Concrete: Microstructure, properties, and materials. McGraw-Hill Education.

    Google Scholar 

  • Mittal, M., Goyal, L. M., Hemanth, D. J., & Sethi, J. K. (2019). Clustering approaches for high-dimensional databases: A review. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, 9(3), 1300.

    Google Scholar 

  • Montgomery, D. C. (Ed.). (2020). Introduction to statistical quality control. Wiley.

    Google Scholar 

  • Mortada, M. A., Yacout, S., & Lakis, A. (2014). Fault diagnosis in power transformers using multi-class logical analysis of data. Journal of Intelligent Manufacturing, 25(6), 1429–1439.

    Article  Google Scholar 

  • Murphy, B. J. (1987). Selecting out of control variables with the T2 multivariate quality control procedure. Journal of the Royal Statistical Society: Series D, 36(5), 571–581.

  • Niaki, S. T. A., & Abbasi, B. (2005). Fault diagnosis in multivariate control charts using artificial neural networks. Quality and Reliability Engineering International, 21(8), 825–840.

    Article  Google Scholar 

  • Pham, H. (2006). Springer handbook of engineering statistics. Springer.

    Book  Google Scholar 

  • Prabhu, S. S., & Runger, G. C. (1997). Designing a multivariate EWMA control chart. Journal of Quality Technology, 29(1), 8–15.

    Article  Google Scholar 

  • Qin, S. J. (2012). Survey on data-driven industrial process monitoring and diagnosis. Annual Reviews in Control, 36(2), 220–234.

    Article  Google Scholar 

  • Ragab, A., Yacout, S., & Ouali, M.S. (2015). Interpretable pattern-based machine learning for condition based maintenance. In Conference RAMS 2015, Florida, USA.

  • RStudio Team. (2020). RStudio: Integrated Development Environment for R, Inc. http://www.rstudio.com/

  • Ryoo, H. S., & Jang, I.-Y. (2009). MILP approach to pattern generation in logical analysis of data. Discrete Applied Mathematics, 157(4), 749–761.

    Article  MathSciNet  Google Scholar 

  • Salehi, M., Bahreininejad, A., & Nakhai, I. (2011). On-line analysis of out-of-control signals in multivariate manufacturing processes using a hybrid learning-based model. Neurocomputing, 74(12–13), 2083–2095.

    Article  Google Scholar 

  • Steiner, S. H. (1999). EWMA control charts with time-varying control limits and fast initial response. Journal of Quality Technology, 31(1), 75–86.

    Article  Google Scholar 

  • Subramanyam, N., & Houshmand, A. A. (1995). Simultaneous representation of multivariate and corresponding univariate \(\bar{X}\) charts using line-graph. Quality Engineering, 7(4), 681–692.

    Article  Google Scholar 

  • Torgo, L., & Gama, J. (1997). Regression using classification algorithms. Intelligent Data Analysis, 1(4), 275–292.

    Article  Google Scholar 

  • Yacout, S., Salamanca, D., & Mortada, M.A. (2017). Tool and method for fault detection of devices by condition based maintenance. Google Patents. US Patent 9824060.

  • Yan, Z., & Yao, Y. (2015). Variable selection method for fault isolation using least absolute shrinkage and selection operator (lasso). Chemometrics and Intelligent Laboratory Systems, 146, 136–146.

    Article  CAS  Google Scholar 

  • Yeh, I. C. (2007). Modeling slump flow of concrete using second-order regressions and artificial neural networks. Cement and Concrete Composites, 29(6), 474–480.

    Article  CAS  Google Scholar 

  • Zhao, Y., Wang, S., & Xiao, F. (2013). A statistical fault detection and diagnosis method for centrifugal chillers based on exponentially-weighted moving average control charts and support vector regression. Applied Thermal Engineering, 51(1–2), 560–572.

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported by the Natural Sciences and Engineering Research Council of Canada (NSERC) [Grant Numbers RGPIN-2017- 05785].

Author information

Authors and Affiliations

  1. Department of Mathematics and Industrial Engineering, École Polytechnique de Montréal, Montréal, QC, H3T 1J4, Canada

    Ramy M. Khalifa, Soumaya Yacout & Samuel Bassetto

  2. Department of Mechanical Design Engineering, Faculty of Engineering, Helwan University, Cairo, Egypt

    Ramy M. Khalifa

Authors
  1. Ramy M. Khalifa
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Soumaya Yacout
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Samuel Bassetto
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ramy M. Khalifa.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Khalifa, R.M., Yacout, S. & Bassetto, S. Root cause analysis of an out-of-control process using a logical analysis of data regression model and exponential weighted moving average. J Intell Manuf 35, 1321–1336 (2024). https://doi.org/10.1007/s10845-023-02118-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10845-023-02118-z

Keywords

Search

Navigation