Skip to main content
SpringerLink
Log in

Autoregressive coefficient-invariant control chart pattern recognition in autocorrelated manufacturing processes using neural network ensemble

  • Published:
Journal of Intelligent Manufacturing Aims and scope Submit manuscript

Abstract

Pattern recognition is an important issue in statistical process control because unnatural control chart patterns (CCPs) exhibited on control charts can be associated with specific causes that adversely affect the manufacturing process. In recent years, many machine learning techniques [e.g., artificial neural networks (ANNs) and support vector machine (SVM)] have been successfully used to the CCP recognition (CCPR) in autocorrelated manufacturing processes. However, these existing researches can only detect and classify unnatural CCPs but do not provide more detailed process information, for example the autocorrelation level, which would be very useful for quality practitioners to search the assignable causes that give rise to the out-of-control situation. This study proposes a neural network ensemble-enabled autoregressive coefficient-invariant CCPR model for on-line recognition of seven typical types of unnatural CCP, assuming that the process observations are AR(1) correlated over time with unknown constant autoregressive coefficient. In this model, each individual back propagation network (BPN) is trained to recognize only CCPs with the specific autoregressive coefficient of the underlying process, while the outputs of all these individual BPNs are combined via a learning vector quantization network (LVQN). The experimental results indicate that the proposed CCPR model can not only accurately recognize the specific CCP types but also efficiently identify the autoregressive coefficient of the underlying autocorrelated manufacturing process. Empirical comparisons also show that the proposed CCPR model outperform other existing CCPR approaches in literature. In addition, a demonstrative application is provided to illustrate the utilization of the proposed CCPR model to the CCPR in autocorrelated manufacturing processes.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  • Aparisi, F., Avendaño, G., & Sanz, J. (2006). Techniques to interpret T2 control chart signals. IIE Transactions, 38(8), 647–657

    Google Scholar 

  • Barghash, M. A., & Santarisi, N. S. (2004). Pattern recognition of control charts using artificial neural networks—analyzing the effect of the training parameters. Journal of Intelligent Manufacturing, 15(5), 635–644.

    Article  Google Scholar 

  • Box, G. E. P., Jenkins, G. M., & Reinsel, G. C. (2008). Time series analysis: Forecasting and control (4th ed.). Englewood Cliffs, NJ: Prentice Hall.

    Book  Google Scholar 

  • Cheng, C.-S. (1997). A neural network approach for the analysis of control chart patterns. International Journal of Production Research, 35(3), 667–697.

    Article  MATH  Google Scholar 

  • Cheng, C.-S., & Cheng, H.-P. (2008). Identifying the source of variance shifts in the multivariate process using neural networks and support vector machines. Expert Systems with Applications, 35(1–2), 198–206.

    Article  Google Scholar 

  • Chinnam, R. B. (2002). Support vector machines for recognizing shifts in correlated and other manufacturing processes. International Journal of Production Research, 40(17), 4449–4466.

    Article  MATH  Google Scholar 

  • Datta, S., & McCormick, W. P. (1995). Bootstrap inference for a first-order autoregression with positive innovations. Journal of the American Statistical Association, 90(432), 1289–1300.

    Article  MathSciNet  MATH  Google Scholar 

  • Davis, R. B., & Woodall, W. H. (1988). Performance of the control chart trend rule under linear shift. Journal of Quality Technology, 20(4), 260–262.

    Google Scholar 

  • DeSieno, D. (1988). Adding a conscience to competitive learning. In Proceedings of international joint conference on neural networks (pp. 117–124). San Diego, CA: IEEE Press.

  • Du, S. C., & Lv, J. (2013). Minimal Euclidean distance chart based on support vector regression for monitoring mean shifts of auto-correlated processes. International Journal of Production Economics, 141(1), 377–387.

    Article  Google Scholar 

  • El-Midany, T. T., El-Baz, M. A., & Abd-Elwahed, M. S. (2010). A proposed framework for control chart pattern recognition in multivariate process using artificial neural networks. Expert Systems with Applications, 37(2), 1035–1042.

    Article  Google Scholar 

  • Grant, E. L., & Leavenworth, R. S. (1996). Statistical quality control (7th ed.). New York: McGraw-Hill.

    Google Scholar 

  • Gu, N., Cao, Z. Q., Xie, L. J., et al. (2012). Identification of concurrent control chart patterns with singular spectrum analysis and learning vector quantization. Journal of Intelligent Manufacturing,. doi:10.1007/s10845-012-0659-0.

    Google Scholar 

  • Guh, R.-S. (2002). Robustness of the neural network based control chart pattern recognition system to non-normality. International Journal of Quality and Reliability Management, 19(1), 97–112.

    Article  Google Scholar 

  • Guh, R.-S. (2004). Optimizing feedforward neural networks for control chart pattern recognition through genetic algorithms. International Journal of Pattern Recognition and Artificial Intelligence, 18(2), 75–99.

    Article  Google Scholar 

  • Guh, R.-S. (2005). A hybrid learning-based model for on-line detection and analysis of control chart patterns. Computers and Industrial Engineering, 49(1), 35–62.

    Article  ADS  Google Scholar 

  • Guh, R.-S. (2008). Real-time recognition of control chart patterns in autocorrelated manufacturing processes using a learning vector quantization network-based approach. International Journal of Production Research, 46(14), 3959–3991.

    Article  MATH  Google Scholar 

  • Guh, R.-S., & Hsieh, Y.-C. (1999). A neural network based model for abnormal pattern recognition of control charts. Computers and Industrial Engineering, 36(1), 97–108.

    Article  Google Scholar 

  • Guh, R. S., & Shiue, Y. R. (2008). An effective application of decision tree learning for online detection of mean shifts in multivariate control charts. Computers and Industrial Engineering, 55(2), 475–493.

    Article  Google Scholar 

  • Guh, R.-S., & Tannock, J. D. T. (1999). A neural network approach to characterize pattern parameters in process control charts. Journal of Intelligent Manufacturing, 10(5), 449–462.

    Article  Google Scholar 

  • He, S.-G., He, Z., & Wang, G. A. (2013). Online monitoring and fault identification of mean shifts in bivariate processes using decision tree learning techniques. Journal of Intelligent Manufacturing, 24, 25–34.

    Article  Google Scholar 

  • Hsu, C.-W., Chang, C.-C., & Lin, C.-J. (2010). A practical guide to support vector classification. Technical report: Department of Computer Science and Information Engineering, National Taiwan University.

  • Hwarng, H. B. (1995). Multilayer perceptions for detecting cyclic data on control charts. International Journal of Production Research, 33(11), 3101–3117.

    Article  MATH  Google Scholar 

  • Hwarng, H. B. (2004). Detecting process mean shift in the presence of autocorrelation: A neural-network based monitoring scheme. International Journal of Production Research, 42(3), 573– 595.

    Google Scholar 

  • Hwarng, H. B. (2005). Simultaneous identification of mean shift and correlation change in AR(1) processes. International Journal of Production Research, 43(9), 1761–1783.

    Article  MATH  Google Scholar 

  • Hwarng, H. B., & Hubele, N. F. (1993a). X-bar control chart pattern identification through efficient off-line neural network training. IIE Transactions, 25(3), 27–40.

    Article  Google Scholar 

  • Hwarng, H. B., & Hubele, N. F. (1993b). Back-propagation pattern recognizers for X-bar control charts: Methodology and performance. Computers and Industrial Engineering, 24(2), 219–235.

    Article  Google Scholar 

  • Jiang, P. Y., Liu, D. Y., & Zeng, Z. J. (2009). Recognizing control chart patterns with neural network and numerical fitting. Journal of Intelligent Manufacturing, 20, 625–635.

    Article  Google Scholar 

  • Kohonen, T. (2001). Self-organizing maps, 3rd extended edition. In Springer series in information sciences (Vol. 30). Springer, Berlin, Heidelberg, New York.

  • Kohonen, T., Barna, G., & Chrisley, R. (1988). Statistical pattern recognition with neural networks: Benchmarking studies. In Proceedings of international joint conference on neural networks (pp. 161–168). San Diego, CA: IEEE Press.

  • Lapedes, A., & Farber, R. (1988). How neural nets work. In Z. A. Anderson (Ed.), Neural information processing systems (pp. 442–456). New York: American Institute of Physics.

    Google Scholar 

  • Lin, S.-Y., Guh, R.-S., & Shiue, Y.-R. (2011). Effective recognition of control chart patterns in autocorrelated data using a support vector machine based approach. Computers and Industrial Engineering, 61(4), 1123–1134.

    Article  Google Scholar 

  • Low, C., Hsu, C. M., & Yu, F. J. (2003). Analysis of variations in a multi-variate process using neural networks. International Journal of Advanced Manufacturing Technology, 22(11–12), 911–921.

    Article  Google Scholar 

  • Lucy-Bouler, T. L. (1993). Application to forecasting of neural network recognition of shifts and trends in quality control data. In Proceedings of world congress on neural networks (pp. 631–633). Portland, UK: IEEE Press.

  • Minitab Inc. (2006). Meet MINITAB release 15. State College, PA: Minitab.

  • Montgomery, D. C. (2009). Introduction to statistical quality control (6th ed.). New York: Wiley.

    Google Scholar 

  • Niaki, S. T. A., & Abbasi, B. (2005). Fault diagnosis in multivariate control charts using artificial neural networks. International Quality and Reliability Engineering, 21(8), 825–840.

    Google Scholar 

  • Pacella, M., & Semeraro, Q. (2007). Using recurrent neural networks to detect changes in autocorrelated manufacturing processes for quality monitoring. Computers and Industrial Engineering, 52(4), 502–520.

    Article  Google Scholar 

  • Packianather, M. S., Drake, P. R., & Rowlands, H. (2000). Optimizing the parameters of multilayered feedforward neural networks through Taguchi design of experiments. Quality and Reliability Engineering International, 16(6), 461–473.

    Article  Google Scholar 

  • Pandit, S. M., & Wu, S. (1983). Time series and system analysis with applications. New York: Wiley.

    MATH  Google Scholar 

  • Runger, G. C., Willemain, T. R., & Prabhu, S. (1995). Average run lengths for CUSUM control charts applied to residuals. Communications in Statistics-Theory and Methods, 24(1), 273–282.

    Article  MATH  Google Scholar 

  • Salehi, M., Bahreininejad, A., & Nakhai, I. (2011). On-line analysis of out-of-control signals in multivariate manufacturing processes using a hybrid learning-based model. Neurocomputing, 74(12–13), 2083–2095.

    Article  Google Scholar 

  • Tsacle, E. G., & Aly, N. A. (1996). An expert system model for implementing statistical process control in the health care industry. Computers and Industrial Engineering, 31(1–2), 447–450.

    Article  Google Scholar 

  • Wang, C.-H., Dong, T.-P., & Kuo, W. (2009). A hybrid approach for identification of concurrent control chart patterns. Journal of Intelligent Manufacturing, 20, 409–419.

    Article  Google Scholar 

  • Wang, C.-H., & Kuo, W. (2007). Identification of control chart patterns using wavelet filtering and robust fuzzy clustering. Journal of Intelligent Manufacturing, 18, 343–350.

    Article  Google Scholar 

  • Wang, T. Y., & Chen, L. H. (2002). Mean shifts detection and classification in multivariate process: A neural-fuzzy approach. Journal of Intelligent Manufacturing, 13(3), 211–221.

    Article  CAS  Google Scholar 

  • Wardell, D. G., Moskowitz, H., & Plante, R. D. (1994). Run-length distributions of special-cause control charts for correlated processes. Technometrics, 36(1), 3–17.

    Article  MathSciNet  MATH  Google Scholar 

  • Western Electric Company. (1958). Statistical quality control handbook. Indianapolis: Western Electric.

  • Wu, B., & Yu, J. B. (2009). A neural network ensemble model for on-line monitoring of process mean and variance shifts in correlated processes. Expert Systems with Applications, 36(1), 909–921.

    Article  ADS  Google Scholar 

  • Zobel, C. W., Cook, D. F., & Nottingham, Q. J. (2004). An augmented neural network classification approach to detecting mean shifts in correlated manufacturing process parameters. International Journal of Production Research, 42(4), 741–758.

    Article  Google Scholar 

Download references

Acknowledgments

The authors would like to express sincere appreciation to the anonymous referees for their detailed and helpful comments to improve the quality of this article.

Author information

Authors and Affiliations

  1. School of Mechanical and Electrical Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing , 210016, People’s Republic of China

    Wen-An Yang & Wei Zhou

Authors
  1. Wen-An Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Wei Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Wen-An Yang.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Yang, WA., Zhou, W. Autoregressive coefficient-invariant control chart pattern recognition in autocorrelated manufacturing processes using neural network ensemble. J Intell Manuf 26, 1161–1180 (2015). https://doi.org/10.1007/s10845-013-0847-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10845-013-0847-6

Keywords

Search

Navigation