Elsevier

Computers & Industrial Engineering

Volume 127, January 2019, Pages 1115-1129
Computers & Industrial Engineering

Phase II monitoring of linear profiles with random explanatory variable under Bayesian framework

https://doi.org/10.1016/j.cie.2018.12.001Get rights and content

Highlights

  • Bayesian schemes for profiles monitoring with random explanatory variables are proposed.

  • The classical multivariate EWMA (MEWMA) chart is extended to Bayesian MEWMA chart.

  • Bayesian approach efficiently handled the parametric uncertainty of processes.

  • Conjugate and non-conjugate priors are incorporated to handle parametric uncertainty.

  • Conjugate priors are efficient among all priors in this study.

Abstract

Linear profiles monitoring have been successfully implemented in many industrial applications. The design structures of control charts for profiles monitoring are mostly based on two major classifications namely Classical and Bayesian. This study investigates the novel Bayesian exponentially weighted moving average and multivariate exponentially weighted moving average control charts for the monitoring of linear profiles, when explanatory variable(s) are random. The informative priors of normal and inverse gamma; and Bramwell, Holdsworth, Pinton (BHP) and Levy distributions are considered as conjugate and non-conjugate priors respectively. The proposed Bayesian schemes are evaluated using different run length characteristics. The schemes are also validated with simulation study and real-world data sets. The outcomes demonstrate that the Bayesian methods perform effectively better than the competing methods. The specified values of hyper-parameters are selected carefully after elicitation and sensitivity analysis of hyper-parameters. It has been observed that careful consideration is required while selecting the priors and possible values of hyper-parameters. The selection of appropriate priors and corresponding hyper-parameters comes up with efficient control structures which provide tangible benefits.

Introduction

Statistical Process Control (SPC) community has been actively involved in developing up-to-date statistical structures to enhance the performance of process structures in industrial engineering. The more emphasis on better quality of final product requires more information about process parameters and continuous process monitoring. The timely identification of changes in process parameters improves the quality of final product. There are several tools for process monitoring and the most essential one are the control charts. The quality control literature consists enormous articles that reflect the significance of this toolkit (i.e., Ahmad et al., 2014, Gunay and Kula, 2016, Stoumbos et al., 2000, Wu et al., 2017; references therein).

Currently, the SPC community is using two diverse approaches to define the quality characteristics of interest. These are the probability distribution or by using profiles function. In profiles function the quality characteristic(s) are defined using regression model where one is independent variable and other as dependent variable. The control charts are effectively used in profiles monitoring to check for possible change in relationship over time. The application of simple linear profiles was first introduced by Stover and Brill (1998) and attempt to resolve the appropriate calibration rate of recurrence for distinctive IC system with censored conductivity identification. Later, Kang and Albin (2000) characterized pressure and amount of flow using profiles function.

Since then, lots of literature has been published on profiles monitoring. They had tried to explore new dimensions and applications where profiles functions served effectively. The issue of interpretability in Kang and Albin (2000) was well addressed by Kim, Mahmoud, and Woodall (2003) by using transformed explanatory variable that results in zero covariance between Y-intercept and slope. Noorossana, Amiri, Vaghefi, and Roghanian (2004) introduced Multivariate Cumulative Sum (MCUSUM)/R chart for the monitoring of linear profiles in phase II. To handle the case of general linear profiles Zou, Tsung, and Wang (2007) incorporated Multivariate Exponentially Weighted Moving Average (MEWMA) charts. The idea of linear profiles monitoring was further extended by Noorossana, Eyvazian, and Vaghefi (2010) for multivariate cases. Soleimani and Noorossana (2012) investigated the impact of autocorrelation for the case of multivariate linear profiles. Zhang, He, Zhang, and Woodall (2014) evaluated the case of within-profile correlation in Phase II method. Zhang, Shang, He, and Wang (2016) used CUSUM schemes for the monitoring of pre specified changes in linear profiles. Zhang, Shang, Gao, and Wang (2017) used run rule schemes to monitor pre specified changes in linear profiles. Wang and Huang (2017) considered the case of first-order auto correlation in error terms while monitoring the linear profiles and provided diagnosis.

The control charting schemes discussed above and reference therein mainly focused the classical set-up to designed control charts. In classical set-up of process monitoring, assumption of fixed parameters seems impractical where parametric uncertainty is involved. This parametric uncertainty evolves when technological changes occur on regular basis to enhance the efficiency of products or processes. This demand from Statisticians to design flexible process monitoring structure to handle parametric uncertainty, which can be achieved through Bayesian control charts. Moreover, the use of posterior probability under Bayesian framework provides more practical grounds to identify the state of the process. There are numerous literature available where authors showed advantages of Bayesian approach over classical approach for the detection of shifts in process parameters (i.e., Hassan et al., 2011, Makis, 2008, Nikolaidis and Tagaras, 2017, Pan and Rigdon, 2012, Riaz et al., 2017, Wang, 2012, Wang and Lee, 2015; references therein).

In the view point of Bayesian approach, the elegant way to handle uncertainty is probability. For the case of repeated process parametric uncertainty occurs due to randomness in process. This scenario allows considering the fuzziness of the uncertain parameters in probabilistic way. Under these situations it seems more attractive to amassed most reliable values rather one value of the parameter (as in case of classical setup) Zellner, Ando, Basturk, Hoogerheide, and Van Dijk (2014). This parametric uncertainty incorporated in the form of probability distribution named as prior distribution. In Bayesian the information available for further analysis about process (i.e., environment of process, repairing history, observation of the engineer about process) are combined with response data by using Bayes theorem, mathematically defined as,P(η|data)=Pdata|ηPηPdataP(data|η)Pη,where η is the under study parameter. Pη|data is the posterior distribution of under study parameter η. Pdata|η defined the likelihood function of sampling distribution of process information. Pη represent the prior distribution of uncertain parameter of interest. Pdata is normalizing constant independent of parameter of interest which scale the posterior distribution.

Most of the literature available on profiles monitoring considered both explanatory variables and under study parameters as fixed. Noorossana, Fatemi, and Zerehsaz (2015) considered the case of random explanatory variables by taking a real process situation. However, there are many situations in process structures where the process parameters may vary along with explanatory variables. In this study, we have investigated randomness in both the process parameters and independent variable using Bayesian approach. The parametric uncertainty of process parameters integrated via prior distribution. This study investigated the properties of aforesaid Bayesian set-up after the modification of control limits coefficients, choice of priors and selection of hyper-parameters, choice of sampling distribution for dependent and independent variables, choice of loss function and impact of log and natural scale while monitoring the process standard deviations. Posterior estimates (posterior means) are obtained after incorporating prior knowledge into sample data. Three separate Bayesian EWMA control charts are designed under log and natural scale to monitor the process parameters of profiles model. The sensitivity analyses of hyper-parameters are performed to obtain the optimum choices of hyper-parameters values. The simulative study showed that there are processes defined by linear profiles where Bayesian set-up perform effectively and comes up with tangible benefits. The remaining article is structured as follows: Section 2 explains the linear profile model and Bayesian estimation. Classical and Bayesian control charting structure provided in Section 3. Section 4 describes the performance measure and step for simulation. Section 5 presents elicitation and sensitivity analysis for hyper-parameters. Section 6 demonstrates the comparative study. Section 7 presents the case study and Section 8 concludes the finding.

Section snippets

Linear profiles model and estimation under Bayesian framework

This section provides detail estimation procedure of simple linear profiles model under classical and Bayesian setup. The simple linear profiles model can be defined as:yij=A0j+A1jxij+εij,i=1,2,3,...,n,j=1,2,3,...,kwhere A0j and A1j are the specified process parameters under an in-control scenario for the jth profile. The least square estimates are Â0j=y¯j-Â1jx¯j, and Â1j=njSxy(j)-Sx(j)Sy(j)njSxx(j)-Sxj2 with respective variances as: Var(Â0j)=σj21nj+x¯j2Sxx(j) and Var(Â1j)=σj2/Sxx(j). The

Phase II classical and Bayesian control charting structure

This section presents control charting structure based on classical and Bayesian framework using phase II method with random X for linear profiles monitoring. The SPC community designed control charting structures either in Phase I or in Phase II. These have different goals and demonstration when applied. Further we demonstrate the competing and proposed control charts in Phase II after incorporating the posterior estimates.

Performance measures and simulation setting

The control charts mostly evaluated on the basis of run length distribution properties. The ARL values are the widely acknowledged measure of evaluation. It is interpreted as the average number of values required by a control structure to identify first out-of-control signal or signal false alarm. There are several methods available in literature to compute ARL values, like the integral equation method of Page, 1954, Brook and Evans, 1972 scheme based on MCMC techniques, and the method based on

Elicitation and sensitivity analysis

This section describes the hyper-parameter’s elicitation and corresponding sensitivity analysis to obtain the best choice of hyper-parameters. The hyper-parameter values contribute significantly for the designed control structures using Bayesian setups. So it is quite important to elicitate these hyper-parameter values to conduct further Bayesian analysis. A method proposed by Garthwaitea, Al-Awadhib, Elfadalya, and Jenkinsonc (2013) is an effective way of elicitating the hyper-parameters. We

Comparison of proposed method

This section provides comparative analysis of proposed Bayesian scheme for the monitoring of linear profiles with the existing classical approach. The evaluations of the proposed and existing control charts are based on different individual and overall measures. The smoothing constant value of 0.2 used by Noorossana et al. (2015) also used for Bayesian analyses. The EWMA control charts under classical setup represented by EWMA-Cx, while the proposed Bayesian EWMA charts for non-conjugate and

Real data applications

This section presents and discusses case studies based on real data to justify simulative work findings. The in-control and out-of-control scenarios are designed based on real data set to validate the effectiveness of control charts under Bayesian setup for linear profiles monitoring with random explanatory variable. The following steps are involved to estimate Bayesian EWMA charts.

  • Check the linearity and normality assumption of each profile.

  • Elicitation of hyper-parameters based on real data.

Conclusion and recommendations

There are situations in manufacturing industry where the process parameters are random then Bayesian approach is a wiser choice to handle such processes. This study has investigated linear profiles under random explanatory variables using Bayesian EWMA and MEWMA control charts in phase II. It is to be mentioned that the priors and the corresponding hyper-parameters should be selected carefully for efficient monitoring of linear profiles. From the run length comparison it is observed that the

Acknowledgments

The authors would like to acknowledge the Editor and Referees for their constructive comments that lead to significant improvements in the manuscript. The authors would like to acknowledge their parent Universities for providing excellent research facilities. Moreover, Dr. Muhammad Riaz would like to acknowledge Deanship of Scientific Research for supporting the study under Project Number IN171016.

References (40)

  • F.S. Stover et al.

    Statistical quality control applied to ion chromatography calibrations

    Journal of Chromatography A

    (1998)
  • W. Wang

    A simulation-based multivariate Bayesian control chart for real time condition-based maintenance of complex systems

    European Journal of Operational Research

    (2012)
  • Y.H.T. Wang et al.

    Phase II monitoring and diagnosis of autocorrelated simple linear profiles

    Computers & Industrial Engineering

    (2017)
  • C. Wu et al.

    Properties and enhancements of robust likelihood cusum control chart

    Computers & Industrial Engineering

    (2017)
  • M. Aslam et al.

    On the prior selection for variance of the normal distribution

    Journal of Stats

    (2009)
  • S.T. Bramwell et al.

    Universality of rare fluctuations in turbulence and critical phenomena

    Nature

    (1998)
  • D. Brook et al.

    An approach to the probability distribution of cusum run length

    Biometrika

    (1972)
  • P.H. Garthwaitea et al.

    Prior distribution elicitation for generalized linear and piecewise-linear models

    Journal of Applied Statistics

    (2013)
  • A. Hassan et al.

    Bayesian estimation of the time of a linear trend in risk-adjusted control charts

    International Journal of Computer Science

    (2011)
  • Jonathan, C. B., & Roger, D. C. (2014). Use of a levy distribution for modeling best case execution time variation. In...
  • Cited by (19)

    • Efficient linear profile schemes for monitoring bivariate correlated processes with applications in the pharmaceutical industry

      2020, Chemometrics and Intelligent Laboratory Systems
      Citation Excerpt :

      Saeed et al. [36] proposed a progressive setup approach to estimate the parameters of the linear profile. A Bayesian framework for monitoring linear profiles in phase II under a random explanatory variable was proposed by Refs. [37]. In all the literature mentioned above, the estimations of the linear profile’s intercept and slope parameters were based on the maximum likelihood estimation framework [38–41].

    • Change detection of profile with jumps and its application to 3D printing

      2020, Computers and Industrial Engineering
      Citation Excerpt :

      The mainstream literature only focuses on the former and neglects the latter. Early research in this area assumes that the in-control (IC) profile is linear (e.g., Abbas, Abbasi, Riaz, & Qian, 2019; Kang & Albin, 2000; Kim, Mahmoud, & Woodall, 2003; Li & Wang, 2010; Mahmoud, Parker, Woodall, & Hawkins, 2007; Saeed, Mahmood, Riaz, & Abbas, 2018; Zou, Zhang, & Wang, 2006). These linear charting schemes are extended to monitor parametric non-linear profiles (e.g., Colosimo, Semeraro, & Pacella, 2008; Huwang, Wang, Xue, & Zou, 2014; Williams, Woodall, & Birch, 2007; Zou, Tsung, & Wang, 2007).

    View all citing articles on Scopus
    View full text