Fault diagnosis of car assembly line based on fuzzy wavelet kernel support vector classifier machine and modified genetic algorithm

https://doi.org/10.1016/j.eswa.2010.12.109Get rights and content

Abstract

This paper presents a new version of fuzzy wavelet support vector classifier machine to diagnosing the nonlinear fuzzy fault system with multi-dimensional input variables. Since there exist problems of finite samples and uncertain data in complex fuzzy fault system, the input and output variables are described as fuzzy numbers. Then by integrating the fuzzy theory, wavelet analysis theory and v-support vector classifier machine, fuzzy wavelet v-support vector classifier machine (FWv-SVCM) is proposed. To seek the optimal parameters of FWv-SVCM, genetic algorithm (GA) is also applied to optimize unknown parameters of FWv-SVCM. A diagnosing method based on FWv-SVCM and GA is put forward. The results of the application in car assembly line diagnosis confirm the feasibility and the validity of the diagnosing method. Compared with the traditional model and other SVCM methods, FWv-SVCM method requires fewer samples and has better diagnosing precision.

Introduction

Recently, a novel machine learning technique, called support vector machine (SVM), has drawn much attention in the fields of pattern classification and regression estimation. SVM was first introduced by Vapnik, 2000, Vapnik, 1999. It is an approximate implementation to the structure risk minimization (SRM) principle in statistical learning theory, rather than the empirical risk minimization (ERM) method. This SRM principle is based on the fact that the generalization error is bounded by the sum of the empirical error and a confidence interval term depending on the Vapnik–Chervonenkis (VC) dimension (Vapnik, 2000). By minimizing this bound, good generalization performance can be achieved. Compared with traditional neural networks, SVM can obtain a unique global optimal solution and avoid the curse of dimensionality. These attractive properties make SVM become a promising technique. SVM was initially designed to solve pattern recognition problems (Cevikalp et al., 2007, Doumpos et al., 2007, Guo and Li, 2003, Huysmans et al., 2008, Jayadeva and Chandra, 2007, Juang et al., 2007, Peng et al., 2008, Ratsch et al., 2002, Wang et al., 2008, Widodo and Yang, 2008, Zhang et al., 2004, Wu and Law, 2010). With the introduction of Vapnik’s ε-insensitive loss function, SVM has been extended to function approximation and regression estimation problems (Hu et al., 2007, Lin et al., 2001, Rueda et al., 2004, Wu, 2009, Wu and Law, 2011, Wu et al., 2010, Zhang et al., 2004, Zhu et al., 2008) before 2001.

In SVM approach, the parameter ε controls the sparseness of the solution in an indirect way. However, it is difficult to come up with a reasonable value of ε without the prior information about the accuracy of output values. Schölkopf et al., 2000, Chalimourda et al., 2004 modify the original ε-SVM and introduce v-SVM, where a new parameter v controls the number of support vectors and the points that lie outside of the ε-insensitive tube. Then, the value of ε in the v-SVRM is traded off between model complexity and slack variables via the constant v.

In many real applications, the observed input data cannot be measured precisely and usually described in linguistic levels or ambiguous metrics. However, traditional support vector classifier (SVC) method cannot cope with qualitative information. It is well known that fuzzy logic is a powerful tool to deal with fuzzy and uncertain data. Some scholars have explored the fuzzy support vector machine (FSVM). For pattern classification problems, Shieh and Yang (2008) apply a fuzzy SVM to construct a classification model of product form design based on consumer preferences by allocating continuous and discrete attributes to the product form. Each product sample was assigned a class label, and a fuzzy membership, which is used to describe the semantic differential score corresponding to this label. To better handle uncertainties existing in real classification data and in the membership functions in the traditional type-1 fuzzy logic system, Chen, Li, Harrison, and Zhang (2008) apply interval type-2 fuzzy sets to construct a type-2 SVMs fusion FLS. This type-2 fusion architecture takes consideration of the classification results from individual SVC and generates the combined classification decision as the output. Yang, Jin, and Chuang (2006) propose system uses both fuzzy support vector machines and the variable-degree variable-step-size least-mean-square algorithm to achieve these objectives. They apply fuzzy memberships to each point, and provide different contributions to the decision learning function for support vector machines. However, the fuzzy support vector classifier machines mentioned in the above literatures are not suitable for the input and output variables described as triangular fuzzy numbers from the triangular fuzzy number space of which the input variables in classification problem of SVM may come from. Moreover, the kernel function of the published fuzzy SVCM pays less attention to wavelet support vector kernel.

It is obvious that the left and right parts of triangular fuzzy number can represent the uncertain information of expert judgement. For ordinary fuzzy SVRM, all fuzzy information is transformed into a crisp number via membership or a mapping, the regression analysis is based on the dealt sample set with crisp numbers. However, the paper suggests a novel fuzzy v-SVCM with wavelet kernels. The major novelty of the present work is that the inputs and outputs are described by triangular fuzzy numbers, and hence it allows a more effective description of system involving uncertainties. Additionally, the parameters pertaining in formulation are determined via GA-based search. Compared with ordinary SVCM, the fuzzy SVCM model in triangular fuzzy number space, the proposed model, whose constraint conditions of are three times that of standard SVCM, establishes the optimal problem based on the left, middle and right of triangular fuzzy number respectively. In a word, the uncertain information is considered into the establishment of the novel fuzzy v-SVCM with wavelet kernels, as is suitable to complex nonlinear fuzzy system diagnosing problem with uncertain influencing factors.

To overcome this disadvantage that the solution to the optimal parameter b of fuzzy v-SVCM with wavelet kernel model is difficult, the influencing of parameter b is taken into account confidence interval of fuzzy v-SVCM with wavelet kernel model. Finally, parameter b will be not come out in the classifier output function of the modified fuzzy v-SVCM with wavelet kernel model. The modified fuzzy v-SVCM with wavelet kernels model according to the structure risk minimization (SRM) is a new version of v-SVCM, named FWv-SVCM.

In this paper, we put forward a new FSVCM, called FWv-SVCM. Based on the FWv-SVCM, a diagnosing method for nonlinear fuzzy fault system is proposed. The rest of this paper is organized as follows. The FWv-SVCM is described in Section 2. In Section 3, a GA is used to optimize the unknown parameters of FWv-SVCM. In Section 4, a diagnosing method based on FWv-SVCM and GA is proposed. Section 5 gives an application in car assembly line diagnosis. FWv-SVCM is also compared with other SVCMs. Section 6 draws the conclusions.

Section snippets

Triangular fuzzy theory

Definition 1

Suppose M  T(R) is triangular fuzzy number (TFN) in triangular fuzzy space, whose membership function is represented as follows:μM(x)=x-αMrM-αM,αMx<rM,1,x=rM,x-βMrM-βM,rMx<βM,where αM  rM < βM, αM, rM, βM  R, αM  x < βM, x  R. Then we have the formulation M = (αM, rM, βM) in which rM is the center, αM is the left boundary and βM is the right boundary.

The standard triangular fuzzy number is difficult to deal with input variable of SVM, the extended version of Definition 1 is considered and described as

The modified genetic algorithm

Genetic algorithm (GA) is a stochastic global search technique that solves problems by imitating processes during natural evolution. Based on the survival and reproduction of the fitness, GA continually exploits new and better solutions without any pre-assumptions, such as continuity and unimodality. GA has been successfully applied to many complex optimization problems and shows its merits over traditional optimization methods, especially when the system under study has multiple optimum

The diagnosing algorithms and steps

GA is considered as an excellent technique to solve the combinatorial optimization problems. The modified GA is also a random search method, which is based on the concept of natural selection and a niching technique operator. It starts with an initial population and then applies a mixture of reproduction, crossover, and mutation to create new and hopefully better populations.

The steps of the modified GA are listed below:

Algorithm 1

The modified genetic algorithm

  • Step 1:

    Data preparation: Training and testing sets

Experiment

To analyze the performance of the Fv-SVCM model, the fault diagnosis of car assembly line is studied. The car assembly line is a type of fuzzy fault system influenced by manufacture equipments and some state factors of production environment in manufacturing system and its diagnosis action is usually driven by many uncertain factors. In our experiments, car assembly line pattern are selected from past production record in a typical company. The detailed characteristic data and fault pattern

Conclusion

In this paper, a new version of SVM, named FWv-SVCM, is proposed to establish the nonlinear diagnosing system of car assembly line. parameter b will be not come out in the classifier output function of the modified fuzzy v-SVCM with wavelet kernel model. The FWv-SVCM model can handle fuzzy fault pattern and provide better classifier precision, compared with fuzzy neural network. Therefore, the Fv-SVCM, which can deal with fault diagnosis with fuzzy input variables effectively, extends the

Acknowledgements

This research was partly supported by the National Natural Science Foundation of China under Grant 60904043 and 70761002, a research grant funded by the Hong Kong Polytechnic University (G-YX5J), China Postdoctoral Science Foundation (20090451152), Jiangsu Planned Projects for Postdoctoral Research Funds (0901023C) and Southeast University Planned Projects for Postdoctoral Research Funds.

References (31)

  • Q. Wu et al.

    Cauchy mutation based on objective variable of Gaussian particle swarm optimization for parameters selection of SVM

    Expert Systems with Applications

    (2011)
  • C.H. Wu et al.

    A Novel hybrid genetic algorithm for kernel function and parameter optimization in support vector regression

    Expert Systems with Applications

    (2009)
  • Q. Wu et al.

    Hybrid model based on SVM with Gaussian loss function and adaptive Gaussian PSO

    Engineering Applications of Artificial Intelligence

    (2010)
  • C.H. Yang et al.

    Fuzzy support vector machines for adaptive morse code recognition

    Medical Engineering & Physics

    (2006)
  • H. Cevikalp et al.

    The kernel common vector method: A novel nonlinear subspace classifier for pattern recognition

    IEEE Transactions on Systems, Man, and Cybernetics, Part B

    (2007)
  • Cited by (15)

    • Inverse fuzzy fault model for fault detection and isolation with least angle regression for variable selection

      2021, Computers and Industrial Engineering
      Citation Excerpt :

      An evolving fuzzy classifier was designed by Lemos, Caminhas, and Gomide (2013) for fault diagnosis in the same benchmark, and a similar evolved fuzzy classifier was developed by Inacio, Lemos, and Caminhas (2015) for fault detection in a DC drive system. A combination between fuzzy logic and a support vector machine to obtain a classifier for FDI in a car assembly line was shown by Wu, Law, and Wu (2011). Hemanth, Vijila, and Anitha (2009) showed that neural classifiers can give better results in classification tasks than their fuzzy counterparts in tumor image segmentation.

    • Kernel regression residual decomposition-based synchroextracting transform to detect faults in mechanical systems

      2019, ISA Transactions
      Citation Excerpt :

      As a nonparametric modeling technique, kernel regression(KR) [17] can be used to construct a prediction model based on the Nadaraya–Watson (NW) kernel estimator [18,19]. Wu et al. [20,21] proposed two hybrid methods based on KR for detecting faults in car assembly line and achieved good results. To detect the condition of industrial components, Baraldi et al. [22] presented a modified technique called auto-associative kernel regression (AAKR) and verified its effectiveness.

    • Comparison of NN and LR classifiers in the context of screening native American elders with diabetes

      2013, Expert Systems with Applications
      Citation Excerpt :

      GA is a generic all-purpose algorithm used for searching through a large number of objects to find one that optimizes the quantity of interest using methods derived from Darwinian evolution. GA continually exploits new and better solutions without any pre-assumption, Wu, Law, and Wu (2011). In the genetic algorithm, each factor is represented by a chromosome {0 or 1}.

    • Feature extraction using wavelets and classification through decision tree algorithm for fault diagnosis of mono-block centrifugal pump

      2013, Measurement: Journal of the International Measurement Confederation
      Citation Excerpt :

      Wu et al. [1], proposed a new Fuzzy Wavelet Support Vector Classifier Machine (FWSVCM) to overcome the problems faced in finite samples and uncertain data in a complex fuzzy fault system by describing the input and output variables as fuzzy numbers. They have also tested for a car assembly and proved that the proposed method requires less number of data points compared to other conventional methods [1]. Tang et al. [2] used morlet wavelet transformations in its continuous form and Winger–Ville Distribution (WVD) for fault diagnosis of wind turbine.

    View all citing articles on Scopus
    View full text