Fault diagnosis of car assembly line based on fuzzy wavelet kernel support vector classifier machine and modified genetic algorithm
Introduction
Recently, a novel machine learning technique, called support vector machine (SVM), has drawn much attention in the fields of pattern classification and regression estimation. SVM was first introduced by Vapnik, 2000, Vapnik, 1999. It is an approximate implementation to the structure risk minimization (SRM) principle in statistical learning theory, rather than the empirical risk minimization (ERM) method. This SRM principle is based on the fact that the generalization error is bounded by the sum of the empirical error and a confidence interval term depending on the Vapnik–Chervonenkis (VC) dimension (Vapnik, 2000). By minimizing this bound, good generalization performance can be achieved. Compared with traditional neural networks, SVM can obtain a unique global optimal solution and avoid the curse of dimensionality. These attractive properties make SVM become a promising technique. SVM was initially designed to solve pattern recognition problems (Cevikalp et al., 2007, Doumpos et al., 2007, Guo and Li, 2003, Huysmans et al., 2008, Jayadeva and Chandra, 2007, Juang et al., 2007, Peng et al., 2008, Ratsch et al., 2002, Wang et al., 2008, Widodo and Yang, 2008, Zhang et al., 2004, Wu and Law, 2010). With the introduction of Vapnik’s ε-insensitive loss function, SVM has been extended to function approximation and regression estimation problems (Hu et al., 2007, Lin et al., 2001, Rueda et al., 2004, Wu, 2009, Wu and Law, 2011, Wu et al., 2010, Zhang et al., 2004, Zhu et al., 2008) before 2001.
In SVM approach, the parameter ε controls the sparseness of the solution in an indirect way. However, it is difficult to come up with a reasonable value of ε without the prior information about the accuracy of output values. Schölkopf et al., 2000, Chalimourda et al., 2004 modify the original ε-SVM and introduce v-SVM, where a new parameter v controls the number of support vectors and the points that lie outside of the ε-insensitive tube. Then, the value of ε in the v-SVRM is traded off between model complexity and slack variables via the constant v.
In many real applications, the observed input data cannot be measured precisely and usually described in linguistic levels or ambiguous metrics. However, traditional support vector classifier (SVC) method cannot cope with qualitative information. It is well known that fuzzy logic is a powerful tool to deal with fuzzy and uncertain data. Some scholars have explored the fuzzy support vector machine (FSVM). For pattern classification problems, Shieh and Yang (2008) apply a fuzzy SVM to construct a classification model of product form design based on consumer preferences by allocating continuous and discrete attributes to the product form. Each product sample was assigned a class label, and a fuzzy membership, which is used to describe the semantic differential score corresponding to this label. To better handle uncertainties existing in real classification data and in the membership functions in the traditional type-1 fuzzy logic system, Chen, Li, Harrison, and Zhang (2008) apply interval type-2 fuzzy sets to construct a type-2 SVMs fusion FLS. This type-2 fusion architecture takes consideration of the classification results from individual SVC and generates the combined classification decision as the output. Yang, Jin, and Chuang (2006) propose system uses both fuzzy support vector machines and the variable-degree variable-step-size least-mean-square algorithm to achieve these objectives. They apply fuzzy memberships to each point, and provide different contributions to the decision learning function for support vector machines. However, the fuzzy support vector classifier machines mentioned in the above literatures are not suitable for the input and output variables described as triangular fuzzy numbers from the triangular fuzzy number space of which the input variables in classification problem of SVM may come from. Moreover, the kernel function of the published fuzzy SVCM pays less attention to wavelet support vector kernel.
It is obvious that the left and right parts of triangular fuzzy number can represent the uncertain information of expert judgement. For ordinary fuzzy SVRM, all fuzzy information is transformed into a crisp number via membership or a mapping, the regression analysis is based on the dealt sample set with crisp numbers. However, the paper suggests a novel fuzzy v-SVCM with wavelet kernels. The major novelty of the present work is that the inputs and outputs are described by triangular fuzzy numbers, and hence it allows a more effective description of system involving uncertainties. Additionally, the parameters pertaining in formulation are determined via GA-based search. Compared with ordinary SVCM, the fuzzy SVCM model in triangular fuzzy number space, the proposed model, whose constraint conditions of are three times that of standard SVCM, establishes the optimal problem based on the left, middle and right of triangular fuzzy number respectively. In a word, the uncertain information is considered into the establishment of the novel fuzzy v-SVCM with wavelet kernels, as is suitable to complex nonlinear fuzzy system diagnosing problem with uncertain influencing factors.
To overcome this disadvantage that the solution to the optimal parameter b of fuzzy v-SVCM with wavelet kernel model is difficult, the influencing of parameter b is taken into account confidence interval of fuzzy v-SVCM with wavelet kernel model. Finally, parameter b will be not come out in the classifier output function of the modified fuzzy v-SVCM with wavelet kernel model. The modified fuzzy v-SVCM with wavelet kernels model according to the structure risk minimization (SRM) is a new version of v-SVCM, named FWv-SVCM.
In this paper, we put forward a new FSVCM, called FWv-SVCM. Based on the FWv-SVCM, a diagnosing method for nonlinear fuzzy fault system is proposed. The rest of this paper is organized as follows. The FWv-SVCM is described in Section 2. In Section 3, a GA is used to optimize the unknown parameters of FWv-SVCM. In Section 4, a diagnosing method based on FWv-SVCM and GA is proposed. Section 5 gives an application in car assembly line diagnosis. FWv-SVCM is also compared with other SVCMs. Section 6 draws the conclusions.
Section snippets
Triangular fuzzy theory
Definition 1 Suppose M ∈ T(R) is triangular fuzzy number (TFN) in triangular fuzzy space, whose membership function is represented as follows:where αM ⩽ rM < βM, αM, rM, βM ∈ R, αM ⩽ x < βM, x ∈ R. Then we have the formulation M = (αM, rM, βM) in which rM is the center, αM is the left boundary and βM is the right boundary.
The standard triangular fuzzy number is difficult to deal with input variable of SVM, the extended version of Definition 1 is considered and described as
The modified genetic algorithm
Genetic algorithm (GA) is a stochastic global search technique that solves problems by imitating processes during natural evolution. Based on the survival and reproduction of the fitness, GA continually exploits new and better solutions without any pre-assumptions, such as continuity and unimodality. GA has been successfully applied to many complex optimization problems and shows its merits over traditional optimization methods, especially when the system under study has multiple optimum
The diagnosing algorithms and steps
GA is considered as an excellent technique to solve the combinatorial optimization problems. The modified GA is also a random search method, which is based on the concept of natural selection and a niching technique operator. It starts with an initial population and then applies a mixture of reproduction, crossover, and mutation to create new and hopefully better populations.
The steps of the modified GA are listed below: Algorithm 1 The modified genetic algorithm Data preparation: Training and testing sets
Experiment
To analyze the performance of the Fv-SVCM model, the fault diagnosis of car assembly line is studied. The car assembly line is a type of fuzzy fault system influenced by manufacture equipments and some state factors of production environment in manufacturing system and its diagnosis action is usually driven by many uncertain factors. In our experiments, car assembly line pattern are selected from past production record in a typical company. The detailed characteristic data and fault pattern
Conclusion
In this paper, a new version of SVM, named FWv-SVCM, is proposed to establish the nonlinear diagnosing system of car assembly line. parameter b will be not come out in the classifier output function of the modified fuzzy v-SVCM with wavelet kernel model. The FWv-SVCM model can handle fuzzy fault pattern and provide better classifier precision, compared with fuzzy neural network. Therefore, the Fv-SVCM, which can deal with fault diagnosis with fuzzy input variables effectively, extends the
Acknowledgements
This research was partly supported by the National Natural Science Foundation of China under Grant 60904043 and 70761002, a research grant funded by the Hong Kong Polytechnic University (G-YX5J), China Postdoctoral Science Foundation (20090451152), Jiangsu Planned Projects for Postdoctoral Research Funds (0901023C) and Southeast University Planned Projects for Postdoctoral Research Funds.
References (31)
Selecting of the optimal feature subset and kernel parameters in digital modulation classification by using hybrid genetic algorithm–support vector machines: HGASVM
Expert Systems with Applications
(2009)- et al.
Experimentally optimal ν in support vector regression for different noise models and parameter settings
Neural Networks
(2004) - et al.
Type-2 fuzzy logic-based classifier fusion for support vector machines
Applied Soft Computing
(2008) - et al.
Dynamically exploring internal mechanism of stock market by fuzzy-based support vector machines with high dimension input space and genetic algorithm
Expert Systems with Applications
(2009) - et al.
Support vector machine with genetic algorithm for forecasting of key-gas ratios in oil-immersed transformer
Expert Systems with Applications
(2009) - et al.
Classification model for product form design using fuzzy support vector machines
Computers & Industrial Engineering
(2008) - et al.
Optimization of coal-fired boiler SCRs based on modified support vector machine models and genetic algorithms
Fuel
(2009) - et al.
Wavelet support vector machine for induction machine fault diagnosis based on transient current signal
Expert Systems with Applications
(2008) The forecasting model based on wavelet v-support vector machine
Expert Systems with Applications
(2009)- et al.
Complex system fault diagnosis based on a fuzzy robust wavelet support vector classifier and an adaptive Gaussian particle swarm optimization
Information Sciences
(2010)
Cauchy mutation based on objective variable of Gaussian particle swarm optimization for parameters selection of SVM
Expert Systems with Applications
A Novel hybrid genetic algorithm for kernel function and parameter optimization in support vector regression
Expert Systems with Applications
Hybrid model based on SVM with Gaussian loss function and adaptive Gaussian PSO
Engineering Applications of Artificial Intelligence
Fuzzy support vector machines for adaptive morse code recognition
Medical Engineering & Physics
The kernel common vector method: A novel nonlinear subspace classifier for pattern recognition
IEEE Transactions on Systems, Man, and Cybernetics, Part B
Cited by (15)
Inverse fuzzy fault model for fault detection and isolation with least angle regression for variable selection
2021, Computers and Industrial EngineeringCitation Excerpt :An evolving fuzzy classifier was designed by Lemos, Caminhas, and Gomide (2013) for fault diagnosis in the same benchmark, and a similar evolved fuzzy classifier was developed by Inacio, Lemos, and Caminhas (2015) for fault detection in a DC drive system. A combination between fuzzy logic and a support vector machine to obtain a classifier for FDI in a car assembly line was shown by Wu, Law, and Wu (2011). Hemanth, Vijila, and Anitha (2009) showed that neural classifiers can give better results in classification tasks than their fuzzy counterparts in tumor image segmentation.
Kernel regression residual decomposition-based synchroextracting transform to detect faults in mechanical systems
2019, ISA TransactionsCitation Excerpt :As a nonparametric modeling technique, kernel regression(KR) [17] can be used to construct a prediction model based on the Nadaraya–Watson (NW) kernel estimator [18,19]. Wu et al. [20,21] proposed two hybrid methods based on KR for detecting faults in car assembly line and achieved good results. To detect the condition of industrial components, Baraldi et al. [22] presented a modified technique called auto-associative kernel regression (AAKR) and verified its effectiveness.
Comparison of NN and LR classifiers in the context of screening native American elders with diabetes
2013, Expert Systems with ApplicationsCitation Excerpt :GA is a generic all-purpose algorithm used for searching through a large number of objects to find one that optimizes the quantity of interest using methods derived from Darwinian evolution. GA continually exploits new and better solutions without any pre-assumption, Wu, Law, and Wu (2011). In the genetic algorithm, each factor is represented by a chromosome {0 or 1}.
Feature extraction using wavelets and classification through decision tree algorithm for fault diagnosis of mono-block centrifugal pump
2013, Measurement: Journal of the International Measurement ConfederationCitation Excerpt :Wu et al. [1], proposed a new Fuzzy Wavelet Support Vector Classifier Machine (FWSVCM) to overcome the problems faced in finite samples and uncertain data in a complex fuzzy fault system by describing the input and output variables as fuzzy numbers. They have also tested for a car assembly and proved that the proposed method requires less number of data points compared to other conventional methods [1]. Tang et al. [2] used morlet wavelet transformations in its continuous form and Winger–Ville Distribution (WVD) for fault diagnosis of wind turbine.