Elsevier

Neurocomputing

Volume 173, Part 3, 15 January 2016, Pages 483-500
Neurocomputing

Hybrid BF–PSO and fuzzy support vector machine for diagnosis of fatigue status using EMG signal features

https://doi.org/10.1016/j.neucom.2015.06.002Get rights and content

Abstract

In this study, a novel BF–PSO–FSVCM model has been proposed to identify the fatigue status of the electromyography (EMG) signal. To improve the classifier accuracy of fuzzy support vector classification machine (FSVCM), a hybrid Bacterial Foraging (BF) and particle swarm optimization (PSO) is proposed to optimize the unknown parameters of the classifier. In the proposed method, the EMG signals are firstly decomposed by discrete wavelet transform (DWT), Fast Fourier Transformation (FFT) and Ensemble Empirical Mode Decomposition (EEMD)–Hilbert transform (HT), and then a set of combined features were extracted from different types of fatigue or normal EMG signals. The optimal fatigue vectors of static, local and dynamic fatigue are also provided in this study. The obtained results obviously indicate that further significant enhancements in terms of classification accuracy can be achieved by the proposed BF–PSO–FSVCM classification system. BF–PSO–FSVCM is developed as an efficient tool so that various support vector classification machines (SVCMs) can be used conveniently as the core of BF–PSO–FSVCM for diagnosis of fatigue status.

Introduction

Muscular fatigue [1] is an exercise-induced reduction in maximal voluntary muscle force. It may arise not only because of peripheral changes at the level of the muscle, but also because the central nervous system fails to drive the motoneurons adequately. The measurement of the muscular fatigue is according to the decline of the system maximal function. The adaptation of the neuromuscular system to heavy resistance exercise is a very complex result of many factors. This implies central and peripheral neural adaptations as well as chemical and morphological modifications of muscle tissue [2].

Surface electromyographic signal (sEMG) is an one-dimensional time series signal of neuromuscular system that recorded for skin surface; the time–frequency domain and nonlinear dynamical characters of it are sensitive to the intensity and state for muscular activities and therefore it is a valuable method for muscle functional evaluation [9]. For many years, the analysis of sEMG concentrated on two main fields, time domain and the frequency domain [3]. The common use of traditional time domain analysis is to regard the sEMG signal as the function of time, using some indices like Integrated EMG (IEMG) or some statistical features such as Root Mean Square (RMS). In aspect of spectrum analysis, the typical method is the Fast Fourier Transform short as FFT. The spectrum we acquire from the FFT can show the distribution of the signals in different frequency components quantitatively. In order to portray the characteristic of the spectrum, researchers often use the following two indicators: Median Frequency (MF) and Mean Power Frequency (MPF) [4]. The mean frequency of sEMG signal is an important index of local muscle fatigue. Most research works have found that the indicators of frequency analysis of the muscles in limbs and waist have good regularity in the condition of the static burthen. The main manifestation is the decline of the MPF or MF and the increase of power spectrum or the ratio of the low/high frequency during the process of fatiguing. However, under the dynamic condition, the alteration of the MPF and MF during the fatiguing process exists considerable difference from which can hardly get a universal conclusion [17].

Recently, Georgakis et al. [5] proposed to analyze the instantaneous frequency (IF) of fatigue EMG directly using Hilbert transform. They reported that the reliability and accuracy of the IF was better than the conventional spectral variables, i.e. mean frequency and median frequency. However, contrary to the suggestion given by [5], several authors [6], [7] argued that one should not just take any data to perform a Hilbert transform, find the phase function, and define the instantaneous frequency as the derivative of this phase function. They pointed out, if one follows this path, one would obtain a finite number of points where the frequency becomes very high and even assumes negative values that bear no relationship to the real oscillation of the data. It is to say that the instantaneous frequency derived from this method is typically oscillatory and often extends beyond the spectral range of the signal. To overcome the shortage of instantaneous frequency, a novel fatigue feature is proposed by the weighted frequency energy signals in this study.

Obviously, the feature extraction methods are also very important in the recognition of the fatigue status of EMG signals. From the above review of literatures [39], [40], [41], [42], [43], [44], features can be time and frequency domain information, such as Fourier coefficients, Hilbert transform coefficients [8], wavelet coefficients, and a wide range of quantities derived from other signal processing techniques. In the published literatures, the changes of features such as IEMG, RMS, MPF and MF were usually used to find the static or local fatigue phenomena, while the dynamic fatigue, feature IF has no enough capability to clue on the occurrence of fatigue. Features extracted from FuzzyEn, approximate entropy (ApEn), sample entropy (SampEn), and cumulative residual entropy (CrEn) have been applied to the classification of EMG signal [45], [50], [51], while wavelet entropy and wavelet energy techniques have been rarely applied as feature of EMG signal reported in [50]. By the analysis of the above, some statistical features of fatigue status such as IEMG, RMS, MPF, MF, wavelet entropy, wavelet high-low frequency energy ratio and improved IF are used to characterize the EMG interference pattern in the diagnosis of different types of muscular fatigue status in this study. These features can then be used as input data for classifiers such as NNs and SVMs, which can classify or detect muscular fatigue status.

However, design of practical and accurate automated recognition system remains challenging. The challenge in this area is to develop a robust and efficient classification technique that preserves important discriminatory information so as to provide a better accuracy for classification. Consequently, for an effective automated EMG signal classification, a systematic treatment of EMG signals must be carried out. For this reason, a number of computer-based quantitative EMG analysis algorithms have been developed [38].

More recently, Hassoun et al. [10] proposed the NNERVE algorithm in 1994 in an attempt to computerize the extraction of individual EMG. Schizas et al. [11] used artificial neural network (ANN) to classify action potentials of a large group of muscles. Their work was later extended by Schizas et al. [12] to compare K-means, multi-layer perceptron (MLP)–neural network (NN), self-organizing maps (SOMs), and genetic-based classifiers. It was shown that the simple K-means algorithm was not suitable as it gave the lowest classification accuracy, but both ANN and genetic-based models produced promising results. Pattichis et al. [13] extended the work by Schizas et al. [12] by applying ANN to motor unit action potential (MUAP) signals collected from the biceps brachii muscle. They compared the MLP network against the K-means clustering and Kohonen’s SOM. Comparisons with unsupervised learning methods were undertaken by Pattichis and Elia [14] using SOM, learning vector quantization (LVQ), and statistical methods. Pattichis and Pattichis [15] have investigated the usefulness of the wavelet transform (WT), that provides a linear time-scale representation for describing MUAP morphology and three different neural networks, the back propagation (BP), the radial basis function network (RBF), and the self-organizing feature map(SOFM). Subasi et al. [16] investigated the practicality of using an autoregressive model with wavelet neural network to classify EMG signals. Subasi and Kiymik [17] developed the EMG decomposition system consisting of time–frequency methods and independent component analysis (ICA).

SVM is a promising data classification technique proposed by Vapnik [18]. SVM is generated from the training process with the training data. Later on, classification is implemented based on the trained model [19], [20], [21], [22], [23]. Due to the fact that it is hard to obtain sufficient fatigue samples in practice, SVM is introduced into fatigue recognition of EMG signal due to its high accuracy and good generalization for a smaller number of samples. Moreover, some potential influencing factors are fuzzy and uncertain in EMG data collection [23], [42]. The standard SVM is hard to handle the fuzzy sample set. Therefore, a new fuzzy SVM should be explored. Yan et al. [46] constructed a fuzzy support vector machine model, in which a fuzzy membership function was utilized to transfer the output of a SVM discriminant function into a fuzzy class score. They made a comparison between the FSVM scheme and a BP neural network. The results indicated that four hand/wrist motions could be identified by FSVM with about 5% higher accuracy than BP network [50].

However, the fuzzy support vector machines mentioned in the above literatures [47], [48], [49], [50] are not suitable for the input and output variables described as triangular fuzzy numbers from the triangular fuzzy number space of which the input variables in classification problem of SVM may come from. The triangular fuzzy SVCM has the ability to establish optimal problem of uncertain information. The results will be obtained precisely. Moreover, the main problems encountered in setting up the FSVCM model are how to decide on the kernel function and its parameter values. Improper parameter settings and feature-selection may lead to deprived classification results [21]. In order to improve the FSVCM classification accuracy, the parameters that should be optimized including the penalty parameter s and the kernel function parameter for the radial basis function (RBF) kernel must be tuned. So, the tuned model parameters have an effect on the classification accuracy. This study attempts to increase the EMG signal classification accuracy rate by utilizing an approach based on a novel hybrid evolutionary computation algorithm based on bacterial foraging (BF) and particle swarm optimization (PSO) in FSVCM. BF algorithm is proposed by Passino [24] and a population-based search algorithm that is initialized with a population of random solutions, called bacteria. Recently, several researches on BF theories and applications have been reported [25], [26], [27], [28], [29], [30], [31], while BF algorithm has been not applied in the classification of EMG signal [50]. In BF algorithm, a unit length direction of tumble behavior is randomly generated which may lead to delay in reaching the global solution. To solve the shortcoming, BF and PSO were combined to use advantages of both techniques. The aim is to make use of PSO ability to exchange social information and BF ability in finding a new solution by elimination and dispersal. In the combined BF–PSO, the unit length random direction of tumble behavior can be obtained by the global best position and the best position of each bacterium by PSO algorithm.

In this study, the BF–PSO is proposed to use as an optimization technique to optimize the FSVCM parameters in fatigue classification of EMG signal. To recognize the fatigue status of EMG signal, a methodology has been developed for EMG signal classification which consists of three steps, which is shown in Fig. 1. In the first step, the EMG signals are decomposed using different signal process techniques such as wavelet, FFT and EEMD–Hilbert transform. In the second step, statistical features are extracted from the decomposed EMG signals using some technique such as entropy and energy ratio, and then provide better accuracy for diagnosis of muscular fatigue. In the last step, an unknown part of EMG signal is classified as normal and fatigue by different classification methods.

Obviously, in recognition applications of EMG or electroencephaloGram (EEG) signals, the observed input data cannot be measured precisely and affected by noise. Traditional support vector machine method cannot cope with fuzzy and uncertain information. It is well known that fuzzy logic is a powerful tool to deal with fuzzy and uncertain data. The conventional fuzzy support vector machine (FSVM) introduced a fuzzy membership to each training sample of SVM, so that fuzzy training samples could be trained and tested by standard SVM. In our proposed method, fuzzy information of sample data is represented accurately by triangular fuzzy number space, and then tree optimization problems on the left, middle and right of triangular fuzzy number are modeled and represented in the unified SVM model. The established SVM model develops SVM literatures in the field of fuzzy training samples.

And then, the main novelty of this paper is the proposed FSVCM-based approach and its parameter optimization algorithm, which aim at the performances shortage of SVCM classifier by fuzzy modeling of SVCM. The flowing results verify that the proposed BF–PSO–FSVCM classification method improves significantly the generalization capability of the classifier. Another advantage of the proposed BF–PSO–FSVCM approach can be found in its high sparseness, which is explained by the fact that the adopted optimization algorithm is based on hybrid BF and PSO. Another contribution of this study is how to select the optimal feature vectors for different fatigues such as static fatigue, local fatigue and dynamic fatigue. Our conclusion strengthens the published literatures of fatigue recognition.

The remaining paper is organized as follows: in the next section, we give information about the fatigue feature extracted using different signal process methods. The proposed classifier system is arranged in Section 3. Section 4 provides a complete experimental study for the BF–PSO–FSVCM model-based fatigue classification scheme of EMG signal, in which the impact of feature set and algorithmic issues are examined with respect to classification performance. The advantage of our proposed method is arranged in Section 5. Finally, the conclusions are summarized in Section 6.

Section snippets

Feature extraction

Fourier transform (FT), independent component analysis (ICA), Hilbert–Huang transform (HHT) and discrete wavelet transform (DWT) are the most common methods for extracting features from images or signals. In addition to being an efficient and highly intuitive framework for the representation and storage of multi-resolution signals, the DWT and HHT also provide powerful insight into a signal’s spatial and frequency characteristics. The FT provides representation of a signal based only on its

Hybrid classifier model based on BF–PSO–FSVCM

In this section we describe the proposed BF–PSO–FSVCM system for the EMG signal classification. The aim of this system is to optimize the FSVCM classifier accuracy by BF–PSO algorithm. Improper parameter settings may lead to deprived classification results. In order to improve the FSVCM classification accuracy, the parameters that should be optimized including the penalty parameter and the kernel function parameter for the radial basis function (RBF) kernel must be tuned. So, the tuned model

Experiment setup and fatigue feature selection

Ten male healthy, right-handed volunteers (mean age 22±2.8 years) participated in the experiment. All subjects also read and signed an informed consent before this experiment. No subject had a lower extremity injury, physical disability, or discomfort problem. Surface EMG signals were obtained from the left and right biceps brachii in an isometric constant force experiment. The subject sat with a dumbbell in his right hand. The initial position of the arm was such that the angle of elbow joint

Discussion

Since data error exists in EMG data gather process, the modeling process need to consider these errors. Then, a modeling uncertain data methodology is presented to solve the recognition of fatigue state in this paper. The recognition results of three types of fatigue state indicate the feasibility of the proposed method. In the recognition of static fatigue state, feature vector (RMS, IEMG, WE and ERHL) has been thought as the optimal features of static fatigue; the proposed model gives the

Conclusion

It is found in this study that the vector (RMS, IEMG, WE and ERHL) is feature vector of static fatigue evaluation, the vector (MPF, MF) is feature vector of local fatigue, and the feature vector (RMS, IEMG, MIF, WE) is that of dynamic fatigue. The proposed dynamic index MIF can represent the trend of the dynamic fatigue.

This study proposed a BF–PSO–FSVCM system in which BF–PSO was used to optimize the best FSVCM model parameters for fatigue recognition of EMG signal. One of the main

Acknowledgements

This research is supported by the Shanghai Pujiang Program under Grants 15PJ1404300 and a research grant of PLA General Armament Department׳s Foundation for Forward Research of Weapons (9140A17040114JW03241); the National Natural Science Foundation of China under Grants 61374195; the grant from Jiangsu Natural Science Foundation of china (No. BK2012363).

Qi Wu is an Associate Professor of Control Science and Engineering at the School of Electronic, Information and Electrical Engineering, the Shanghai Jiao Tong University. His research interests are pattern recognition and fault diagnosis.

References (51)

  • H. Supriyono et al.

    Parametric modelling approach using bacterial foraging algorithms for modelling of flexible manipulator systems

    Eng. Appl. Artif. Intell.

    (2012)
  • O.P. Verma et al.

    A novel bacterial foraging technique for edge detection

    Pattern Recognit. Lett.

    (2011)
  • R. Hooshmand et al.

    Simultaneous optimization of phase balancing and reconfiguration in distribution networks using BF-NM algorithm

    Int. J. Electr. Power Energy Syst.

    (2012)
  • S. Panda et al.

    Hybrid BFOA–PSO approach for coordinated design of PSS and SSSC-based controller considering time delays

    Int. J. Electr. Power Energy Syst.

    (2013)
  • M. Parastegari et al.

    AC constrained hydro-thermal generation scheduling problem: application of Benders decomposition method improved by BFPSO

    Int. J. Electr. Power Energy Syst.

    (2013)
  • O.A. Rosso

    Entropy changes in brain function

    Int. J. Psychophysiol.

    (2007)
  • K. Daqrouq

    Wavelet entropy and neural network for text-independent speaker identification

    Eng. Appl. Artif. Intell.

    (2011)
  • R. Moshrefi et al.

    Application of wavelet entropy in analysis of electrochemical noise for corrosion type identification

    Electrochem. Commun.

    (2014)
  • T. Wang et al.

    Comparing the applications of EMD and EEMD on time–frequency analysis of seismic signal

    J. Appl. Geophys.

    (2012)
  • O.A. Rosso et al.

    Wavelet entropy: a new tool for analysis of short duration brain electrical signals

    J. Neurosci. Methods

    (2001)
  • A. Phinyomark et al.

    Feature extraction of the first difference of EMG time series for EMG pattern recognition

    Comput. Methods Progr. Biomed.

    (2014)
  • A. Subasi

    Medical decision support system for diagnosis of neuromuscular disorders using DWT and fuzzy support vector machines

    Comput. Biol. Med.

    (2012)
  • A. Subasi

    Classification of EMG signals using combined features and soft computing techniques

    Appl. Soft Comput.

    (2012)
  • S.K. Chowdhury et al.

    Discrete wavelet transform analysis of surface electromyography for the fatigue assessment of neck and shoulder muscles

    J. Electromyogr. Kinesiol.

    (2013)
  • X. Zhang et al.

    Sample entropy analysis of surface EMG for improved muscle activity onset detection against spurious background spikes

    J. Electromyogr. Kinesiol.

    (2012)
  • Cited by (28)

    • A hybrid deep transfer learning-based approach for Parkinson's disease classification in surface electromyography signals

      2022, Biomedical Signal Processing and Control
      Citation Excerpt :

      In a muscle function measurement structure, which can often be based on the analysis obtained from pattern recognition, feature vectors are initially extracted from EMG signals using various feature description methods [21]. Afterwards, the extracted features is used to construct learning patterns, like Support Vector Machine (SVM) [22], Artificial Neural Networks (ANN) [23], Decision Tree (DT) [24], k-Nearest Neighbors (k-NN) [25], Logistic Regression (LR) [26], and Bayes Network (BN) [26]. The mechanism of the pattern recognition method should provide the possibility to achieve the appropriate response by extracting the proper features obtained from the EMG signal.

    • Automated diagnosis of muscle diseases from EMG signals using empirical mode decomposition based method

      2022, Biomedical Signal Processing and Control
      Citation Excerpt :

      In [22], the authors proposed a method to detect NMD using deep feature extraction of cross wavelet spectra. The research in [23] combines supervised and unsupervised learning methods to classify EMG signals. In this work, we have used the EMD based visual features for the classification of ALS, myopathy, and normal class EMG signals.

    • Toward optimum fuzzy support vector machines using error distribution

      2020, Engineering Applications of Artificial Intelligence
      Citation Excerpt :

      One-against-all SVM has a problem with multi-label classification and it is that a data sample may not be classified into any class. For solving this problem, Wu et al. (2016) proposes a FSVM for multi-label classification in which for each single label or multi-label class, they define a fuzzy region using decision function. The membership’s degree of data to the fuzzy region is defined by the decision hyperplane which is the nearest one to the data.

    • Recent advances in neuro-fuzzy system: A survey

      2018, Knowledge-Based Systems
      Citation Excerpt :

      A multiclass FSVM with PSO is utilized for fault diagnosis of wind turbine [129]. A hybrid tuning of FSVM by a combined bacterial forging-PSO algorithm and empirical mode decomposition (EMD) is applied for fatigue pattern recognition using EMG signal [130]. In all the above method, the number of fuzzy rules is equal to the number of support vectors.

    View all citing articles on Scopus

    Qi Wu is an Associate Professor of Control Science and Engineering at the School of Electronic, Information and Electrical Engineering, the Shanghai Jiao Tong University. His research interests are pattern recognition and fault diagnosis.

    Jianfeng Mao received the B.E. degree and M.E. degree in Automation Science from Tsinghua University, Beijing, China in 2001 and 2004, respectively, and Ph.D. degree in Systems Engineering from Boston University, Boston, MA, US in 2009. He is currently an assistant professor with the Division of Systems and Engineering Management, School of Mechanical and Aerospace Engineering, Nanyang Technological University, Singapore. His research is primarily focused on modeling and optimization of discrete event and hybrid systems with applications to transportation systems, air traffic management, energy management and healthcare systems.

    Wei Chuanfeng, Ph.D., is a Professor of Spacecraft System Design. Now he is director of Human Spaceflight System Engineering Division, Institute of Manned Space System Engineering, CAST, Beijing, China. Also he is a Member of IAF Human Space flight Endeavors. His research focuses on Spacecraft System Design.

    Shan Fu was born in 1964. Received his B.E.ng degree in EE from Northwestern Polytechnic University and Ph.D. degree from Heriot-Watt University. He is currently a professor in System Engineering in the School of Electronic Information and with particular research interests in Human Factors, Intelligent System and Pattern Recognition.

    Rob Law, Ph.D., is a Professor of Technology Management at the School of Hotel and Tourism Management, the Hong Kong Polytechnic University. His research interests are information management and technology applications.

    L. Ding received her Bachelor’s degree in engineering from Wu Han University, China, in 2011. Now, she is currently pursuing a Ph.D. at Shanghai Jiao Tong University. Her areas of interest include image processing, pattern recognition and machine learning.

    B. Jia is currently pursuing a Ph.D. in Control Science and Engineering in Shanghai Jiao Tong University, China. He received M.E. degree in Shanghai Jiao Tong University in 2013. His current research interests include signal processing and pattern recognition.

    Biting Yu received the B.S. degree in Biomedical Engineering from Nanjing University of Aeronautics and Astronautics, and is working toward the M.E. degree in Shanghai Jiao Tong University, China. Her current research interests include optimal algorithm and classification algorithm.

    Changpeng Yang received the B.S. degree in Aerospace engineering in 2011 from Northwestern Polytechnical University, Xi’an, China, the M.S. degree in Control Science in 2014 from Shanghai Jiao Tong University. Now he is working toward the Ph.D. degree in Aerospace engineering in Nanyang Technological University, Singapore. His current research interests include air transportation network optimization, evolutionary computation and human–machine–environment system.

    View full text