Elsevier

Applied Soft Computing

Volume 13, Issue 5, May 2013, Pages 2467-2477
Applied Soft Computing

Case based time series prediction using biased time warp distance for electrical evoked potential forecasting in visual prostheses

https://doi.org/10.1016/j.asoc.2012.11.047Get rights and content

Abstract

Case based time series prediction (CTSP) is a machine learning technique to predict the future behavior of the current time series by referring similar old cases. To reduce the cost of the visual prostheses research, we devote to the investigation of predictive performance of CTSP in electrical evoked potential (EEP) prediction instead of doing numerous biological experiments. The heart of CTSP for EEP prediction is a similarity measure of training case for target electrical stimulus by using distance metric. As EEP experimental case consists of the stationary electrical stimulation values and time-varying EEP elicited values, this paper proposes a new distance metric which takes the advantage of point-to-point distance's efficient operation in stationary data and time series distance's high capability in temporal data, called as biased time warp distance (BTWD). In BTWD metric, stimulation set difference (Diff_I) and EEP sequence difference (Diff_II) are calculated respectively, and a time-dependent bias configuration is added to reflect the different influences of Diff_I and Diff_II to the numerical computation of BTWD. Similarity-related adaptation coefficient summation is employed to yield the predictive EEP values at given time point in principle of k nearest neighbors. The proposed predictor using BTWD was empirically tested with data collected from the electrophysiological EEP eliciting experiments. We statistically validated our results by comparing them with other predictor using classical point-to-point distances and time series distances. The empirical results indicated that our proposed method produces superior performance in EEP prediction in terms of predictive accuracy and computational complexity.

Graphical abstract

As EEP experimental case consists of the stationary electrical stimulation values and time-varying EEP elicited values, this paper proposes a new distance metric which takes advantage of point-to-point distance's efficient operation in stationary data and time series distance's high capability in temporal data, called as biased time warp distance (BTWD). In BTWD metric, stimulation set difference (Diff_I) and EEP sequence difference (Diff_II) are calculated respectively, and a time-dependent bias configuration is added to reflect the different influences of Diff_I and Diff_II to the numerical computation of BTWD. Similarity-related adaptation coefficient summation is employed to yield the predictive EEP values at given time point in principle of k nearest neighbors.

  1. Download : Download full-size image

Highlights

► Propose a case based time series prediction approach by using new distance metric. ► Integrate point-to-point distance and time series distance to measure similarity. ► Add the time-dependent bias configuration to improve the predictive results.

Introduction

As the interests in time series have been explored by the number of domains in which time series occur: medicine, industry, entertainment, finance, computer science, meteorology and in almost every other field of human activity [1], the problem of time series prediction (TSP) has attracted great attention [2], [3], [4], [5], in which the historical observation values are collected and analyzed to predict the possible values of future time point. Different from traditional TSP approaches based on neural network (NN) model or regression model, case based TSP (CTSP) allows us to use previous data in predicting current data without completely understanding the underlying mechanism of time series behavior [6], actually, it would be very useful for experts to make their decision and predict the future behavior of the current time series by referring similar old case from past.

The purpose of optic nerve visual prosthesis is to deliver the electrical impulses to optic nerve with the penetrating electrode, and the visual perception is then emerged from the visual cortex, therefore, the analysis of responses of the visual cortex after the electrical stimulation to the optic nerve is a key part in optic nerve visual prosthesis [7], [8], [9], [10]. To explore the temporal property of responses, electrical evoked potentials (EEPs) are elicited over the rabbit skull when the optic nerve was stimulated with specific electrical stimulation current, as shown in Fig. 1. However, subjected to experiment cost and material restriction, the EEP response data triggered by various stimulations are too sparse and inadequate to be analyzed, and the characteristics of EEP data are time series, non-linear, inherently noisy, non-stationary, and deterministically chaotic [11]. To reduce the cost of the visual prostheses research, it is useful to exploit existing EEP electrophysiological data to predict new EEP response at given time point under new electrical stimulations, e.g., the current intensity, the pulse duration, the frequency of the stimuli, etc. In our previous works [11], [12], we presented an adapted support vector machine (SVM) based TSP model to predict EEP movement but with higher computational complexity. Enlighten by the advantages of CTSP, we devote to the investigation of predictive performance of CTSP to solve the EEP forecasting problem.

In this research, we attempt to employ CTSP to undertake EEP prediction task, and each experimental sample is expressed as an EEP experimental case, which involves stationary electrical stimulation values and time-varying EEP elicited values. The contribution of this paper is twofold. On the one hand, we try to construct a new distance function of similarity measure for EEP prediction. For the sake of implementing CTSP, training case should capture the evolution of the observed phenomenon over time [13], but time-varying information in cases will be neglected or the retrieval procedure will require massive calculated quantity when classical point-to-point distance or time series distance is used to measure the similarity of each case. The motivation of this research lies in employing a novel distance metric to calculate the similarity of EEP biological case by referring classic distance metrics, and intending to introduce the bias parameter to reflect the different influences from stationary electrical stimulation values and time series EEP elicited values for new predictive result, so the proposed distance is called biased time warp distance (BTWD). This paper is the first attempt to develop a new similarity measurement in CTSP which takes the advantages of classical point-to-point distance function's efficient operation in stationary data and time series distance function's high capability in temporal data.

On the other hand, we try to investigate the superiority of BTWD in actual EEP prediction, and the predictive performances of CTSP with BTWD and other TSP approaches are planned to be compared. Initial EEP experimental data are collected from the studies of rabbit's visual cortex by optic nerve stimulation carried out inside the pia mater, on the pia mater and on the dura mater. In the assessment of predictive performance, we employ 30-time cross-validation strategy by combining hold-out method and leave-one-out cross-validation. Predictive performance is evaluated by predictive results produced on hold-out data. Statistical analysis is employed to find whether or not there are significant differences among comparative predictors in the light of the predictive results.

The breakdown of this paper is organized as follows. The next section summarizes the research trends in TSP, and the motivation and originality of this research. Section 3 presents the specification on the BTWD. Section 4 describes the empirical design. Section 5 presents the empirical results and relevant discussions. The last section provides the conclusions and suggestions for further research.

Section snippets

Model based time series prediction

Model based TSP (MTSP) represents a family of TSP methods based on various predictive models. Initially, TSP for business failure prediction has been extensively studied from the views of statistic models in 1960s [14], e.g., discriminant analysis model [15], [16] and logistic regression model [17] were applied to predict business failure. Later, moving average model [18] and auto-regressive integrated moving average model [19] have been proposed to forecast the monthly electricity demand, but

Framework of CTSP using BTWD for EEP prediction

The framework of CTSP process using BTWD metric is shown in Fig. 2, where initial cases collected from EEP electrophysiological recording data is constructed, containing several stimulation values and EEP values. Accordingly, there are two types of differences in case comparison problem, that is, stimulation set difference (Diff_I) and EEP sequence difference (Diff_II). Diff_I means the difference of electrical stimulation sets from two comparison cases, and Diff_II is the difference between

Objective and comparative methods

Objective of this empirical research is to investigate whether or not the proposed CTSP using BTWD metric can achieve higher EEP predictive performance compare with other CTSP methods using traditional distances. Two chief ways of distance computation in similarity measure of CTSP are point-to-point distance metrics and time series distance metrics. Thus, this study makes two empirical comparisons, i.e., comparison of predictive accuracy between predictors using BTWD and point-to-point

Comparison of predictive accuracy on PPA

In this section, the predictive abilities of the distance-based CTSP predictors are compared. The actual EEP values at 0.1 ms, 0.2 ms, …, 50 ms time points of target case and the corresponding predictive EEP values generated by BTWD, ED, MD, DTW and TWED are depicted in Fig. 7, Fig. 8, so there are total 500 × 5 predictive values in one time hold-out validation. Then, in terms of the predictive results, we will be able to calculate PPA to examine the superiority of BTWD compare with other

Conclusion

This study constructed a case based time series prediction method (CTSP) by using new distance metric, which demonstrated good predictive performance in EEP prediction of optic nerve visual prostheses research. As EEP experimental case contains the stationary electrical stimulation values and time-varying EEP elicited values, we proposed a biased time wrapping distance (BTWD) metric in similarity measure of case retrieval process, which was composed of stimulation set difference (Diff_I) and

Acknowledgements

This research is supported by the National Basic Research Program of China (2011CB707503 and 2011CB013305). China Postdoctoral Science Foundation funded project (2012M510112). The authors are grateful to the editors and the anonymous reviewers for their insightful comments and suggestions.

References (74)

  • H. Li et al.

    On performance of case-based reasoning in Chinese business failure prediction from sensitivity, specificity, positive and negative values

    Applied Soft Computing

    (2011)
  • C.H. Wu et al.

    Patent classification system using a new hybrid genetic algorithm support vector machine

    Applied Soft Computing

    (2010)
  • S.H. Huang et al.

    Integrating GA-based time-scale feature extractions with SVMs for stock index forecasting

    Expert Systems with Applications

    (2008)
  • M. Awad et al.

    Dynamic classification for video stream using support vector machine

    Applied Soft Computing

    (2008)
  • I. Aydin et al.

    A multi-objective artificial immune algorithm for parameter optimization in support vector machine

    Applied Soft Computing

    (2011)
  • B. Jin et al.

    Support vector machines with genetic fuzzy feature transformation for biomedical data classification

    Information Sciences

    (2007)
  • T.W. Quan et al.

    Weighted least squares support vector machine local region method for nonlinear time series prediction

    Applied Soft Computing

    (2010)
  • B.W. Huang et al.

    Price information evaluation and prediction for broiler using adapted case-based reasoning approach

    Expert Systems with Applications

    (2009)
  • K.J. Oh et al.

    Financial market monitoring by case-based reasoning

    Expert Systems with Applications

    (2007)
  • J. Qi et al.

    AGFSM: a new FSM based on adapted Gaussian membership in case retrieval model for customer-driven design

    Expert Systems with Applications

    (2011)
  • H. Li et al.

    Majority voting combination of multiple case-based reasoning for financial distress prediction

    Expert Systems with Applications

    (2009)
  • H. Li et al.

    Financial distress prediction based on OR-CBR in the principle of k-nearest neighbors

    Expert Systems with Applications

    (2009)
  • J. Qi et al.

    A new adaptation method based on adaptability under k-nearest neighbors for case adaptation in case-based design

    Expert Systems with Applications

    (2012)
  • E.J. Keogh

    Exact indexing of dynamic time warping

  • S.W. Kim et al.

    Efficient processing of similarity search under time warping in sequence databases: an index-based approach

    Information Systems

    (2004)
  • W.K. Loh et al.

    Distortion-free predictive streaming time-series matching

    Information Sciences

    (2010)
  • B. Boucheham

    Reduced data similarity-based matching for time series patterns

    Pattern Recognition Letters

    (2010)
  • J. Qi et al.

    A case retrieval method combined with similarity measurement and multi-criteria decision making for concurrent design

    Expert Systems with Applications

    (2009)
  • N. Hvala et al.

    Influence of model validation on proper selection of process models – an industrial case study

    Computers & Chemical Engineering

    (2005)
  • C. Huilinir et al.

    Dynamic modeling of partial nitrification in a rotating disk biofilm reactor: calibration, validation and simulation

    Biochemical Engineering Journal

    (2010)
  • K. Vladimir et al.

    Case-based curve behaviour prediction

    Software: Practice and Experience

    (2009)
  • P.C. Chang et al.

    Evolving fuzzy rules for due-date assignment problem in semiconductor manufacturing factory

    Journal of Intelligent Manufacturing

    (2005)
  • S. Cost et al.

    A weighted nearest neighbor algorithm for learning with symbolic features

    Machine Learning

    (1993)
  • P.J. Cao et al.

    Evoked cortical potential and optic nerve response after direct electrical stimulation of the optic nerve in rabbits

  • A.Y. Chow et al.

    Implantation of silicon chip microphotodiode arrays into the cat subretinal space

    Neural Systems and Rehabilitation Engineering

    (2007)
  • Q.S. Ren et al.

    Development of C-Sight visual prosthesis based on optical nerve stimulation with penetrating electrode array

    Investigative Ophthalmology & Visual Science

    (2007)
  • J.H. Niu et al.

    Vision implants: an electrical device will bring light to the blind

    Science in China Series F: Information Sciences

    (2008)
  • Cited by (3)

    • Additive requirement ratio prediction using trend distribution features for hydrometallurgical purification processes

      2016, Control Engineering Practice
      Citation Excerpt :

      During ARR prediction process, a prediction algorithm plays an essential role. Recently, various algorithms have been used to solve this type of problem, such as neural networks (Ghavipour, Ghavipour, Chitsazan, Najibi & Ghidary, 2013; Yang, Gui, Kong & Wang, 2009; Iliyas, Elshafei, Habib & Adeniran, 2013), support vector regressions (Xi, Poo & Chou, 2007; Han, Liu, Zhao & Wang, 2012), partial least squares (Wang, Jang, Wong, Shieh & Wu, 2013; Vanlaer, Gins & Impe, 2013), autoregressive integrated moving averages (Zhang, Teng & Zhang, 2010; Pellegrini, Ruiz & Espasa, 2011), case based reasoning (CBR) (Qi, Hua, Peng, Chai & Ren, 2013; Xing, Ding, Chai, Puya & Wang, 2012; Chang, Fan & Lin, 2011) etc. In this paper, CBR is chosen for predicting ARR for following reasons: (1) it is relatively easy to set up a knowledge base; (2) CBR can be used in the problem domains that are not well understood; (3) in particular, CBR is easy to understand and has low computation cost, which is helpful for future maintenance and real-time process control (Chou, 2009).

    • Predicting electrical evoked potential in optic nerve visual prostheses by using support vector regression and case-based prediction

      2015, Information Sciences
      Citation Excerpt :

      The non-linear models used for time series prediction (TSP) were chiefly the neural networks (NNs), e.g., back-propagation neural network [3,13], multi-layer feed-forward neural network [15], sparsely connected neural networks [4,16], Kalman filter-based Elman network [43], and hybrid neural networks [1,28,41]. Although these networks work well, they have some inherent drawbacks, such as the problem of multiple local minima, the choice of number of hidden units and the danger of overfitting [31]. Meanwhile, case based prediction (CBP) originated from case based reasoning methodology began to be employed in this area as well [19,20,31], which allows experts to make their decision and predict the future behavior of the current time series by referring similar old case from past [31].

    • A quantum multi-agent based neural network model for failure prediction

      2016, Journal of Systems Science and Systems Engineering
    View full text