Elsevier

Neural Networks

Volume 98, February 2018, Pages 283-295
Neural Networks

Nonlinear predictive control for adaptive adjustments of deep brain stimulation parameters in basal ganglia–thalamic network

https://doi.org/10.1016/j.neunet.2017.12.001Get rights and content

Abstract

The efficacy of deep brain stimulation (DBS) for Parkinson’s disease (PD) depends in part on the post-operative programming of stimulation parameters. Closed-loop stimulation is one method to realize the frequent adjustment of stimulation parameters. This paper introduced the nonlinear predictive control method into the online adjustment of DBS amplitude and frequency. This approach was tested in a computational model of basal ganglia–thalamic network. The autoregressive Volterra model was used to identify the process model based on physiological data. Simulation results illustrated the efficiency of closed-loop stimulation methods (amplitude adjustment and frequency adjustment) in improving the relay reliability of thalamic neurons compared with the PD state. Besides, compared with the 130Hz constant DBS the closed-loop stimulation methods can significantly reduce the energy consumption. Through the analysis of inter-spike-intervals (ISIs) distribution of basal ganglia neurons, the evoked network activity by the closed-loop frequency adjustment stimulation was closer to the normal state.

Introduction

Deep brain stimulation (DBS) is an adjustable and reversible surgical treatment for Parkinson’s disease (PD), which is usually used for patients who do not respond well to medication Bronstein et al. (2011), Castrioto et al. (2011), Halpern et al. (2007), Krack et al. (2003). The stimulation parameters used for DBS are tuned for each patient using a time consuming trial-and-error process. Then the selected regular short-duration (60–180 μs), high-frequency (130–185 Hz) pulses are used to alleviate the motor symptoms. The efficacy of DBS is strongly dependent on the stimulation parameters Kuncel et al. (2007), Kuncel & Grill (2004), Rizzone et al. (2001). Currently, the stimulation parameters are adjusted intermittently every 3–12 months by neurologists while remain unchanged between clinical visits Deuschl et al. (2006), Hickey & Stacy (2016). Unfortunately, the therapeutic window of such constant stimulation is sometimes limited by strong side effects. Reprogramming stimulation parameters have been shown to reverse the adverse effects Frankemolle et al. (2010), Lee et al. (2010), Moro et al. (2006).

Although studies are carried out to investigate the relationship between stimulation parameters and the clinical effectiveness of DBS Heldman et al. (2016), Kuncel et al. (2007), Rizzone et al. (2001), the parameter setting for different patients and follow-up adjustments are still not standardized. Temporal pattern of stimulation and closed-loop modulation of stimulation parameters are deemed as two stimulation waveform related therapeutic innovations (Rossi et al., 2016). Some studies prove that temporal patterns of DBS are less effective than regular DBS in reducing symptoms in rats (McConnell, So, & Grill, 2016), tremor Birdno et al. (2008), Birdno et al. (2011) and bradykinesia in patients (Dorval, Kuncel, Birdno, Turner, & Grill, 2010). However, these studies offer important insights into how DBS works: the efficacy of high-frequency DBS is correlated with its ability to regulate neuronal firing patterns within the basal ganglia. Also, some studies demonstrate that the non-regular patterns of stimulation are more effective than regular stimulation Baker et al. (2011), Brocker et al. (2017), Brocker et al. (2013). The differences in findings may attribute to differences in stimulation targets (STN, GPi and Vim) or methods of evaluation (Baker et al., 2011).

Closed-loop DBS consists of closed-loop, real-time adjustment of stimulation parameters according to the patient’s clinical status, which can tailor the therapy to individual patients’ needs Beuter et al. (2014), Carron et al. (2013), Gorzelic et al. (2013), Hebb et al. (2014), Holt et al. (2016), Little et al. (2016), Little et al. (2013), Liu et al. (2013), Liu et al. (2015), Modolo et al. (2012), Rosin et al. (2011), Santaniello et al. (2011), Su et al. (2015), Tinkhauser et al. (2017). Rosin et al. use the spike time recorded in the primary motor cortex to control the open time of stimulation delivered to the GPi and prove these patterns are superior in alleviating akinesia than standard DBS in MPTP-treated monkeys (Rosin et al., 2011). Little et al. use the beta oscillation power of the STN local field potentials (LFPs) to control the on and off time of stimulation signal in PD patients, which can realize a 56% reduction in stimulation time than standard DBS (Little et al., 2013). These two stimulation strategies belong to the on-demand control from the control-theory perspectives. Another type of stimulation strategy called adaptive stimulation is realized through the real-time modulation of DBS amplitude or frequency parameter and mainly carried out on computational models. The traditional proportional–integral–derivative (PID) methodology (Liu et al., 2013), the generalized minimum variance control law, the adaptive control (Su et al., 2015) and variable universe fuzzy control algorithm (Liu et al., 2015) are studied to calculate the online stimulation waveforms. Although these studies are very promising, the optimal closed-loop stimulation method is still not discovered and the different action mechanisms between regular DBS and closed-loop stimulation need to be explored.

These studies motivated our current study. The nonlinear predictive control algorithm was used to realize the online adjustment of stimulation parameters, and then we attempted to explain the difference between regular DBS and closed-loop modulated stimulation from the distribution of BG neurons’ inter-spike-intervals (ISIs). This paper was organized as follows. The introduction of the computational model and selection of feedback signal were given in Section 2. In Section 3, the identification of the AR-Volterra model using the input–output data was described. The control framework was introduced in Section 4. Computer simulation results were presented in Section 5. Finally, the discussion and conclusion were given in Section 6.

Section snippets

Computational model of the basal ganglia–thalamic network

We used the basal ganglia–thalamicnetwork model (BG model) developed by Rosa et al. to test the efficacy of the proposed stimulation method in reducing the mean energy consumption and preserved efficacy (So, Kent, and Grill, 2012). The model is modified from the Rubin and Terman model (RT model) (Rubin & Terman, 2004). Compared with the original RT model, Rosa et al. change the ionic currents in each neuron and the topological structure of the network to make the model activity closer to

Identification of the input–output relationship

The BG model was described by the nonlinear differential equations, so the relationship between the input stimulation signal and the output LFP signal was deemed to be nonlinear. The second-order autoregressive Volterra model (AR-Volterra model) was used to identify the input–output relationship Doyle III et al. (2012), Marmarelis (2004). Because the efficiency of the second-order Volterra model in simulating the dynamics of neural system is proved by Marmarelis et al. Berger et al. (2011),

Approach to modulate the DBS parameters

The proposed control framework was diagrammedin Fig. 2. The control purpose was to make the actual output yt=LFPt track the desired one yspt=LFPspt. The control law was obtained by minimizing the following cost function, Jn+p=p=1uUPyen+pyrefn+p2which is a quadratic sum of errors between the predicted output ye and the reference trajectory yref. P is the prediction horizon, and U is the constraint of the input signal.

The reference trajectory yrefn+p was designed to be, yrefn+p=yspn+pμpyspnyn

Simulated BG network under normal, PD and DBS conditions

The level of bias currents applied to the STN, GPe, and GPi neurons (listed in Table 1) were the main adjustable parameters to model the transition from normal to pathological dynamics. Simulation results of different states were shown in Fig. 3. In the normal state, the STN, GPe, and GPi neurons fired irregularly and were irrelevant, and the thalamic neurons could relay the SMC input faithfully with the error index EI=0.0065. However, in the PD state, the firing patterns of BG nuclei became

Discussion and conclusion

The Volterra series was selected to identify the input–output relationship because which could treat the BG model as a black box and focus on describing the input–output mapping using different kernels (Marmarelis, 2004). Except for the second-order AR-Volterra model used in above sections, we also tried other orders. “FF”, “FD”, and “Cr” were used to denote the order of feedforward, feedback and cross kernels. Therefore, different orders of kernels tried here were FF,FD,Cr=2,0,0,2,1,0,2,2,2,3,3

Acknowledgments

This work was supported by the National Natural Science Foundation of China (grant numbers: 61374182, 61471265, 61501330, 61771330, 61701336); the Natural Science Foundation of Tianjin, China (grant number: 17JCQNJC00800) and the China Scholarship Council’s Study Abroad Project (grant number: 201606250142).

References (70)

  • JoundiR.A. et al.

    Driving oscillatory activity in the human cortex enhances motor performance

    Current Biology

    (2012)
  • KuncelA.M. et al.

    Selection of stimulus parameters for deep brain stimulation

    Clinical Neurophysiology

    (2004)
  • LeeJ. et al.

    Reprogramming guided by the fused images of MRI and CT in subthalamic nucleus stimulation in Parkinson disease

    Clinical Neurology and Neurosurgery

    (2010)
  • LeventhalD.K. et al.

    Basal ganglia beta oscillations accompany cue utilization

    Neuron

    (2012)
  • LiuC. et al.

    Variable universe fuzzy closed-loop control of tremor predominant Parkinsonian state based on parameter estimation

    Neurocomputing

    (2015)
  • LiuC. et al.

    Neural mass models describing possible origin of the excessive beta oscillations correlated with Parkinsonian state

    Neural Networks

    (2017)
  • MayneD.Q. et al.

    Constrained model predictive control: stability and optimality

    Automatica

    (2000)
  • PrioriA. et al.

    Adaptive deep brain stimulation (aDBS) controlled by local field potential oscillations

    Experimental Neurology

    (2013)
  • RosinB. et al.

    Closed-loop deep brain stimulation is superior in ameliorating Parkinsonism

    Neuron

    (2011)
  • RossiP.J. et al.

    Proceedings of the third annual deep brain stimulation think tank: a review of emerging issues and technologies

    Frontiers in Neuroscience

    (2016)
  • BergerT.W. et al.

    A cortical neural prosthesis for restoring and enhancing memory

    Journal of Neural Engineering

    (2011)
  • BergerT.W. et al.

    A hippocampal cognitive prosthesis: multi-input, multi-output nonlinear modeling and VLSI implementation

    IEEE Transactions on Neural Systems and Rehabilitation Engineering

    (2012)
  • BirdnoM.J. et al.

    Tremor varies as a function of the temporal regularity of deep brain stimulation

    NeuroReport

    (2008)
  • BirdnoM.J. et al.

    Stimulus features underlying reduced tremor suppression with temporally patterned deep brain stimulation

    Journal of Neurophysiology

    (2011)
  • BroccardF.D. et al.

    Closed-loop brain–machine–body interfaces for noninvasive rehabilitation of movement disorders

    Annals of Biomedical Engineering

    (2014)
  • BrockerD.T. et al.

    Optimized temporal pattern of brain stimulation designed by computational evolution

    Science Translational Medicine

    (2017)
  • BronsteinJ.M. et al.

    Deep brain stimulation for Parkinson Disease: an expert consensus and review of key issues

    Archives of Neurology

    (2011)
  • BuzsákiG. et al.

    The origin of extracellular fields and currents - EEG, ECoG, LFP and spikes

    Nature Reviews Neuroscience

    (2012)
  • CarronR. et al.

    Closing the loop of deep brain stimulation

    Frontiers in Systems Neuroscience

    (2013)
  • CastriotoA. et al.

    Ten-year outcome of subthalamic stimulation in Parkinson Disease

    Archives of Neurology

    (2011)
  • DeuschlG. et al.

    Deep brain stimulation: postoperative issues

    Movement Disorders

    (2006)
  • DorvalA.D. et al.

    Deep brain stimulation of the subthalamic nucleus reestablishes neuronal information transmission in the 6-OHDA rat model of parkinsonism

    Journal of Neurophysiology

    (2014)
  • DorvalA.D. et al.

    Deep brain stimulation alleviates Parkinsonian bradykinesia by regularizing pallidal activity

    Journal of Neurophysiology

    (2010)
  • Doyle IIIF.J. et al.

    Identification and control using volterra model

    (2012)
  • EdenU.T. et al.

    Characterizing the spiking dynamics of subthalamic nucleus neurons in Parkinson’s disease using generalized linear models

    Frontiers in Integrative Neuroscience

    (2012)
  • Cited by (16)

    View all citing articles on Scopus
    View full text