MPC based Artificial Pancreas: Strategies for individualization and meal compensation

https://doi.org/10.1016/j.arcontrol.2012.03.009Get rights and content

Abstract

This paper addresses the design of glucose regulators based on Model Predictive Control (MPC) to be used as part of Artificial Pancreas devices for type 1 diabetic patients. Two key issues are deeply investigated: individualization, needed to cope with intersubject variability, and meal compensation, interpreted as a disturbance rejection problem. The individualization is achieved either by tuning the cost function, based on few well known clinical parameters (MPC1) or through the use of an individual model obtained via system identification techniques and an optimal tuning of the cost function based on real-life experiments (MPC2). The in silico tests, performed on 4 different scenarios using a simulator equipped with 100 patients, show that the performances of MPC1 are very promising, supporting its current use in an in vivo multicenter trial on 47 patients that is being carried out within the European Research Project AP@home. At the same time, further improvements are achieved by MPC2, showing that there is scope for in vivo experimentation of control strategies employing individually estimated patient models.

Introduction

Diabetes is a pathology that involves glucose regulation and can be divided in two main types: type 1, or insulin dependent, and type 2 or insulin resistant. The first one is characterized by the destruction of the beta cells in the pancreas, responsible for the insulin production, and, as a consequence, by the complete dependency of the patient on external insulin administration. In type 2 diabetic patients, there are an alteration of insulin secretion and a reduction of sensitivity to this hormone. A good glucose regulation, with glucose levels in the range 70–140 mg/dl, is mandatory for both types of diabetes because low blood glucose levels, hypo-glycemia, can lead to coma and, if not treated, to death. Conversely, high blood glucose levels, hyper-glycemia, maintained for too long can lead to the onset of long term problems such as cardiovascular diseases, chronic renal failures and retinal damages.

Scientific research devoted to diabetes is motivated by its prevalence, the estimated increase of new cases in the future and also because, with its complications, it imposes heavy charges on individuals, families, health systems, and countries. The World Health Organization (WHO), estimates that more than 346 million people worldwide have diabetes, a number destined to more than double by 2030. Diabetes is a major cause of death and in 2004 an estimated 3.4 million people died from consequences of high blood sugar (World Health Organization).

Research addresses several issues (Cobelli et al., 2009, Cobelli et al., 2011) and has different objectives: prevent the diffusion of the pathology, optimize therapy and develop automatic devices for regulating glucose in diabetic patients. The first example of device, developed in 1970s, for glucose regulation is the Biostator® that used glucose measurements, obtained with an intravenous sensor, to suggest insulin values, injected with an intravenous pump (Albisser et al., 1974, Clemens et al., 1977, Marliss et al., 1977). This method is too invasive and not suitable for outpatient use. For this reason, of great interest are devices employing a subcutaneous glucose sensor and a subcutaneous insulin pump. The integration of these two components with a control algorithm is called Artificial Pancreas (AP). A new era for the AP started in 1999 when the MiniMed introduced a commercial continuous glucose monitoring (CGM) system. Since then, several research project studied and experimented AP systems, starting from the MiniMed AP project (Steil, Rebrin, Darwin, Hariri, & Saad, 2006), with an acceleration caused by the launch of research projects funded by the JDRF, the European Commission and the NIH (El-Khatib et al., 2010, Hovorka et al., 2004, Hovorka et al., 2010, Kovatchev et al., 2010, Weinzimer et al., 2008). Among the most notable results is the approval by the Food and Drugs Administration (FDA) of a large scale in silico simulator developed by the University of Padova and the University of Virginia (Kovatchev, Breton, Dalla Man, & Cobelli, 2008) as a substitute to animal trials in the preclinical testing of AP control strategies.

Designing a control algorithm for the sc to sc glucose–insulin system is challenging because the system is characterized by significant interindividual variability, time varying dynamics, nonlinear phenomena and time delays due to the absorption of insulin from the subcutaneous level to the blood and, on reverse, of glucose from the blood to the subcutaneous level. Moreover the glucose profile depends on the insulin delivered, bounded from zero to a maximal value given by the pump, but also on very important disturbances such as meals and physical exercises that could be predicted to some extent.

The objective of the control algorithm is to keep the glucose levels within an optimal range (70–140 mg/dl). In the literature, several algorithms have been presented starting from PID schemes such as the work of Marchetti et al., 2006, Steil et al., 2006.

One of the most promising approaches to glucose regulation is Model Predictive Control. Three examples of MPC glucose regulation are the study of Parker, Doyle, and Peppas (1999), that considers a linear model identified with step responses and the work of Hovorka et al. (2004) that relies on a nonlinear time varying model whose parameters are adapted via Bayesian estimation and Magni et al. (2007) that is based on a mean linear model with an individualized cost function. Other interesting approaches are presented in Bequette, 2005, Dua et al., 2006, Grosman et al., 2010, Hovorka, 2005a, Hovorka, 2005b, Magni, Raimondo, et al., 2009, Magni, Forgione, et al., 2009, Patek et al., in press. So far, encouraging pilot results have been reported using Proportional-Integral-Derivative (PID) control (Steil et al., 2006, Weinzimer et al., 2008) and MPC strategies (Dassau et al., 2010, Hovorka et al., 2010, Kovatchev et al., 2010). In the technological implementation of the Artificial Pancreas, the control algorithm can be embedded in a modular architecture, (Patek et al., in press), including a safety module that checks the insulin suggested by the algorithm and approves or reduces this value.

The results illustrated in this article have been obtained in silico, using a simulator equipped with a cohort of virtual subjects that span sufficiently well the interindividual variability of key metabolic parameters in the general population of diabetic patients. In particular, the in silico experiments were performed using the glucose–insulin simulator developed by the University of Padova and University of Virginia (see Dalla Man, Rizza, & Cobelli, 2007). Underlying this simulator there is a high-order nonlinear model, characterized by several physiological parameters and incorporating all available knowledge about system functionality so as to be able to provide realistic glucose–insulin simulations in diabetes.

The paper is organized as follows. Section 2 is devoted to discussing the structure of the control system. The main contribution is the analysis of alternative feedback–feedforward schemes that exploit conventional therapy in order to improve the effectiveness of meal compensation. The novel scheme proposed in this paper combines a feedforward action derived from conventional therapy with feedforward action optimized by the MPC based on a meal absorption model. In Section 3, a general framework for controller individualization is described that hinges on two models, one for control design purposes and the other for tuning the cost function. Three possible implementations of this framework are discussed in Section 4. The first control strategy is an ideal one as it assumes availability of an accurate model of the true patient. The second one pursues individualization without assuming knowledge of individual patient dynamics, but exploiting only the knowledge of standard clinical parameters obtainable from screening questionnaires. The third control strategy individualizes the regulator on the basis of an individual linear model identified from real life experiments. The comparison of the three control strategies is carried out in silico in Section 5 considering four different scenarios: nominal, randomly perturbed meals, randomly perturbed insulin sensitivity and perturbation of basal insulin delivery. Some conclusions end the paper.

Section snippets

Control structure

The Artificial Pancreas has to do with closed-loop control of blood glucose profile. In such a context the blood glucose profile plays the role of controlled variable. The noisy measurements however, are provided by CGM readings that refer to subcutaneous glucose concentration, which is known to be a unit-gain lowpass filtered version of the controlled variable (the time constant being of the order of 5 min). The control variable is the injected insulin which is used to keep the blood glucose

MPC individualization

When controlling physiological systems, two major issues are the inherent inter-individual variability and the limited amount of information that can be gathered on the single subject under control. Hence, the importance but also the difficulty of controller individualization, that should ensure the needed flexibility without compromising simplicity and robustness. For this reasons, attention is focused on few but essential design choices, keeping fixed the less critical ones. In the algorithm

From in silico to real patients

Mathematical models of glucose metabolism enter the flow chart of Fig. 5 in two distinct steps: control synthesis and control testing. The control design strategies discussed in the present section will differ in the choice of the models used for control synthesis and testing. For ease of future reference, the models to be used are listed and named below:

  • IDM: nonlinear and time varying model associated with one particular in silico patient, drawn from the 100 patients provided by the

Results

The strategies described in this article have been evaluated in silico (Patek et al., 2009), running simulations for 100 virtual patients on a set of four scenarios obtained from a nominal protocol1 that starts at 6:00 pm and lasts 24 h. The state of each patient is initialized at the steady-state associated with the basal insulin. The first half an hour is managed with an open-loop therapy while at

Conclusions

The paper has addressed two major issues. The first one is the development of feedback–feedforward MPC structure that incorporates the knowledge embedded in the conventional insulin therapy consisting of basal administration and pre-meal boluses. The second issue has to do with the individualization of the MPC regulator in order to cope with the substantial inter-individual variability observed in diabetic patients. Two implementable strategies are proposed and compared to an ideal strategy

Acknowledgments

This research was funded through FP7 Grant number 247138 from the European Commission to the AP@home consortium, www.apathome.eu and through the FIRB Project Artificial Pancreas: in silico development and in vivo validation of algorithms for blood glucose control, from the Italian MIUR.

Paola Soru was born in Pavia, Italy, on August 14, 1987. She graduated with full marks and honours in Computer Engineering from the University of Pavia, Italy, in 2010. From December 2010 to December 2011 she worked as Grant Recipient on individualization of predictive control for glucose regulation of diabetic patients at the University of Pavia.

References (33)

  • P. Dua et al.

    Model-based blood glucose control for type 1 diabetes via parametric programming

    IEEE Transactions on Biomedical Engineering

    (2006)
  • F.H. El-Khatib et al.

    A bihormonal closed-loop artificial pancreas for type 1 diabetes

    Science Translational Medicine

    (2010)
  • D.A. Finan et al.

    Effect of input excitation on the quality of empirical dynamic models for type 1 diabetes

    AIChE Journal

    (2009)
  • B. Grosman et al.

    Zone model predictive control: A strategy to minimize hyper- and hypoglycemic events

    Journal of Diabetes Science and Technology

    (2010)
  • R. Hovorka

    Continuous glucose monitoring and closed-loop systems

    Diabetic Medicine

    (2005)
  • R. Hovorka

    Management of diabetes using adaptive control

    International Journal of Adaptive Control and Signal Processing

    (2005)
  • Cited by (105)

    View all citing articles on Scopus

    Paola Soru was born in Pavia, Italy, on August 14, 1987. She graduated with full marks and honours in Computer Engineering from the University of Pavia, Italy, in 2010. From December 2010 to December 2011 she worked as Grant Recipient on individualization of predictive control for glucose regulation of diabetic patients at the University of Pavia.

    Giuseppe De Nicolao is full professor of Model Identification and Data Analysis in the Department of Computer Science and Systems Engineering of the University of Pavia (Italy). He is an associated editor of the IEEE Transactions on Control Systems Technology and has been AE of the IEEE Transactions on Automatic Control and Automatica. His research interests include system identification, model predictive control, modeling and control of biomedical systems, advanced process control and fault diagnosis for semiconductor manufacturing. On these subjects, he has authored or coauthored more than 110 journal papers.

    Chiara Toffanin was born in Vizzolo Predabissi (MI), Italy, on March 24, 1985. She graduated with full marks and honours (summa cum laude) in Computer Engineering from the University of Pavia, Italy, in 2009. From November 2009 she is working on Model Predictive Control applied to type 1 diabetes, toward the Ph.D. degree. In 2011 she was at UCSB, University of California Santa Barbara as Visitor Researcher.

    Chiara Dalla Man was born in Venice, Italy, in 1977. She received the Doctoral degree cum laude in Electronics Engineering in 2000. She received the Ph.D. degree in Biomedical Engineering from the University of Padova, Italy, and City University London, UK in 2005. Then, she was Post-Doctoral with the Department of Information Engineering of Padova University. Since October 2007, she is Assistant Professor at the Faculty of Engineering of Padova University. She is on the Editorial Board of Journal of Diabetes Science and Technology. Her main interests are in the field of mathematical modeling of metabolic and endocrine systems.

    Claudio Cobelli was born in Bressanone (Bolzano), Italy, on February 21, 1946. He is a Full Professor of Biomedical Engineering at the University of Padova. His main research activity is in modeling and identification of metabolic systems. He has published more than 350 papers in peer reviewed journals and co-author of several international books. He is Associate Editor of IEEE Transactions on Biomedical Engineering. Dr. Cobelli has been Chairman of IFAC TC on Modeling and Control of Biomedical Systems (1990–1993 and 1993–1996). In 2010 he received the Diabetes Technology Artificial Pancreas Research Award. He is Fellow of IEEE, BMES, AIMBE.

    Lalo Magni was born in Bormio (SO), Italy, in 1971. He is Full Professor at the University of Pavia. In 2003 he was a plenary speaker at the 2nd IFAC Conference “Control Systems Design” (CSD’03). In 2005 he was Keynote speaker at the International Workshop on Assessment and Future Directions of NMPC. His current research interests include model predictive control and glucose control in type-1 diabetic patients. His research is witnessed by about 50 journal papers. He served as an Associate Editor of the IEEE Transactions on Automatic Control and currently of Automatica.

    View full text