Elsevier

Automatica

Volume 88, February 2018, Pages 98-106
Automatica

Brief paper
On optimal system operation in robust economic MPC

https://doi.org/10.1016/j.automatica.2017.11.007Get rights and content

Abstract

In this paper, different approaches for economic MPC under disturbances are investigated with respect to their optimal operating behavior. We derive dissipativity-based conditions under which certain optimal operating regimes can be guaranteed for the considered setups. Depending on the information about the disturbance, the system, and the algorithmic structure of the considered underlying robust economic MPC scheme, different statements can be derived. These include, inter alia, statements on stochastic and robust optimal operation. Moreover, we are able to provide converse statements showing – under a certain controllability assumption – necessity of the dissipativity statements for optimal operation at steady-state.

Introduction

Economic Model Predictive Control (MPC) has been an active field of research within the last decade. While in stabilizing MPC, the stage cost function is chosen in order to stabilize an a priori determined steady-state, in economic MPC arbitrary stage cost functions can be handled. This allows to consider more general control objectives, e.g., profit maximization or minimization of energy consumption. In the nominal, undisturbed case, optimal behavior of economic MPC algorithms has thoroughly been investigated. Due to the consideration of general stage cost functions in economic MPC, the optimal operating behavior might not be steady-state operation and also the closed-loop system does not necessarily converge to the optimal steady-state. Thus, one key question is: How can the optimal operating behavior be classified? In Angeli, Amrit, and Rawlings (2012), a first definition of optimal operation at steady-state is introduced for nominal economic MPC and sufficient conditions for a system to satisfy this property are presented (based on dissipativity). The converse statement is investigated in Müller, Angeli, and Allgöwer (2015), where it is shown that a certain controllability assumption is needed in order to prove necessity of dissipativity. A generalization of the above results as well as an extension to periodic systems is provided in Müller and Grüne (2016) and Zanon, Grüne, and Diehl (2016).

For most practical applications, the system is affected by disturbances. Whenever disturbances are acting on a system, it turns out that just transferring robust stabilizing MPC schemes to the economic case can result in a very poor performance, since the schemes do not account for the influence of the disturbance on the performance (see, e.g., Bayer, Müller, & Allgöwer, 2014). In order to overcome this drawback, several schemes have been presented explicitly accounting for the disturbance within the setup of the MPC algorithm (see, e.g., Bayer, Lorenzen et al. (2016), Bayer et al. (2014), Bayer, Müller et al. (2016), Broomhead et al. (2015), Hovgaard et al. (2011), Huang et al. (2012), Lucia et al. (2014), Marquez et al. (2014)).

In this paper, we are interested in analyzing the optimal operating behavior in the context of economic MPC under disturbances. In the robust setting, only in Bayer et al. (2014) some first attempt to examine the optimal operating behavior has been made, but only for one particular setup and for a special structure of the optimization problem. Here, we present a more comprehensive treatment of the subject. The major difficulty when analyzing optimal operation at steady-state under disturbances lies in the different robust economic MPC approaches available in literature. In particular, these approaches differ in the way which information about the disturbance is assumed to be known and how it is taken into account. This necessitates different notions of optimal operation at steady-state and, at the same time, different notions of dissipativity for investigating these properties. We highlight the fundamental contrast to the nominal case, where optimal operation at steady-state is a property that is independent of the underlying MPC approach. The analysis is split in three parts, which differ depending on which information about the disturbance is considered and how the disturbance is accounted for. These three parts also structure the paper: First, we investigate optimality depending only on the dynamics, the cost function, and the constraints. The disturbance is only considered through bounds on the worst case disturbance. The resulting optimality notion can be interpreted as steady-state operation being approximately optimal up to an error term depending on the largest disturbance. This seems to be the most general but also the weakest statement for optimality. Thus, in a second step, we investigate optimality for robust economic MPC schemes based on nominal dynamics underlying the optimal control problem. Third, we extend the analysis to systems with additional stochastic information on the disturbance. This additional information can be employed to sharpen the statement on the optimal operating behavior.

Notation: We denote by I0 the set of all non-negative integers and by I[a,b] the set of all integers in the interval [a,b]R. For sets X,YRn, the Minkowski set addition is defined by XY{x+yRn:xX,yY}. A continuous function α:R0R0 is a class K function if it is strictly increasing and α(0)=0. It is a class K function if furthermore α(s) for s. We denote k-step ahead predictions of state or input a, which are predicted at time t, by a(k|t). When a prediction is marked by , e.g., a(k|t), this indicates that this state or input is the optimal k-step ahead prediction at time t with respect to the considered MPC problem. Given a set YX×U, we denote its projection on X by YX. The Euclidean norm of a vector xRn is denoted by |x|.

Section snippets

Problem setup

We are interested in controlling systems of the form x(t+1)=f(x(t),u(t),w(t)),x(0)=x0,with f:Rn×Rm×RqRn continuous, where x(t)XRn is the system state, u(t)URm is the input to the system, and w(t)WRq is an external disturbance acting on the system. We assume that the disturbance set W is convex, compact, and contains the origin in its interior. Moreover, we assume constraints on the states and inputs of the form (x(t),u(t))Z,tI0,where ZX×U is a compact and convex set containing the

Robust optimal operation by comparison functions

The definition of optimal operation at steady-state in the nominal case only depends on the dynamics, the constraints, and the stage cost function. In this section, we introduce a similar notion in the robust setup taking additionally information about the disturbance set W into account. As it turns out, this notion is in general rather weak and we encounter in the subsequent sections that tighter statements can be obtained when taking into account more information on the disturbance than just

Dissipativity and optimal operation based on the nominal system

In this section, we investigate dissipativity and optimal operation for robust economic MPC approaches based on the nominal system. In contrast to Definition 2 and thus to the nominal case, the chosen algorithm for determining the nominal (and thus the real) closed loop has a significant influence on statements that can be derived concerning the optimal operating behavior.

The considered approaches are motivated by tube-based robust MPC, where the artificial nominal system (5) is considered

Stochastic dissipativity and optimal operation

In Bayer, Lorenzen et al. (2016), an approach for robust economic MPC was presented using stochastic information of the disturbance in order to improve the performance result. This result is for linear time-invariant systems of the form x(t+1)=Ax(t)+Bu(t)+w(t),x(0)=x0,where (A,B) is stabilizable. The results are based on disturbances satisfying the following assumption.

Assumption 1

See Bayer, Lorenzen et al., 2016

For each tI0, the disturbance satisfies w(t)WRn, where W is a compact and convex set containing the origin

Discussion on different approaches

Considering the different notions of dissipativity, we can see the following relation: Robust dissipativity (Section 3) is closely related to the nominal notion of dissipativity (cf. Müller, Angeli et al., 2015), however, here trajectories of the real, i.e., disturbed, system are considered. Still, this is a rather weak condition, since several steady-states (not only the one defined in (10)) could potentially satisfy this condition. The associated notion of robust optimal operation at

Conclusion

In this paper, we have discussed optimal operation at steady-state for different approaches in the framework of robust economic MPC. Three different concepts were investigated: (i) robust optimal operation, which is based on the stage cost, the dynamics and the constraints only, (ii) Ω-robust optimal operation which is based on the underlying optimization algorithm and the resulting nominal closed loop, and (iii) stochastic optimal operation which takes additional stochastic information about

Florian A. Bayer received a Diploma degree in Engineering Cybernetics from the University of Stuttgart, Germany, in 2012. He currently works as a teaching and research assistant at the Institute for Systems Theory and Automatic Control at the University of Stuttgart, Germany. Moreover, he is a Ph.D. student under the supervision of Prof. Frank Allgöwer at the University of Stuttgart. In 2011, he was a visiting researcher at the University of Colorado, Boulder, USA, and in 2015 at the University

References (32)

  • AngeliD. et al.

    On average performance and stability of economic model predictive control

    IEEE Transactions on Automatic Control

    (2012)
  • Bayer, F. A., Bürger, M., & Allgöwer, F. (2013). Discrete-time incremental ISS: A framework for robust NMPC. In Proc....
  • Bayer, F. A., Müller, M. A., & Allgöwer, F. (2016). Min-max economic model predictive control approaches with...
  • Bayer, F. A., Müller, M. A., & Allgöwer, F. (2017). Additional material to the paper “On Optimal Operation in Robust...
  • DammT. et al.

    An exponential turnpike theorem for dissipative discrete time optimal control problems

    SIAM Journal on Optimization

    (2014)
  • DiehlM. et al.

    A Lyapunov function for economic optimizing model predictive control

    IEEE Transactions on Automatic Control

    (2011)
  • Cited by (26)

    • Economic MPC of Markov Decision Processes: Dissipativity in undiscounted infinite-horizon optimal control

      2022, Automatica
      Citation Excerpt :

      MPC for stochastic systems is often treated within the Robust MPC (RMPC) or Stochastic MPC (SMPC) frameworks. The former is equipped with stability theories, but the analysis is usually restricted to tracking MPC formulations, to the exception of Bayer, Lorenzen, Müller, and Allgöwer (2016), Bayer et al. (2018), which discuss the economic setting. However, the stability results found in the RMPC context are limited to proving the stability of the closed-loop trajectories to a set (Chisci, Rossiter, & Zappa, 2001; Mayne, Seron, & Rakovic, 2005; Zanon & Gros, 2021) under the assumption of bounded support.

    • Lyapunov-based economic model predictive control for online model discrimination

      2022, Computers and Chemical Engineering
      Citation Excerpt :

      Process data recorded off-line or obtained from steady-state operation may not carry meaningful information for the purpose of reidentifying and discriminating between mechanistic models during process operation; an online (control-assisted) selection of the process model after a system identification approach may be more suitable for this goal. In the literature, several EMPC schemes have been proposed for which closed-loop stability can be guaranteed, which, in addition to LEMPC, include EMPC with terminal equality or terminal region constraints (Rawlings et al., 2012), with generalized terminal constraints (Fagiano and Teel, 2013), without terminal constraints (Müller and Grüne, 2016), or robust EMPC methods (Bayer et al., 2018; Schwenkel et al., 2020). We would not expect the ability of EMPC to aid in mechanistic model discrimination to be restricted to LEMPC, but conditions required to achieve safety during mechanistic model discrimination with other control policies are outside the scope of the present work.

    • Periodically time-varying economic model predictive control with applications to nonlinear continuous stirred tank reactors

      2022, Computers and Chemical Engineering
      Citation Excerpt :

      The stochastic information on the distributions of disturbances is given so the pointwise-in-time constraints are tightened by taking into account the growing error sets. For the discussion on different formulations of robust EMPC under disturbances, the readers are referred to Bayer et al. (2018). The operating policy of EMPC can depend on the time periods and time-varying parameters.

    View all citing articles on Scopus

    Florian A. Bayer received a Diploma degree in Engineering Cybernetics from the University of Stuttgart, Germany, in 2012. He currently works as a teaching and research assistant at the Institute for Systems Theory and Automatic Control at the University of Stuttgart, Germany. Moreover, he is a Ph.D. student under the supervision of Prof. Frank Allgöwer at the University of Stuttgart. In 2011, he was a visiting researcher at the University of Colorado, Boulder, USA, and in 2015 at the University of Wisconsin, Madison, USA. His research interests include robust and economic model predictive control as well as optimization algorithms.

    Matthias A. Müller received a Diploma degree in Engineering Cybernetics from the University of Stuttgart, Germany, and an M.S. in Electrical and Computer Engineering from the University of Illinois at Urbana–Champaign, US, both in 2009. In 2014, he obtained a Ph.D. in Mechanical Engineering, also from the University of Stuttgart, Germany, for which he received the 2015 European Ph.D. award on control for complex and heterogeneous systems. He is currently working as a senior lecturer (Akademischer Oberrat) at the Institute for Systems Theory and Automatic Control at the University of Stuttgart, Germany. In 2012, he was a visiting researcher at the Imperial College, London, UK. He is a member of the Elite program for PostDocs of the Baden-Württemberg Foundation and was a semi-plenary speaker at the 5th IFAC Conference on Nonlinear Model Predictive Control 2015. His research interests include nonlinear control and estimation, model predictive control, distributed control and switched systems.

    Frank Allgöwer studied Engineering Cybernetics and Applied Mathematics in Stuttgart and at the University of California, Los Angeles (UCLA), respectively, and received his Ph.D. degree from the University of Stuttgart in Germany.

    He is the Director of the Institute for Systems Theory and Automatic Control and Executive Director of the Stuttgart Research Centre Systems Biology at the University of Stuttgart.

    His research interests include cooperative control, predictive control, and nonlinear control with application to a wide range of fields including systems biology.

    For the years 2017–2020 Frank serves as President of the International Federation of Automatic Control (IFAC) and since 2012 as Vice President of the German Research Foundation DFG.

    The authors would like to thank the German Research Foundation (DFG) for financial support of the project within the research grants MU 3929/1-1 and AL 316/12-1 as well as within the Cluster of Excellence in Simulation Technology (EXC 310/2) at the University of Stuttgart. Matthias A. Müller is indebted to the Baden-Württemberg Stiftung for the financial support of this research project by the Eliteprogramme for Postdocs. The material in this paper was not presented at any conference. This paper was recommended for publication in revised form by Associate Editor Franco Blanchini under the direction of Editor Ian R. Petersen.

    View full text