Brief paperOn optimal system operation in robust economic MPC☆
Introduction
Economic Model Predictive Control (MPC) has been an active field of research within the last decade. While in stabilizing MPC, the stage cost function is chosen in order to stabilize an a priori determined steady-state, in economic MPC arbitrary stage cost functions can be handled. This allows to consider more general control objectives, e.g., profit maximization or minimization of energy consumption. In the nominal, undisturbed case, optimal behavior of economic MPC algorithms has thoroughly been investigated. Due to the consideration of general stage cost functions in economic MPC, the optimal operating behavior might not be steady-state operation and also the closed-loop system does not necessarily converge to the optimal steady-state. Thus, one key question is: How can the optimal operating behavior be classified? In Angeli, Amrit, and Rawlings (2012), a first definition of optimal operation at steady-state is introduced for nominal economic MPC and sufficient conditions for a system to satisfy this property are presented (based on dissipativity). The converse statement is investigated in Müller, Angeli, and Allgöwer (2015), where it is shown that a certain controllability assumption is needed in order to prove necessity of dissipativity. A generalization of the above results as well as an extension to periodic systems is provided in Müller and Grüne (2016) and Zanon, Grüne, and Diehl (2016).
For most practical applications, the system is affected by disturbances. Whenever disturbances are acting on a system, it turns out that just transferring robust stabilizing MPC schemes to the economic case can result in a very poor performance, since the schemes do not account for the influence of the disturbance on the performance (see, e.g., Bayer, Müller, & Allgöwer, 2014). In order to overcome this drawback, several schemes have been presented explicitly accounting for the disturbance within the setup of the MPC algorithm (see, e.g., Bayer, Lorenzen et al. (2016), Bayer et al. (2014), Bayer, Müller et al. (2016), Broomhead et al. (2015), Hovgaard et al. (2011), Huang et al. (2012), Lucia et al. (2014), Marquez et al. (2014)).
In this paper, we are interested in analyzing the optimal operating behavior in the context of economic MPC under disturbances. In the robust setting, only in Bayer et al. (2014) some first attempt to examine the optimal operating behavior has been made, but only for one particular setup and for a special structure of the optimization problem. Here, we present a more comprehensive treatment of the subject. The major difficulty when analyzing optimal operation at steady-state under disturbances lies in the different robust economic MPC approaches available in literature. In particular, these approaches differ in the way which information about the disturbance is assumed to be known and how it is taken into account. This necessitates different notions of optimal operation at steady-state and, at the same time, different notions of dissipativity for investigating these properties. We highlight the fundamental contrast to the nominal case, where optimal operation at steady-state is a property that is independent of the underlying MPC approach. The analysis is split in three parts, which differ depending on which information about the disturbance is considered and how the disturbance is accounted for. These three parts also structure the paper: First, we investigate optimality depending only on the dynamics, the cost function, and the constraints. The disturbance is only considered through bounds on the worst case disturbance. The resulting optimality notion can be interpreted as steady-state operation being approximately optimal up to an error term depending on the largest disturbance. This seems to be the most general but also the weakest statement for optimality. Thus, in a second step, we investigate optimality for robust economic MPC schemes based on nominal dynamics underlying the optimal control problem. Third, we extend the analysis to systems with additional stochastic information on the disturbance. This additional information can be employed to sharpen the statement on the optimal operating behavior.
Notation: We denote by the set of all non-negative integers and by the set of all integers in the interval For sets , the Minkowski set addition is defined by . A continuous function is a class function if it is strictly increasing and . It is a class function if furthermore for . We denote -step ahead predictions of state or input , which are predicted at time , by . When a prediction is marked by , e.g., , this indicates that this state or input is the optimal -step ahead prediction at time with respect to the considered MPC problem. Given a set , we denote its projection on by . The Euclidean norm of a vector is denoted by .
Section snippets
Problem setup
We are interested in controlling systems of the form with continuous, where is the system state, is the input to the system, and is an external disturbance acting on the system. We assume that the disturbance set is convex, compact, and contains the origin in its interior. Moreover, we assume constraints on the states and inputs of the form where is a compact and convex set containing the
Robust optimal operation by comparison functions
The definition of optimal operation at steady-state in the nominal case only depends on the dynamics, the constraints, and the stage cost function. In this section, we introduce a similar notion in the robust setup taking additionally information about the disturbance set into account. As it turns out, this notion is in general rather weak and we encounter in the subsequent sections that tighter statements can be obtained when taking into account more information on the disturbance than just
Dissipativity and optimal operation based on the nominal system
In this section, we investigate dissipativity and optimal operation for robust economic MPC approaches based on the nominal system. In contrast to Definition 2 and thus to the nominal case, the chosen algorithm for determining the nominal (and thus the real) closed loop has a significant influence on statements that can be derived concerning the optimal operating behavior.
The considered approaches are motivated by tube-based robust MPC, where the artificial nominal system (5) is considered
Stochastic dissipativity and optimal operation
In Bayer, Lorenzen et al. (2016), an approach for robust economic MPC was presented using stochastic information of the disturbance in order to improve the performance result. This result is for linear time-invariant systems of the form where is stabilizable. The results are based on disturbances satisfying the following assumption.
Assumption 1 For each , the disturbance satisfies , where is a compact and convex set containing the originSee Bayer, Lorenzen et al., 2016
Discussion on different approaches
Considering the different notions of dissipativity, we can see the following relation: Robust dissipativity (Section 3) is closely related to the nominal notion of dissipativity (cf. Müller, Angeli et al., 2015), however, here trajectories of the real, i.e., disturbed, system are considered. Still, this is a rather weak condition, since several steady-states (not only the one defined in (10)) could potentially satisfy this condition. The associated notion of robust optimal operation at
Conclusion
In this paper, we have discussed optimal operation at steady-state for different approaches in the framework of robust economic MPC. Three different concepts were investigated: (i) robust optimal operation, which is based on the stage cost, the dynamics and the constraints only, (ii) -robust optimal operation which is based on the underlying optimization algorithm and the resulting nominal closed loop, and (iii) stochastic optimal operation which takes additional stochastic information about
Florian A. Bayer received a Diploma degree in Engineering Cybernetics from the University of Stuttgart, Germany, in 2012. He currently works as a teaching and research assistant at the Institute for Systems Theory and Automatic Control at the University of Stuttgart, Germany. Moreover, he is a Ph.D. student under the supervision of Prof. Frank Allgöwer at the University of Stuttgart. In 2011, he was a visiting researcher at the University of Colorado, Boulder, USA, and in 2015 at the University
References (32)
- et al.
Robust economic model predictive control using stochastic information
Automatica
(2016) - et al.
Tube-based robust economic model predictive control
Journal of Process Control
(2014) Set invariance in control
Automatica
(1999)- et al.
Robust periodic economic MPC for linear systems
Automatica
(2015) - et al.
General theorems on rates of convergence in distribution of random variables I. General limit theorems
Journal of Multivariate Analysis
(1978) - et al.
Robust stability of economically oriented infinite horizon NMPC that include cyclic processes
Journal of Process Control
(2012) - et al.
Handling uncertainty in economic nonlinear model predictive control: A comparative case study
Journal of Process Control
(2014) - et al.
Robust model predictive control of constrained linear systems with bounded disturbances
Automatica
(2005) - et al.
Economic model predictive control without terminal constraints for optimal periodic behavior
Automatica
(2016) - et al.
Tube MPC scheme based on robust control invariant set with application to Lipschitz nonlinear systems
Systems & Control Letters
(2013)
On average performance and stability of economic model predictive control
IEEE Transactions on Automatic Control
An exponential turnpike theorem for dissipative discrete time optimal control problems
SIAM Journal on Optimization
A Lyapunov function for economic optimizing model predictive control
IEEE Transactions on Automatic Control
Cited by (26)
Offshore wind power generation system control using robust economic MPC scheme
2023, Ocean EngineeringSelf-tuning kernel Gaussian method for predictive control systems
2023, Journal of Process ControlEconomic MPC of Markov Decision Processes: Dissipativity in undiscounted infinite-horizon optimal control
2022, AutomaticaCitation Excerpt :MPC for stochastic systems is often treated within the Robust MPC (RMPC) or Stochastic MPC (SMPC) frameworks. The former is equipped with stability theories, but the analysis is usually restricted to tracking MPC formulations, to the exception of Bayer, Lorenzen, Müller, and Allgöwer (2016), Bayer et al. (2018), which discuss the economic setting. However, the stability results found in the RMPC context are limited to proving the stability of the closed-loop trajectories to a set (Chisci, Rossiter, & Zappa, 2001; Mayne, Seron, & Rakovic, 2005; Zanon & Gros, 2021) under the assumption of bounded support.
Lyapunov-based economic model predictive control for online model discrimination
2022, Computers and Chemical EngineeringCitation Excerpt :Process data recorded off-line or obtained from steady-state operation may not carry meaningful information for the purpose of reidentifying and discriminating between mechanistic models during process operation; an online (control-assisted) selection of the process model after a system identification approach may be more suitable for this goal. In the literature, several EMPC schemes have been proposed for which closed-loop stability can be guaranteed, which, in addition to LEMPC, include EMPC with terminal equality or terminal region constraints (Rawlings et al., 2012), with generalized terminal constraints (Fagiano and Teel, 2013), without terminal constraints (Müller and Grüne, 2016), or robust EMPC methods (Bayer et al., 2018; Schwenkel et al., 2020). We would not expect the ability of EMPC to aid in mechanistic model discrimination to be restricted to LEMPC, but conditions required to achieve safety during mechanistic model discrimination with other control policies are outside the scope of the present work.
Periodically time-varying economic model predictive control with applications to nonlinear continuous stirred tank reactors
2022, Computers and Chemical EngineeringCitation Excerpt :The stochastic information on the distributions of disturbances is given so the pointwise-in-time constraints are tightened by taking into account the growing error sets. For the discussion on different formulations of robust EMPC under disturbances, the readers are referred to Bayer et al. (2018). The operating policy of EMPC can depend on the time periods and time-varying parameters.
Florian A. Bayer received a Diploma degree in Engineering Cybernetics from the University of Stuttgart, Germany, in 2012. He currently works as a teaching and research assistant at the Institute for Systems Theory and Automatic Control at the University of Stuttgart, Germany. Moreover, he is a Ph.D. student under the supervision of Prof. Frank Allgöwer at the University of Stuttgart. In 2011, he was a visiting researcher at the University of Colorado, Boulder, USA, and in 2015 at the University of Wisconsin, Madison, USA. His research interests include robust and economic model predictive control as well as optimization algorithms.
Matthias A. Müller received a Diploma degree in Engineering Cybernetics from the University of Stuttgart, Germany, and an M.S. in Electrical and Computer Engineering from the University of Illinois at Urbana–Champaign, US, both in 2009. In 2014, he obtained a Ph.D. in Mechanical Engineering, also from the University of Stuttgart, Germany, for which he received the 2015 European Ph.D. award on control for complex and heterogeneous systems. He is currently working as a senior lecturer (Akademischer Oberrat) at the Institute for Systems Theory and Automatic Control at the University of Stuttgart, Germany. In 2012, he was a visiting researcher at the Imperial College, London, UK. He is a member of the Elite program for PostDocs of the Baden-Württemberg Foundation and was a semi-plenary speaker at the 5th IFAC Conference on Nonlinear Model Predictive Control 2015. His research interests include nonlinear control and estimation, model predictive control, distributed control and switched systems.
Frank Allgöwer studied Engineering Cybernetics and Applied Mathematics in Stuttgart and at the University of California, Los Angeles (UCLA), respectively, and received his Ph.D. degree from the University of Stuttgart in Germany.
He is the Director of the Institute for Systems Theory and Automatic Control and Executive Director of the Stuttgart Research Centre Systems Biology at the University of Stuttgart.
His research interests include cooperative control, predictive control, and nonlinear control with application to a wide range of fields including systems biology.
For the years 2017–2020 Frank serves as President of the International Federation of Automatic Control (IFAC) and since 2012 as Vice President of the German Research Foundation DFG.
- ☆
The authors would like to thank the German Research Foundation (DFG) for financial support of the project within the research grants MU 3929/1-1 and AL 316/12-1 as well as within the Cluster of Excellence in Simulation Technology (EXC 310/2) at the University of Stuttgart. Matthias A. Müller is indebted to the Baden-Württemberg Stiftung for the financial support of this research project by the Eliteprogramme for Postdocs. The material in this paper was not presented at any conference. This paper was recommended for publication in revised form by Associate Editor Franco Blanchini under the direction of Editor Ian R. Petersen.