Innovative Applications of O.R.A stochastic program with time series and affine decision rules for the reservoir management problem
Introduction
This paper considers the problem of minimizing the risk of floods for a multi-reservoir system over a fixed time horizon subject to uncertainty on inflows while respecting tight operational constraints on total storage, spills, releases, water balance and additional physical constraints. This reservoir management problem is of vital importance to various real sites that are close to human habitations and that are prone to flooding (Castelletti, Galetti, Restelli, Soncini-Sessa, 2010, Gauvin, Delage, Gendreau, 2017, Pianosi, Soncini-Sessa, 2009, Quentin, Côté, Robert, 2014).
The deterministic version of the problem already poses serious challenges since operators must consider complex non-linear phenomena related to the physical nature of the system (Labadie, 2004). The interconnection of the catchment also complicates decisions as upstream releases affect downstream volumes and flows. This issue is particularly important for large catchments where there can be long water delays (Gauvin et al., 2017). Considering uncertainty significantly increases theses difficulties since the sequential decision-making under uncertainty represents a huge theoretical obstacle in itself (Dyer & Stougie, 2006).
In order to solve this problem, we propose a multi-stage stochastic program based on affine decision rules and well-known time series models. Our approach leverages techniques from stochastic programming, stochastic processes and robust optimization.
Starting with the pioneering work of Ben-Tal, Goryashko, Guslitzer, and Nemirovski (2004), adjustable robust optimization based on affine decision rules has emerged as a viable approach for dynamic problems where uncertainty is progressively revealed. The approach has been shown capable of finding good quality solutions to large multi-stage stochastic problems that would otherwise be unmanageable to traditional methods such as stochastic dynamic programming.
These techniques have been applied to the reservoir management problems with a varying degree of success. The authors of Apparigliato (2008) and Pan, Housh, Liu, Cai, and Chen (2015) use this framework to maximize the expected electric production for a multi-period and multi-reservoir hydro-electric complex while Gauvin et al. (2017) minimize the risk of floods by adopting a risk averse approach that explicitly considers the multidimensional nature of the problem subject to more realistic operating constraints.
Although some of these studies use elaborate decision rules based on works such as Chen, Sim, Sun, and Zhang (2008); Georghiou, Wiesemann, and Kuhn (2014); Goh and Sim (2010), they only consider very simplified representations of the underlying stochastic process and generally omit serial correlation. However, the importance of the persistence of inflows can play a crucial factor in hydrological modelling for stochastic optimization problems, particularly when daily inflows need to be considered. Authors like Pianosi and Soncini-Sessa (2009); Turgeon (2005) argue that serial correlation of high order is important to consider inflows that are high or low on many consecutive days and risk producing a flood or low baseflow.
This paper addresses the issue by developing a dynamic robust uncertainty set that takes into consideration the dynamic structure and serial correlation of the inflow process. We show that under certain conditions, these sets correspond to the support of the joint conditional distribution of uncorrelated random variables that determine the inflows over a given horizon. Our work shares similarities with the paper of Lorca and Sun (2015) who propose dynamic uncertainty sets based on time series models for a 2-stage economic dispatch problem in the presence of high wind penetration. Like these authors, we take advantage of the dynamic adaptability of the uncertainty sets by incorporating our model in a realistic simulation framework with rolling horizon.
Nonetheless, we give significantly more details on the construction of these uncertainty sets for general univariate ARMA models and provide key insights which are of value to practitioners and academics alike. We also consider the case of heteroscedasticity which is empirically observed in various inflow time series (Romanowicz, Young, & Beven, 2006). Although we minimize the risk of floods, our work can be directly extended to electricity generation, under the hypothesis that head is constant and that the production function can be modeled as a piecewise linear function.
Our model considers ARMA and GARCH models of any order without increasing the complexity of the problem. This is a huge improvement over stochastic dynamic programming (SDP) methods, which have historically been the most popular techniques used for reservoir management both in academia and in practice (see Castelletti, Pianosi, and Soncini-Sessa (2008); Labadie (2004); Turgeon (2005); Yeh (1985) and references therein). Although these methods can deal with more realistic non-convex optimization problems and provide excellent closed-loop policies, they can usually only consider serial correlation through autoregressive models of small order since higher order models require increasing the state-space, which quickly leads to numerical intractability; particularly for multi-reservoir operations (Cervellera, Chen, Wen, 2006, Tilmant, Kelman, 2007, Turgeon, 2007).
Considering heteroscedasticity further increases the state dimension and the resulting computational burden for SDP. As such, we are only aware of the work of Pianosi and Soncini-Sessa (2009) that is capable of considering this phenomenon with this methodology. Furthermore, these authors only manage to incorporate heteroscedasticity in a reduced model used for on-line computations.
Numerous refinements of classical SDP have emerged to circumvent some of these difficulties. Neuro-dynamic programming (Castelletti et al., 2010), sampling SDP (Stedinger & Faber, 2001) and more elaborate discretization schemes (Cervellera, Chen, Wen, 2006, Zéphyr, Lang, Lamond, Côté, 2016) have namely been applied successfully to large reservoir systems while explicitly or implicitely considering high order serial correlation. However, most of these methods still require simplifications of the river dynamics and inflow representation as well as discretization of decisions, which is not the case of our approach.
Other works based on SDP, such as Côté, Haguma, Leconte, and Krau (2011); Stedinger and Faber (2001); Tejada-Guibert, Johnson, and Stedinger (1995); Turgeon (2005), have focused on various low-dimensional hydrological variables such as seasonal forecasts, additional exogenous information like soil moisture and linear combinations of past inflows. Although these aggregate hydrological variables improve the solution quality without excessive computational requirements, they often rely on distributional assumptions such as normality that are not verified in practice or exogenous data that may be difficult to obtain. Our model does not suffer from such limitations.
In recent years, the stochastic dual dynamic programming (SDDP) method has emerged as an effective algorithm capable of successfully tackling multi-dimensional stochastic reservoirs problems (Gjelsvik, Mo, Haugstad, 2010, Pereira, Pinto, 1991, Phillpot, Guan, 2008, Rougé, Tilmant, 2016, Shapiro, Tekaya, da Costa, Soares, 2013, Tilmant, Kelman, 2007). Moreover, Maceira and Damázio (2004) illustrate that this method can consider multiple lag autoregressive processes without excessively increasing the size of the problem for the aggregated 4-state Brazilian hydro-thermal system. However, the algorithm can exhibit relatively slow convergence (Shapiro et al., 2013). To avoid this issue, various studies only consider a limited number of discrete scenarios ( < 100) (Rougé, Tilmant, 2016, Tilmant, Kelman, 2007), but this only leads to approximate solutions of questionable quality (Shapiro, 2011).
We also mention stochastic programming methods based on decision trees, which are also theoretically capable of explicitly handling highly persistent inflows (Carpentier, Gendreau, Bastin, 2013, Fleten, K.J, Näsäkkälä, 2011, Gonçalves, Gendreau, Finardi, 2013). These models are simple to implement when an existing deterministic model already exists and are intuitive to use and interpret. Unfortunately, they display exponential growth in complexity as a function of the time horizon. Therefore, they are usually limited to small decision trees. Gauvin et al. (2017) shows that these methods can be considerably more computationally intensive than corresponding stochastic programs based on decision rules.
The main advantage of our method with respect to SDDP and scenario-tree based stochastic program is its limited distributional assumptions. Whereas these competing methods requires using specific distributions from which it is possible to sample, our approach only demands hypothesis on the first 2 moments of the random variables as well as the correlation between them. As observed by Pan et al. (2015), this is likely to lead to solutions that are more robust when tested on out-of-sample scenarios, which is of prime concern when data availability is limited. Another shortcoming of SDDP and tree-based stochastic programming compared with decision rules and SDP are their inability to provide explicit policies that can be directly used by decision makers. Nonetheless, this is usually not a critical point, particularly when rolling horizon simulations are considered.
The paper is structured as follows. The model for the deterministic reservoir management problem and the stochastic version based on affine decision rules are presented in Section (2). Section (3) discusses inflow representation and general univariate ARMA models and the resulting conditional supports. It then studies heteroscedastic time series and their impact on the model formulation. Section (4) explains the solution procedure and simulation framework while Section (5) studies a river in western Québec. Conclusions are drawn in Section (6).
The sets and represent the non-negative and non-positive integers while is the cone of square n × n semi-definite matrices. The set represents the entire horizon of T periods and denotes a limited look-ahead horizon for some L < T.
Let be a filtered probability space where is a collection of σ-algebras representing some information available at time where and . We let E[ · ] denote mathematical expectation while represents conditional expectation given any σ-algebra . Both expectations are taken with respect to the base probability measure on .
For the real random variables X, σ(X) represents the σ-algebra generated by X (Billingsley, 1995). We abuse language and refer to the support of X as the smallest closed set on which X takes values with probability one. For any discrete time real valued stochastic process we denote the valued random vector for any and with the special notation if . For simplicity, we abuse notation and do not distinguish a random variable from a given realization.
Section snippets
Deterministic look-ahead model for flood minimization
Before describing our stochastic reservoir management problem with affine decision rules, we describe the deterministic version. A similar model is described in Gauvin et al. (2017), but we present it here to make the paper self-contained. We write the problem in a “look-ahead” form to facilitate its integration in the rolling horizon framework presented in Section (4).
At the beginning of time we seek a vector of decisions for each future time that will minimize a coarse
General inflow representation
The quality of the solutions returned by solving the lookahead problem SPt crucially depends on the representation of the underlying stochastic process {ξt}. Assuming simple independent time series will likely lead to poor quality solutions in the presence of significant serial correlation. However, we also want to maintain the tractability of the overall linear program considering affine decision rules.
In order to achieve these conflicting objectives, we assume that at the beginning of each
Monte Carlo simulation and rolling horizon framework
Solving the stochastic version of problem (1a)–(1j) with affine decision rules at the beginning of time 1 for provides an upper bound on the value of the “true” problem over the horizon when various hypotheses on ϱt and ξt are verified. However, simulating the behaviour of the system with a given distribution can give a better assessment of the real performance of these decisions. Using random variables that violate the support assumptions also provides interesting robustness tests.
The river system
We apply our methodology to the Gatineau river in Québec. This hydro electrical complex is part of the larger Outaouais river basin and is managed by Hydro-Qu ebec, the largest hydroelectricity producer in Canada (Hydro-Québec, 2012). It is composed of 3 run-of-the-river plants with relatively small productive capacity and 5 reservoirs, of which only Baskatong and Cabonga have significant capacity (see Fig. 2).
The Gatineau represents an excellent case study as it runs near the small town of
Conclusion
In conclusion, we illustrate the importance and value of considering the persistence of inflows for the reservoir management problem. Repeatedly solving a simple data-driven stochastic lookahead model using affine decision rules and ARMA and GARCH time series model provides good quality solutions for a problem that would otherwise be intractable for classical SDP and that would require considerably more distributional assumptions for SDDP or tree-based stochastic programming.
We give detailed
Acknowledgments
The authors would like to thank Charles Audet, Fabian Bastin, Angelos Georghiou, Stein-Erick Fleten and Amaury Tilmant for valuable discussion as well as everyone at Hydro-Quẽbec and IREQ for their ongoing support, particularly Grégory Émiel, Louis Delorme, Laura Fagherazzi and Pierre-Marc Rondeau. The comments of two anonymous referees also greatly improved the quality of this paper. This research was supported by the Natural Sciences and Engineering Reasearch Council of Canada (NSERC) and
References (62)
- et al.
Shortfall as a risk measure: Properties, optimization and applications
Journal of Economic Dynamics and Control
(2004) Generalized autoregressive conditional heteroskedasticity
Journal of Econometrics
(1986)- et al.
Data-driven dynamic emulation modelling for the optimal management of environmental systems
Environmental Modelling & Software
(2012) - et al.
Optimization of a large-scale water reservoir network by stochastic dynamic programming with efficient state space discretization
European Journal of Operational Research
(2006) - et al.
A linear decision-based approximation approach to stochastic programming
Operations Research
(2008) - et al.
Generalized decision rule approximations for stochastic programming via liftings
Mathematical Programming
(2014) - et al.
A forecast comparison of volatility models: does anything beat a Garch(1,1)?
Journal of Applied Econometrics
(2005) - et al.
Robust stochastic optimization for reservoir operation
Water Resources Research
(2015) - et al.
Data assimilation and adaptive forecasting of water levels in the river Severn catchment, United Kingdom
Water Resources Research
(2006) - et al.
Using stochastic dual dynamic programming in problems with multiple near-optimal solutions
Water Resources Research
(2016)
The price of robustness
Operations Research
The value of hydrologic information in stochastic dynamic programming models of a multireservoir system
Water Resources Research
Information theory and an extension of the maximum likelihood principle
Règles de décision pour la gestion du risque: Application à la gestion hebdomadaire de la production électrique
Robust optimization
Adjustable robust solutions of uncertain linear programs
Mathematical Programming
Probability and measure
Time series analysis: Forecasting and control
Time series: Theory and methods
Long-term management of a hydroelectric multireservoir system under uncertainty using the progressive hedging algorithm
Water Resources Research
Tree-based reinforcement learning for optimal water reservoir operation
Water Resources Research
Water reservoir control under economic, social and environmental constraints
Automatica
Stochastic optimisationof hydro-Quebec hydropower installations: A statistical comparison between SDP and SSDP methods
Revue canadienne de génie civil
Robust multi-stagedecision making
Tutorials in Operations Research
Computational complexity of stochastic programming problems
Mathematical Programming Series A
Handbook of integrated risk management in global supply chains
Optimal real-time operation of multipurpose urban reservoirs: Case study in Singapore
Journal of Water Resources Planning and Management
A Garch forecasting model to predict day-ahead electricity prices
IEEE Transactions on Power Systems
Decision rule approximations for the risk averse reservoir management problem
European Journal of Operational Research
Long- and medium-term operations planning and stochastic modelling in hydro-dominated power systems based on stochastic dual dynamic programming
Distributionally robust optimization and its tractable approximations
Operations Research
Cited by (13)
Multistage adaptive robust optimization for the hydrothermal scheduling problem
2023, Computers and Operations ResearchCascade hydropower station risk operation under the condition of inflow uncertainty
2022, EnergyCitation Excerpt :In traditional reservoir operation plans, the inflow is treated as a certain sequence. However, in the actual reservoir operation process, the inflow of the reservoir is stochastic and uncertain in nature [4,5]. Adopting a deterministic inflow of the reservoir will inevitably lead to a significant difference between the actual and planned operation process under uncertainty of inflow.
Deep decarbonization in Northeastern North America: The value of electricity market integration and hydropower
2021, Energy PolicyCitation Excerpt :Whereas aggregation methods reduce the model complexity, they tend to overestimate the operational flexibility of multireservoir systems,1 which is a critical aspect in deep decarbonization studies (Härtel and Korpås, 2017). Quebec's hydropower complex consists in several interdependent reservoirs, whose actual operation involves multiple operational and environmental constraints (Gauvin et al., 2018). Rather than exactly reproducing all the operational aspects of this system, we explicitly represent its main reservoirs in order to reduce our model complexity while achieving a good approximation of its generation flexibility and energy storage capacity.
A Planner-Trader Decomposition for Multimarket Hydro Scheduling
2024, Operations Research