Stochastics and Statistics
A stochastic multiscale model for electricity generation capacity expansion

https://doi.org/10.1016/j.ejor.2013.07.022Get rights and content

Abstract

Long-term planning for electric power systems, or capacity expansion, has traditionally been modeled using simplified models or heuristics to approximate the short-term dynamics. However, current trends such as increasing penetration of intermittent renewable generation and increased demand response requires a coupling of both the long and short term dynamics. We present an efficient method for coupling multiple temporal scales using the framework of singular perturbation theory for the control of Markov processes in continuous time. We show that the uncertainties that exist in many energy planning problems, in particular load demand uncertainty and uncertainties in generation availability, can be captured with a multiscale model. We then use a dimensionality reduction technique, which is valid if the scale separation present in the model is large enough, to derive a computationally tractable model. We show that both wind data and electricity demand data do exhibit sufficient scale separation. A numerical example using real data and a finite difference approximation of the Hamilton–Jacobi–Bellman equation is used to illustrate the proposed method. We compare the results of our approximate model with those of the exact model. We also show that the proposed approximation outperforms a commonly used heuristic used in capacity expansion models.

Introduction

The general problem of capacity expansion under uncertainty has been extensively studied both as a stochastic optimal control problem as well as a multistage stochastic programming problem. In many ways it is a prototypical example of an optimal control problem; as a result, it has been studied since the late 1950s (Luss, 1982). For electric power systems, long-term investment (capacity expansion) and short-term operations (generation dispatch and unit commitment) were traditionally treated as decoupled decisions, and numerical models of long-term planning used highly simplified models and heuristics to represent the short-term dynamics.

However, the environment in which generation capacity expansion decisions are being made is becoming increasingly complex. This complexity is driven in part by increasing pressure placed on the electricity industry to address the problem of meeting the projected growth in demand in a sustainable manner, including increased reliance on intermittent renewable generation and increased demand–response mechanisms. The variability on the short time scale has important implications for the optimal portfolio of technologies that should be built in the long-run. For example, more intermittent generation will require other dispatchable technologies such as natural gas generation that can ramp up or down quickly. The conventional simplifications in long-term models will not capture this effect and will lead to suboptimal investment strategies (Palmintier & Webster, 2011). Moreover the deregulation of the electricity industry means that utilities cannot pass on the risks of investment decisions to customers. Consequently advanced models are needed in order to capture the complexities of the new decision making environment. The model of the full system, explicitly resolving both short-term (e.g., hourly) and long-term (e.g., annual or decadal) time scales along with the stochastic processes associated with each, would be computationally intractable for any system of realistic size.

In this paper, we present an efficient method for coupling the multiple temporal scales in the capacity expansion problem using the framework of singular perturbation theory for the control of continuous time problems. We demonstrate that for power systems the relevant stochastic processes are highly structured in ways that can be exploited. In particular load demand uncertainty and uncertainties in generation availability can be accurately modeled using weakly connected Markov processes. We take advantage of the properties of weakly connected processes in order to perform dimensionality reduction on the original model and therefore allows useful computation to be performed.

To make operational the uncertainty structures present in this class of problems we make use of the tools from singular perturbation theory for Finite State Markov Processes (FSMPs) in continuous time. In some respects some models already take advantage of this structure. For example, the widely used MARKAL model (Seebregts, Goldstein, & Smekens, 2001) uses the concept of a “load block” to overcome the onerous requirement of optimizing over all possible loads. Similarly (Palmintier & Webster, 2011) simplify an integrated unit commitment and capacity expansion model by aggregating different power generators together. These types of aggregation approaches can be useful in practice. However, it is also important to understand why heuristics work, when they fail, and what can be done instead. For example, it is not clear how to extend the concept of a “typical” load to handle wind intermittency, or demand elasticity (a major objective of demand response programs). Instead we use perturbation methods to derive an “aggregate” model based on the assumption that the fast processes in our system (e.g wind, demand uncertainty) follow their stationary distribution. The computational complexity of the aggregate model is much less then the exact model and based on initial numerical experiments the error associated with the solution is much less then the existing heuristics used in MARKAL.

The contributions of this paper can be summarized as follows:

  • 1.

    We formulate the problem of energy planning over multiple scales as a stochastic optimal control problem with weakly interacting FSMPs. We then extend and adapt some existing results from the literature of singular perturbation theory to derive an approximate problem that is computationally more attractive than the original problem. We also establish the conditions under which the approximate problem will yield the same value function as the original problem.

  • 2.

    We formalize the heuristics of widely used models such as MARKAL. Existing models are based on the assumption that the Markov processes that describe the stochastic intraday dynamics of power systems are regularly perturbed. This assumption is not supported by the data. We show how to relax this assumption, using standard results from singular perturbation theory.

  • 3.

    We demonstrate the application of this approach using empirical observations. As our approach is based on perturbation theory, we need to make assumptions about the existence of sufficient scale separation. As will be shown in this paper, there is sufficient evidence to suggest that such scale separation is present in the data. We expect some of the statistical techniques we use to be useful in other problem classes as well.

The rest of this paper is structured as follows: in the next section we discuss related literature and outline in more detail the contributions of this paper. In Section 3 we introduce our capacity expansion model and discuss some of its properties. In Section 3.1 we reinforce the arguments that motivated this paper by looking at some real data. In Section 3.2 we review perturbation theory in the context of multiscale Markov processes and link our assumptions with the empirical observations of Section 3.1. We also show that existing models do not capture the correct asymptotic behavior of the uncertainties present in the intraday scale. In Section 4 we introduce an aggregate problem, and show that asymptotically the value function of the approximate problem converges to the value function of the original problem. We also establish the same result for the approximate optimal control. In Section 5 we illustrate how the proposed approach could be implemented in practice. We compare the results of the approximate model with those of the exact model. We also show that the proposed approximation outperforms a commonly used heuristic used in large models.

Section snippets

Related literature and contributions

Capacity expansion problems have generated a large amount of literature. This is mainly because expansion problems are applicable to many areas and also because they are a good testbed for new modeling ideas. We will only discuss models that address the effect of the different time scales. Even though some of the work discussed below does not address capacity expansion directly, we believe that the most relevant papers to this work are the ones that address multiple scales since their ideas

A capacity expansion model

Before we delve into the details of the model, we first motivate our construction by looking at the characteristics of hourly electricity demand data (Section 3.1). In Section 5.1 we show that wind speed time series have the same structure, and thus are amenable to the same techniques. To keep the paper short we will only discuss demand data. In Section 3.2 we show that the assumptions made by existing power systems models can be explained in terms of perturbation theory. The exact, but

The aggregate model

In this section we derive the limiting problem for H as ↓0. We show that the asymptotic value function of H corresponds to a value function of an aggregate model. We also show how to construct asymptotically optimal controls from the aggregate model.

For the application considered in this paper, it is sufficient to assume that each ηi(,t), i = 1,  , N, has the same generator both before and after it has been expanded. Thus only the states may be different, the transition probabilities remain the

Numerical experiments

In this section we describe a numerical implementation of the theory presented above. Our aim is to compare the aggregate with the exact model. For this reason we will only consider a small problem so that the exact problem is tractable. The problem we consider requires the solution of a five dimensional non-linear PDE, still a non-trivial problem by any means. We do however show that using the aggregate model we can reduce the computation time without introducing any significant deterioration

Conclusions

We introduced a stochastic multiscale model that can be used for generation capacity expansion planning in the power systems sector. This class of models has stochastic dynamics that evolve over multiple temporal and spatial scales. Due to the computational challenges involved with simulating and optimizing integrated multiscale models, energy system models have been hitherto treated with each scale decoupled and interactions between scales ignored. However, with the introduction of new

Acknowledgement

The authors wish to acknowledge the two anonymous referees for their helpful comments that led to substantial improvements of the paper. The work of the first author was partially supported by a FP7 Marie Curie Career Integration Grant (PCIG11-GA-2012-321698 SOC-MP-ES) and by the Cyprus Program at MIT Energy Initiative. The work of the second author was supported by the U.S. National Science Foundation Grant No. 1128147 and by the US Department of Energy Office of Science, Biological and

References (32)

  • L. Arnold

    Random dynamical systems

    (1998)
  • M. Bardi et al.

    Optimal control and viscosity solutions of Hamilton–Jacobi–Bellman equations

    (1997)
  • W. Briggs et al.

    A multigrid tutorial

    Society for industrial mathematics

    (2000)
  • D. Crommelin et al.

    Data-based inference of generators for Markov jump processes using convex optimization

    Multiscale Modeling & Simulation

    (2009)
  • EIA (2009). U.S. Energy Information Administration....
  • A. Epe et al.

    Optimization of dispersed energy supply – stochastic programming with recombining scenario trees

    Optimization in the Energy Industry

    (2009)
  • IEA, N. (2005). Projected costs of generating electricity 2005...
  • M. Ilic et al.

    Hierarchical power systems control: its value in a changing industry

    (1996)
  • J. Jiang et al.

    A state aggregation approach to manufacturing systems having machine states with weak and strong interactions

    Operations Research

    (1991)
  • P. Kokotović et al.

    Singular perturbation methods in control: analysis and design

    Society for industrial mathematics

    (1999)
  • H. Kushner et al.

    Numerical methods for stochastic control problems in continuous time

    (2001)
  • H. Luss

    Operations research and capacity expansion problems: A survey

    Operations Research

    (1982)
  • G. Masters

    Renewable and efficient electric power systems

    (2004)
  • Nadler, B., Lafon, S., Coifman, R., & Kevrekidis, I. (2005). Diffusion maps, spectral clustering and eigenfunctions of...
  • NCDC (2009). National Climatic Data Center....
  • B. Øksendal et al.

    Applied stochastic control of jump diffusions

    second ed

    (2007)
  • Cited by (0)

    View full text