Skip to main content

Advertisement

Log in

Statistical estimation of operating reserve requirements using rolling horizon stochastic optimization

  • Original - OR Modeling/Case Study
  • Published:
Annals of Operations Research Aims and scope Submit manuscript

Abstract

We develop a multi-period stochastic optimization framework for identifying operating reserve requirements in power systems with significant penetration of renewable energy resources. Our model captures different types of operating reserves, uncertainty in renewable energy generation and demand, and differences in generator operation time scales. Along with planning for reserve capacity, our model is designed to provide recommendations about base-load generation in a non-anticipative manner, while power network and reserve utilization decisions are made in an adaptive manner. We propose a rolling horizon framework with look-ahead approximation in which the optimization problem can be written as a two-stage stochastic linear program (2-SLP) in each time period. Our 2-SLPs are solved using a sequential sampling method, stochastic decomposition, which has been shown to be effective for power system optimization. Further, as market operations impose strict time requirements for providing dispatch decisions, we propose a warm-starting mechanism to speed up this algorithm. Our experimental results, based on IEEE test systems, establish the value of our stochastic approach when compared both to deterministic rules from the literature and to current practice. The resulting computational improvements demonstrate the applicability of our approach to real power systems.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

Notes

  1. This is in contrast to the forecasted net-demand \({\widehat{L}}_{tn}\) that appears in (6) which is a deterministic quantity.

  2. The ramping constraints in (2b) are written for the fine timescale of the model. For the look-ahead time periods, these constraints need to be modified to reflect ramp limits over the look-ahead resolution. For example, when the look-ahead resolution is the same as coarse timescale, the ramp-up and ramp-down limits will be \(N\times \Delta G_i^{f,max}\) and \(N\times \Delta G_i^{f,min}\), respectively.

  3. For brevity, we do not present our implementation details in the paper and refer the reader to our source code available at https://github.com/jac0320/rollingSD.

References

  • Ahmadi-Khatir, A., Conejo, A. J., & Cherkaoui, R. (2014). Multi-area unit scheduling and reserve allocation under wind power uncertainty. IEEE Transactions on Power Systems, 29(4), 1701–1710.

    Google Scholar 

  • Atakan, S., Gangammanavar, H., & Sen, S. (2019). Operations planning experiments for power systems with high renewable resources. Technical report, Southern Methodist University.

  • Birge, J. R., & Louveaux, F. (2011). Introduction to stochastic programming. Springer series in operations research and financial engineering. New York: Springer.

  • Bouffard, F., & Galiana, F. D. (2004). An electricity market with a probabilistic spinning reserve criterion. IEEE Transactions on Power Systems, 19(1), 300–307.

    Google Scholar 

  • Brown, B. G., Katz, R. W., & Murphy, A. H. (1984). Time series models to simulate and forecast wind speed and wind power. Journal of Climate and Applied Meteorology, 23(8), 1184–1195.

    Google Scholar 

  • Chattopadhyay, D., & Baldick, R. (2002). Unit commitment with probabilistic reserve. In Power engineering society winter meeting (Vol. 1, pp. 280–285). IEEE.

  • Cleveland, R. B., Cleveland, W. S., & Terpenning, I. (1990). Stl: A seasonal-trend decomposition procedure based on loess. Journal of Official Statistics, 6(1), 3.

    Google Scholar 

  • Dantzig, G. B., & Wolfe, P. (1960). Decomposition principle for linear programs. Operations Research, 8(1), 101–111.

    Google Scholar 

  • Dvorkin, Y., Pandžić, H., Ortega-Vazquez, M. A., & Kirschen, D. S. (2015). A hybrid stochastic/interval approach to transmission-constrained unit commitment. IEEE Transactions on Power Systems, 30(2), 621–631.

    Google Scholar 

  • Erik, E., Milligan, M., & Kirby, B. (2011). Operating reserves and variable generation. NREL technical report.

  • Gangammanavar, H., & Sen, S. (2019). Stochastic dynamic linear programming: A sampling based algorithm for multistage programs. Technical report, Southern Methodist University.

  • Gangammanavar, H., Liu, Y., & Sen, S. (2019). Stochastic decomposition for two-stage stochastic linear programs with random cost coefficients. INFORMS Journal on Computing (accepted).

  • Gangammanavar, H., Sen, S., & Zavala, V. M. (2016). Stochastic optimization of sub-hourly economic dispatch with wind energy. IEEE Transactions on Power Systems, 31(2), 949–959.

    Google Scholar 

  • Grigg, C., Wong, P., Albrecht, P., Allan, R., Bhavaraju, M., Billinton, R., et al. (1999). The IEEE reliability test system-1996. A report prepared by the reliability test system task force of the application of probability methods subcommittee. IEEE Transactions on Power Systems, 14(3), 1010–1020.

    Google Scholar 

  • Hamilton, J. D. (1994). Time series analysis (Vol. 2). Princeton: Princeton University Press.

    Google Scholar 

  • Higle, J. L., & Sen, S. (1994). Finite master programs in regularized stochastic decomposition. Mathematical Programming, 67(1–3), 143–168.

    Google Scholar 

  • Higle, J. L., & Sen, S. (1996). Stochastic decomposition: A statistical method for large scale stochastic linear programming. Boston: Kluwer Academic Publishers.

    Google Scholar 

  • Kwiatkowski, D., Phillips, P. C., Schmidt, P., & Shin, Y. (1992). Testing the null hypothesis of stationarity against the alternative of a unit root: How sure are we that economic time series have a unit root? Journal of Econometrics, 54(1–3), 159–178.

    Google Scholar 

  • Linderoth, J., Shapiro, A., & Wright, S. (2006). The empirical behavior of sampling methods for stochastic programming. Annals of Operations Research, 142(1), 215–241.

    Google Scholar 

  • Makarov, Y., Guttromson, R., Huang, Z., Subbarao, K., Etingov, P., Chakrabarti, B., & Ma, J. (2010). Incorporating wind generation and load forecast uncertainties into power grid operations. Report PNNL-19189. PNNL.

  • Morales, J., Minguez, R., & Conejo, A. (2010). A methodology to generate statistically dependent wind speed scenarios. Applied Energy, 87(3), 843–855.

    Google Scholar 

  • Motto, A. L., Galiana, F. D., Conejo, A. J., & Arroyo, J. M. (2002). Network-constrained multiperiod auction for a pool-based electricity market. IEEE Transactions on Power Systems, 17(3), 646–653.

    Google Scholar 

  • Olson, A., Mahone, A., Hart, E., Hargreaves, J., Jones, R., Schlag, N., et al. (2015). Halfway there: Can California achieve a 50% renewable grid? IEEE Power and Energy Magazine, 13(4), 41–52.

    Google Scholar 

  • Ortega-Vazquez, M. A., & Kirschen, D. S. (2009). Estimating the spinning reserve requirements in systems with significant wind power generation penetration. IEEE Transactions on Power Systems, 24(1), 114–124.

    Google Scholar 

  • Papavasiliou, A., & Oren, S. (2013). Multiarea stochastic unit commitment for high wind penetration in a transmission constrained network. Operations Research, 61(3), 578–592.

    Google Scholar 

  • Papavasiliou, A., Oren, S., & O’Neill, R. (2011). Reserve requirements for wind power integration: A scenario-based stochastic programming framework. IEEE Transactions on Power Systems, 26(4), 2197–2206.

    Google Scholar 

  • Potter, C. W., Lew, D., McCaa, J., Cheng, S., Eichelberger, S., & Grimit, E. (2008). Creating the dataset for the western wind and solar integration study (U.S.A.). Wind Engineering, 32(4), 325–338.

    Google Scholar 

  • Powers, J. G., Klemp, J. B., Skamarock, W. C., Davis, C. A., Dudhia, J., Gill, D. O., et al. (2017). The weather research and forecasting model: Overview, system efforts, and future directions. Bulletin of the American Meteorological Society, 98(8), 1717–1737.

    Google Scholar 

  • Price, J. E. (2015). Evaluation of stochastic unit commitment for renewable integration in California’s energy markets. In 2015 IEEE power & energy society general meeting (pp. 1–5). IEEE.

  • Rockafellar, R. T., & Wets, R. J. B. (1991). Scenarios and policy aggregation in optimization under uncertainty. Mathematics of Operations Research, 16(1), 119–147.

    Google Scholar 

  • Sen, S., & Liu, Y. (2016). Mitigating uncertainty via compromise decisions in two-stage stochastic linear programming: Variance reduction. Operations Research, 64(6), 1422–1437.

    Google Scholar 

  • Sen, S., Yu, L., & Genc, T. (2006). A stochastic programming approach to power portfolio optimization. Operations Research, 54(1), 55–72.

    Google Scholar 

  • Shapiro, A., Dentcheva, D., & Ruszczynski, A. (2014). Lectures on stochastic programming: Modeling and theory (2nd ed.). Philadelphia: Society for Industrial and Applied Mathematics.

    Google Scholar 

  • Tsai, H., & Chan, K. S. (2007). A note on non-negative ARMA processes. Journal of Time Series Analysis, 28(3), 350–360.

    Google Scholar 

  • Tsay, R. (2005). Analysis of financial time series (2nd ed.). Wiley series in probability and statistics. Hoboken: Wiley.

  • Van Slyke, R. M., & Wets, R. J. B. (1969). L-shaped linear programs with applications to optimal control and stochastic programming. SIAM Journal on Applied Mathematics, 17(4), 638–663.

    Google Scholar 

  • Zavala, V. M. (2016). New architectures for hierarchical predictive control. IFAC-PapersOnline, 49(7), 43–48.

    Google Scholar 

  • Zheng, Q. P., Wang, J., & Liu, A. L. (2015). Stochastic optimization for unit commitment—A review. IEEE Transactions on Power Systems, 30(4), 1913–1924.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Harsha Gangammanavar.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Appendices

Statistical model of uncertainty

Wind power at any wind farm location can be described as a stochastic process. This process exhibits spatial correlation with processes describing wind power at other geographically separated wind farm locations. These processes are also temporally correlated across several time periods. Hence an appropriate description of these stochastic processes requires recognizing the spatio-temporal correlations of these processes.

The available wind power data is pre-processed by identifying the trend and seasonality. The seasonal-trend decomposition procedure based on loses [STL, Cleveland et al. (1990)] is an appropriate method to achieve this. Once trend and seasonality is estimated, they are subtracted from the original time-series to obtain the residual time-series. Before proceeding, it is necessary to verify if this residual series is stationary. The Augmented Dick–Fuller test and KPSS test were used for this purpose (Hamilton 1994). One possible choice to model a stationary time-series is the multivariate ARMA process shown in (12). A multivariate ARMA models was fitted using the MTS package (Tsay 2005) in R. The order selection is based on Bayesian information criterion (BIC) as it is most suitable for data with limited length. The validity of the model is verified by checking the cross-covariance and correlation functions, and the whiteness of the residual process is verified using the Ljung–Box test.

Recall that our optimization framework relies upon a constant stream of simulated scenarios. The fitted ARMA model is used for this purpose. The simulation is carried out at fine timescale within the decision epoch \(t\in \mathcal {T}\). Recall that we introduce time index \(\tau \) in Sect. 2.5 to unify different time scales. At corresponding time index \(\tau \) at time period \(t\in \mathcal {T}\), we used historical data from time period \((\tau -1)\) as known information for this simulation (the red time series in Fig. 4). Once a residual time series is simulated, the estimated trend and seasonality is added back to obtain the wind power time series (the blue time series in Fig. 4). It should be noted that it is possible to obtain negative wind power values (particularly when trend values are small) using the above procedure. In order to address this, we truncate the simulated time series at zero: \({\widetilde{W}}_{\tau } = \eta _{\tau } + {\tilde{\omega }}_{\tau } + \kappa _{\tau }\), where \(\kappa _{\tau } > 0\) when the simulated output is negative. It is necessary to emphasize the difficulty in constructing stationary processes with non-negative outcomes. There exists limited theoretical results in Tsai and Chan (2007) to address this. However, we enforce non-negativity as part of our algorithm in order to ensure model and algorithm validity.

While our presentation in this paper revolves around stationary residual processes, non-stationary processes can also be accommodated within our framework. In this sense, the proposed method is applicable in conjunction with any external simulator [e.g., the Weather Research and Forecasting model (Powers et al. 2017)].

Notations

We will use \(t\in \mathcal {T}\) to index the decision epochs and \(n\in \mathcal {N}\) to index the fine time periods within decision epoch t.

Sets

\(\mathcal {B}\) :

Buses

\(\mathcal {L}\) :

Transmission lines

\(\mathcal {D}\) :

Demand nodes

\(\mathcal {W}\) :

Renewable generators

\(\mathcal {G}^{B}\) :

Base-load generators

\(\mathcal {G}^{F}/\mathcal {G}^{S}/\mathcal {G}^{R}\) :

following/regulating/ramping reserves.

Stochastic processes

\({\hat{L}}_{tni}/{\widetilde{L}}_{tni}\) :

Forecast/actual demand (MW) at \(i \in \mathcal {D}\)

\({\widehat{W}}_{tni}/{\widetilde{W}}_{tni}\) :

Forecast/actual renewable generation (MW) at \(i\in \mathcal {W}\)

\({\tilde{\omega }}_{t}\) :

Consolidated random vector

\(\eta _{t}\) :

Trend time series.

Parameters

\(V_{i}\) :

voltage (kV) of bus \(i\in \mathcal {B}\)

\(X_{ij}\) :

Reactance of transmission line \((i,j)\in \mathcal {L}\)

\(c^{b}_{i}\) :

Unit generation (MW) cost of \(i\in \mathcal {G}^{B}\)

\(c^{f}_{i}\) :

Unit generation (MW) cost of \(i\in \mathcal {G}^{F}\)

\(c^{s}_{i}\) :

Unit generation (MW) cost of up-front dispatch \(i\in \mathcal {G}^{S}\)

\(c^{p}_{i}\) :

Unit cost of planning regulating service (MW) on \(i\in \mathcal {G}^{S}\)

\(d^{s}_{i}\) :

Unit cost of utilizing (MW) \(i\in \mathcal {G}^{S}\)

\(d^{r}_{i}\) :

Unit cost of utilizing (MW) \(i\in \mathcal {G}^{R}\)

\(\Delta {\hat{L}}^{tni}\) :

Net-demand (MW) base on available forecast of \(i\in \mathcal {D}\)

\(p^{min},p^{max}\) :

Transmission line limitations (MW)

\(\theta ^{min},\theta ^{max}\) :

Voltage angle limitations

\(G_{i}^{b,min}\),\(G_{i}^{b,max}\):

Min and max capacity (MW) of \(i\in \mathcal {G}^{B}\)

\(G_{i}^{f,min}\),\(G_{i}^{f,max}\):

Min and max capacity (MW) of \(i\in \mathcal {G}^{F}\)

\(G_{i}^{s,min}\),\(G_{i}^{s,max}\):

Min and max capacity (MW) of \(i\in \mathcal {G}^{S}\)

\(\Delta G_{i}^{b,max}\),\(\Delta G_{i}^{b,min}\):

Up- and down-ramping limits of \(i\in \mathcal {G}^{B}\)

\(\Delta G_{i}^{f,max}\),\(\Delta G_{i}^{f,min}\):

Up- and down-ramping limits of \(i\in \mathcal {G}^{F}\)

\(\Delta G_{i}^{s,max}\),\(\Delta G_{i}^{s,min}\):

Up- and down-ramping limits of \(i\in \mathcal {G}^{S}\).

Decision variables

\(x^{b}_{ti}\) :

Base-load generation (MW) at \(i\in \mathcal {G}^{B}\)

\(x^{f}_{tni}\) :

Following reserve generation (MW) at \(i\in \mathcal {G}^{F}\)

\(x^{s}_{ti}\) :

Up-front dispatch (MW) at \(i\in \mathcal {G}^{S}\)

\(x^{p+}_{ti}\) :

Planned regulating-up service (MW) at \(i\in \mathcal {G}^{S}\)

\(x^{p-}_{ti}\) :

Planned regulating-down service (MW) at \(i\in \mathcal {G}^{S}\)

\(p_{tnij}\) :

Power flow (MW) on line \((i,j)\in \mathcal {L}\)

\(\theta _{tni}\) :

Voltage angle at \(i\in \mathcal {B}\)

\(u^{s}_{tni}\) :

Utilization spinning reserves (MW) \(i\in \mathcal {G}^{S}\)

\(u^{r}_{tni}\) :

Utilization of ramping reserve (MW) \(i\in \mathcal {G}^{R}\)

\(x_{t}\) :

Consolidated first-stage decision vector \(=[(x_{ti}^{b})_{i\in \mathcal {G}^{B}},(x_{ti}^{f})_{i\in \mathcal {G}^{F}},(x_{ti}^{s})_{i\in \mathcal {G}^{S}},(x_{ti}^{p})_{i\in \mathcal {G}^{S}}]\))

\(y_{t}\) :

Consolidated second-stage decision vector \(=[(p_{tnij})_{(i,j)\in \mathcal {L}}, (\theta _{tni})_{i\in \mathcal {B}},(u_{tni}^{s})_{i\in \mathcal {G}^{S}},(u_{tni}^{r})_{i\in \mathcal {G}^{R}}]\))

\(s_{t}\) :

State variable (\(=[x_{t-1},y_{t-1}({\bar{\omega }}_{t-1})]\)).

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wang, S., Gangammanavar, H., Ekşioğlu, S. et al. Statistical estimation of operating reserve requirements using rolling horizon stochastic optimization. Ann Oper Res 292, 371–397 (2020). https://doi.org/10.1007/s10479-019-03482-x

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10479-019-03482-x

Keywords

Navigation