Skip to main content
Log in

On the number of stages in multistage stochastic programs

  • S.I.: Stochastic Optimization:Theory&Applications in Memory of M.Bertocchi
  • Published:
Annals of Operations Research Aims and scope Submit manuscript

Abstract

Multistage stochastic programs serve to make sequential decisions conditional on a gradual realization of some stochastic process. The progressive arrival of new information divides a problem into stages. As the number of stages increases, however, the applicability of stochastic programming is halted by the curse of dimensionality. A commonly used approximation is obtained by replacing the random parameters by their expected values, which results in a problem with fewer stages. The present paper suggests metrics to support the choice of the number of stages: The value of an extended expected value (EV) problem which accounts for stochastic approximations, the Expected result of using the expected value solution (EEV), the value of the stochastic solution, and the values of two Wait-and-See (WS) approximations. We show that for linear minimization problems with random right-hand-side, the value of the EV problem provides a lower bound that improves with the number of stages. The same holds for the WS approximations for general linear minimization problems and with one of the approximations improving the EV bound. In contrast, we show that the upper bound provided by the EV solution may not improve with the number of stages. Finally, we define the marginal benefit of including an additional stage in an EV approximation and demonstrate how to use it in a heuristic. We apply our approach to a hedging problem and confirm that increasing the number of stages does not necessarily foster better decisions.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2

Similar content being viewed by others

Notes

  1. We define \(A_{0,1}\) to be a matrix of zeros such that the constraints of stage 1 are \(A_{1,1}x_{1}=b_{1}\).

  2. The instances are available at the following address https://sid.erda.dk/sharelink/ecTlLZXJDP.

  3. Assuming a scenario formulation is used instead of the node formulation in (2), the difference is the number of non-anticipativity constraints.

References

  • Ahmed, S., King, A., & Parija, G. (2003). A multi-stage stochastic integer programming approach for capacity expansion under uncertainty. Journal of Global Optimization, 26(1), 3–24.

    Google Scholar 

  • Alonso, A., Escudero, L. F., & Ortuño, M. T. (2000). A stochastic 0–1 program based approach for the air traffic flow management problem. European Journal of Operational Research, 120(1), 47–62.

    Google Scholar 

  • Bakkehaug, R., Eidem, E. S., Fagerholt, K., & Hvattum, L. M. (2014). A stochastic programming formulation for strategic fleet renewal in shipping. Transportation Research Part E: Logistics and Transportation Review, 72, 60–76.

    Google Scholar 

  • Birge, J. R. (1982). The value of the stochastic solution in stochastic linear programs with fixed recourse. Mathematical Programming, 24(1), 314–325.

    Google Scholar 

  • Birge, J. R. (1985). Decomposition and partitioning methods for multistage stochastic linear programs. Operations Research, 33(5), 989–1007.

    Google Scholar 

  • Birge, J. R., & Louveaux, F. (1997). Introduction to stochastic programming. New York: Springer.

    Google Scholar 

  • Cariño, D. R., Kent, T., Myers, D. H., Stacy, C., Sylvanus, M., Turner, A. L., et al. (1994). The Russell-Yasuda Kasai model: An asset/liability model for a Japanese insurance company using multistage stochastic programming. Interfaces, 24(1), 29–49.

    Google Scholar 

  • Crainic, G., Maggioni, F., Perboli, G., & Rei, W. (2018). Reduced cost-based variable fixing in two-stage stochastic programming. Annals of Operations Research, 1–37. https://doi.org/10.1007/s10479-018-2942-8.

  • Dempster, M., & Thompson, G. (2002). Dynamic portfolio replication using stochastic programming. Cambridge: Cambridge University Press.

    Google Scholar 

  • Dupacová, J., Gröwe-Kuska, N., & Römisch, W. (2003). Scenario reduction in stochastic programming. Mathematical Programming, 95(3), 493–511.

    Google Scholar 

  • Escudero, L., Garín, A., Merino, M., & Pérez, G. (2007). The value of the stochastic solution in multistage problems. TOP, 15(1), 48–64.

    Google Scholar 

  • Escudero, L. F., Garín, A., Merino, M., & Pérez, G. (2009). BFC-MSMIP: An exact branch-and-fix coordination approach for solving multistage stochastic mixed 0–1 problems. TOP, 17(1), 96–122.

    Google Scholar 

  • Fleten, S.-E., & Kristoffersen, T. K. (2008). Short-term hydropower production planning by stochastic programming. Computers & Operations Research, 35(8), 2656–2671.

    Google Scholar 

  • Heitsch, H., & Römisch, W. (2003). Scenario reduction algorithms in stochastic programming. Computational optimization and applications, 24(2–3), 187–206.

    Google Scholar 

  • Høyland, K., Kaut, M., & Wallace, S. W. (2003). A heuristic for moment-matching scenario generation. Computational Optimization and Applications, 24(2–3), 169–185.

    Google Scholar 

  • Høyland, K., & Wallace, S. W. (2001). Generating scenario trees for multistage decision problems. Management Science, 47(2), 295–307.

    Google Scholar 

  • Kall, P., & Wallace, S. W. (1994). Stochastic programming. Chichester: Wiley.

    Google Scholar 

  • Kaut, M., Midthun, K. T., Werner, A. S., Tomasgard, A., Hellemo, L., & Fodstad, M. (2014). Multi-horizon stochastic programming. Computational Management Science, 11(1–2), 179–193.

    Google Scholar 

  • King, A. J., & Wallace, S. W. (2012). Modeling with stochastic programming. New York: Springer.

    Google Scholar 

  • Kovacevic, R. M., & Pichler, A. (2015). Tree approximation for discrete time stochastic processes: a process distance approach. Annals of operations research, 235(1), 395–421.

    Google Scholar 

  • Kristoffersen, T. K., & Fleten, S.-E. (2010). Stochastic programming models for short-term power generation scheduling and bidding. In E. Bjørndal, M. Bjørndal, P. M. Pardalos, & M. Rönnqvist (Eds.), Energy, natural resources and environmental economics, energy systems (pp. 187–200). Berlin: Springer.

    Google Scholar 

  • Li, Y., Huang, G., & Nie, S. (2006). An interval-parameter multi-stage stochastic programming model for water resources management under uncertainty. Advances in Water Resources, 29(5), 776–789.

    Google Scholar 

  • Løkketangen, A., & Woodruff, D. L. (1996). Progressive hedging and tabu search applied to mixed integer (0, 1) multistage stochastic programming. Journal of Heuristics, 2(2), 111–128.

    Google Scholar 

  • Lulli, G., & Sen, S. (2004). A branch-and-price algorithm for multistage stochastic integer programming with application to stochastic batch-sizing problems. Management Science, 50(6), 786–796.

    Google Scholar 

  • Maggioni, F., Allevi, E., & Bertocchi, M. (2014). Bounds in multistage linear stochastic programming. Journal of Optimization Theory and Applications, 163(1), 200–229.

    Google Scholar 

  • Maggioni, F., Allevi, E., & Bertocchi, M. (2016). Monotonic bounds in multistage mixed-integer linear stochastic programming. Computational Management Science, 13(3), 423–457.

    Google Scholar 

  • Maggioni, F., & Pflug, G. C. (2016). Bounds and approximations for multistage stochastic programs. SIAM Journal on Optimization, 26(1), 831–855.

    Google Scholar 

  • Maggioni, F., & Pflug, G. C. (2019). Guaranteed bounds for general nondiscrete multistage risk-averse stochastic optimization programs. SIAM Journal on Optimization, 29(1), 454–483.

    Google Scholar 

  • Mulvey, J. M., & Shetty, B. (2004). Financial planning via multi-stage stochastic optimization. Computers & Operations Research, 31(1), 1–20.

    Google Scholar 

  • Pantuso, G. (2017). The football team composition problem: A stochastic programming approach. Journal of Quantitative Analysis in Sports, 13(3), 113–129.

    Google Scholar 

  • Pantuso, G., Fagerholt, K., & Wallace, S. W. (2015). Solving hierarchical stochastic programs: Application to the maritime fleet renewal problem. INFORMS Journal of Computing, 27(1), 89–102.

    Google Scholar 

  • Pflug, G., & Pichler. A. (2014). Multistage stochastic optimization. Springer series in Operations Research and Financial Engineering. Berlin: Springer.

  • Pflug, G. C., & Pichler, A. (2016). From empirical observations to tree models for stochastic optimization: Convergence properties. SIAM Journal on Optimization, 26(3), 1715–1740.

    Google Scholar 

  • Powell, W. B. (2014). Clearing the jungle of stochastic optimization. In A. Newman & J. Leung (Eds.), Bridging data and decisions (pp. 109–137). Athens: Informs.

    Google Scholar 

  • Rockafellar, R. T., & Wets, R. J.-B. (1991). Scenarios and policy aggregation in optimization under uncertainty. Mathematics of Operations Research, 16(1), 119–147.

    Google Scholar 

  • Sandikçi, B., & Özaltin, O. Y. (2017). A scalable bounding method for multistage stochastic programs. SIAM Journal on Optimization, 27(3), 1772–1800.

    Google Scholar 

  • Wallace, S. W., & Fleten, S.-E. (2003) Stochastic programming models in energy. In R. A. and A. Shapiro, editors, Stochastic Programming, Handbooks in Operations Research and Management Science (pp. 637–677). Amsterdam: Elsevier.

  • Werner, A. S., Pichler, A., Midthun, K. T., Hellemo, L., & Tomasgard, A. (2013). Risk measures in multi-horizon scenario trees. In Handbook of risk management in energy production and trading (pp. 177–201). Berlin: Springer.

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Giovanni Pantuso.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Additional results

Additional results

Table 9 Results for the tracking problem with fixed asset returns and \({\tilde{G}}_t\approx T[45,55,65]\), \(t=2,\ldots ,T\), varying the number of stages T in the problem and \(T'\) in the approximation. \(VSS^{1,T'}[\%]\) represents the percentage increase in objective value generated by the approximation and is computed as \(100\times VSS^{1,T'}/RP^1\). \(MSV^{1,T'}[\%]\) represents the percentage increase in the VSS by including stage \(T'\) and is computed as \(100\times MSV^{1,T'}/VSS^{1,T'-1}\). The remaining values are expressed in thousands of dollars
Table 10 Results for the tracking problem with fixed asset returns and \({\tilde{G}}_t\approx T[45(1+\xi )^{t-1},55(1+\xi )^{t-1},65(1+\xi )^{t-1}]\), \(t=2,\ldots ,T\), and \(\xi =6.485\%\), varying the number of stages T in the problem and \(T'\) in the approximation. \(VSS^{1,T'}[\%]\) represents the percentage increase in objective value generated by the approximation and is computed as \(100\times VSS^{1,T'}/RP^1\). \(MSV^{1,T'}[\%]\) represents the percentage increase in the VSS by including stage \(T'\) and is computed as \(100\times MSV^{1,T'}/VSS^{1,T'-1}\). The remaining values are expressed in thousands of dollars

We provide additional results for problems with longer planning horizons, namely \(T=10,12\) and 15 stages, for the case with fixed asset returns and for approximations with up to \(T'=10\) stages. Table 9 shows the results for \(\kappa =10\) and Table 10 with \(\kappa =10\) and a target growth of \(6.485\%\) per stage. To be able to solve the original problem, the scenario trees are obtained by sampling two realizations of the random target per stage. The resulting scenario trees count \(2^{T-1}\) scenarios, with \(T=10,12,15\).

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Pantuso, G., Boomsma, T.K. On the number of stages in multistage stochastic programs. Ann Oper Res 292, 581–603 (2020). https://doi.org/10.1007/s10479-019-03181-7

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10479-019-03181-7

Keywords

Navigation