Skip to main content
Log in

A Primal-Dual Decomposition Algorithm for Multistage Stochastic Convex Programming

  • Published:
Mathematical Programming Submit manuscript

Abstract

This paper presents a new and high performance solution method for multistage stochastic convex programming. Stochastic programming is a quantitative tool developed in the field of optimization to cope with the problem of decision-making under uncertainty. Among others, stochastic programming has found many applications in finance, such as asset-liability and bond-portfolio management. However, many stochastic programming applications still remain computationally intractable because of their overwhelming dimensionality. In this paper we propose a new decomposition algorithm for multistage stochastic programming with a convex objective and stochastic recourse matrices, based on the path-following interior point method combined with the homogeneous self-dual embedding technique. Our preliminary numerical experiments show that this approach is very promising in many ways for solving generic multistage stochastic programming, including its superiority in terms of numerical efficiency, as well as the flexibility in testing and analyzing the model.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Andersen, E.D., Andersen, K.D.: The MOSEK interior point optimizer for linear programming: an implementation of the homogeneous algorithm. High Performance Optimization Techniques Frenk, J.B.G., Roos, K., Terlaky, T., Zhang, S., (eds.), pp. 197–232, Kluwer Academic Publishers, 1999

  2. Andersen, E.D., Ye, Y.: A computational study of the homogeneous algorithm for large-scale convex optimization. Computational Optimization and Applications 10, 243–269 (1998)

    Article  MATH  MathSciNet  Google Scholar 

  3. Ariyawansa, K.A., Jiang, P.L.: Polynomial cutting plane algorithms for two-stage stochastic linear programs based on ellipsoids, volumetric centers and analytic centers, Working Paper. Department of Pure and Applied Mathematics, Washington State University, Pullman, USA, 1996

  4. Berkelaar, A., Dert, C., Oldenkamp, B., Zhang, S.: A Primal-Dual Decomposition-Based Interior Point Approach to Two-Stage Stochastic Linear Programming. Operations Research 50, 904–915 (2002)

    Article  MathSciNet  Google Scholar 

  5. Bahn, O., du Merle, O., Goffin, J.-L., Vial, J.P.: A cutting plane method from analytic centers for stochastic programming. Mathematical Programming 69, 45–73 (1995)

    MathSciNet  Google Scholar 

  6. Berger, A.J., Mulvey, J.M., Rothberg, E., Vanderbei, R.J.: Solving multistage stochastic programs using tree dissection, Technical Report SOR-95-07. Department of Civil Engineering and Operations Research, Princeton University, USA, 1995

  7. Berger, A.J., Mulvey, J.M., Ruszczynski, A.: An extension of the DQA algorithm to convex stochastic programs. SIAM Journal on Optimization 4, 735–753 (1994)

    Article  MATH  MathSciNet  Google Scholar 

  8. Birge, J.R.: Decomposition and partitioning methods for multistage stochastic linear programs. Operations Research 33, 989–1007 (1985)

    Article  MATH  MathSciNet  Google Scholar 

  9. Birge, J.R., Donohue, C.J., Holmes, D.F., Svintsitski, O.G.: A parallel implementation of the nested decomposition algorithm for multistage stochastic linear programs. Mathematical Programming 75, 327–352 (1996)

    Article  MathSciNet  Google Scholar 

  10. Birge, J.R., Holmes, D.F.: Efficient solution of two-stage stochastic linear programs using interior point methods. Computational Optimization and Applications 1, 245–276 (1992)

    Article  MATH  MathSciNet  Google Scholar 

  11. Birge, J.R., Holmes, D.F.: A (PO)rtable (S)tochastic programming (T)est (S)et (POSTS). Northwestern University, http://users.iems.nwu.edu/ jrbirge//html/dholmes/POSTresults.html

  12. Birge, J.R., Louveaux, F.: Introduction to Stochastic Programming. Springer, New York, 1997

  13. Birge, J.R., Qi, L.: Computing block-angular Karmarkar projections with applications to stochastic programming. Management Science 34, 1472–1479 (1988)

    MATH  MathSciNet  Google Scholar 

  14. Birge, J.R., Rosa, C.H.: Parallel decomposition of large-scale stochastic nonlinear programs. Annals of Operations Research 64, 39–65 (1996)

    MATH  MathSciNet  Google Scholar 

  15. Choi, I.C., Goldfarb, D.: Exploiting special structure in a primal-dual path-following algorithm. Mathematical Programming 58, 33–52 (1993)

    Article  MATH  MathSciNet  Google Scholar 

  16. Felt, A.: Test-Problem Collection for Stochastic Linear Programming. University of Wisconsin-Stevens Point, http://www.uwsp.edu/math/afelt/slptestset.html

  17. Czyzyk, J., Fourer, R., Mehrotra, S.: Using a massively parallel processor to solve large sparse linear programs by an interior-point method. SIAM Journal on Scientific Computing 19, 553–565 (1998)

    Article  MathSciNet  MATH  Google Scholar 

  18. Fragnière, E., Gondzio, J., Vial, J.-P.: Building and solving large-scale stochastic programs on an affordable distributed computing system. Annals of Operations Research 99, 167–187 (2000)

    Article  MATH  MathSciNet  Google Scholar 

  19. Gassmann, H.I.: The SMPS format for stochastic linear programs. Dalhousie University, http://www.mgmt.dal.ca/sba/profs/hgassmann/SMPS2.htm

  20. Goldman, A.J., Tucker, A.W.: Polyhedral convex cones, in Kuhn, H.W., Tucker, A.W., (eds.), Linear Inequalities and Related Systems. Princeton University Press, New Jersey, pp. 19–40 (1956)

  21. Gondzio, J., Kouwenberg, R.: High performance computing for asset liability management. Operations Research 49, 879–891 (2001)

    Article  MathSciNet  Google Scholar 

  22. Gonzaga, C.G.: Generation of Degenerate Linear Programming Problems. Federal University of Santa Catarina, http://jurere.mtm.ufsc.br/ clovis/files/degenerate.ps

  23. Higle, J.L., Sen, S.: Stochastic Decomposition: a statistical method for large-scale stochastic linear programming, Kluwer Academic Publishers, Dordrecht, The Netherlands, 1996

  24. Jessup, E.R., Yang, D., Zenios, S.A.: Parallel factorization of structured matrices arising in stochastic programming. SIAM Journal on Optimization 4, 833–846 (1994)

    Article  MATH  MathSciNet  Google Scholar 

  25. Kall, P., Wallace, S.W.: Stochastic Programming, John Wiley and Sons, Chichester, 1994

  26. Luo, Z.Q., Sturm, J.F., Zhang, S.: Conic convex programming and self-dual embedding. Optimization Methods and Software 14, 169–218 (2000)

    MATH  MathSciNet  Google Scholar 

  27. Lustig, I.J., Mulvey, J.M., Carpenter, T.J.: The formulation of stochastic programs for interior point methods. Operations Research 39, 757–770 (1991)

    Article  MathSciNet  MATH  Google Scholar 

  28. Mayer, J.: Stochastic Linear Programming Algorithms: A Comparison Based on a Model Management System, Gordon and Breach Science Publishers, 1998

  29. Mulvey, J.M., Ruszczynski, A.: A new scenario decomposition method for large-scale stochastic optimization. Operations Research 43, 477–490 (1995)

    MATH  MathSciNet  Google Scholar 

  30. Mulvey, J.M., Ziemba, W.T. (eds.): Asset and Liability Management from a Global Perspective. Cambridge University Press, 1998

  31. Sturm, J.F.: Using SeDuMi 1.02, a MATLAB toolbox for optimization over symmetric cones. Optimization Methods and Software . Special issue on Interior Point Methods (CD supplement with software). 11–12, 625–653 (1999)

  32. Terlaky, T. (ed.): Interior Point Methods of Mathematical Programming, Kluwer Academic Publishers, Dordrecht, 1996

  33. Vanderbei, R.J.: LOQO. Princeton University, http://www.orfe.princeton.edu/ loqo/

  34. Van Slyke, R., Wets, R.J.-B.: L-shaped linear programs with application to optimal control and stochastic programming. SIAM Journal on Applied Mathematics 17, 638–663 (1969)

    Article  MATH  MathSciNet  Google Scholar 

  35. Xu, X., Hung, P.F., Ye, Y.: A simplified homogeneous self-dual linear programming algorithm and its implementation. Annals of Operations Research 62, 151–171 (1996)

    MATH  MathSciNet  Google Scholar 

  36. Yang, D., Zenios, S.A.: A Scalable parallel interior point algorithm for stochastic linear programming and robust optimization. Computational Optimization and Applications 7, 143–158 (1997)

    Article  MATH  MathSciNet  Google Scholar 

  37. Ye, Y., Todd, M.J., Mizuno, S.: An -iteration homogeneous and self-dual linear programming algorithm. Mathematics of Operations Research 19, 53–67 (1994)

    Article  MATH  MathSciNet  Google Scholar 

  38. Zhao, G.Y.: A Lagrangian dual method with self-concordant barrier for multi-stage stochastic convex nonlinear programming, Working paper. Department of Mathematics, National University of Singapore, 1998

  39. Zhao, G.Y.: A log-barrier method with Benders decomposition for solving two-stage stochastic linear programs. Mathematical Programming 90, 507–536 (2001)

    MATH  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Shuzhong Zhang.

Additional information

Research supported by Hong Kong RGC Earmarked Grant CUHK4233/01E.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Berkelaar, A., Gromicho, J., Kouwenberg, R. et al. A Primal-Dual Decomposition Algorithm for Multistage Stochastic Convex Programming. Math. Program. 104, 153–177 (2005). https://doi.org/10.1007/s10107-005-0575-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10107-005-0575-6

Keywords

Mathematics Subject Classification (1991)

Navigation