Abstract
This paper presents a new and high performance solution method for multistage stochastic convex programming. Stochastic programming is a quantitative tool developed in the field of optimization to cope with the problem of decision-making under uncertainty. Among others, stochastic programming has found many applications in finance, such as asset-liability and bond-portfolio management. However, many stochastic programming applications still remain computationally intractable because of their overwhelming dimensionality. In this paper we propose a new decomposition algorithm for multistage stochastic programming with a convex objective and stochastic recourse matrices, based on the path-following interior point method combined with the homogeneous self-dual embedding technique. Our preliminary numerical experiments show that this approach is very promising in many ways for solving generic multistage stochastic programming, including its superiority in terms of numerical efficiency, as well as the flexibility in testing and analyzing the model.
Similar content being viewed by others
References
Andersen, E.D., Andersen, K.D.: The MOSEK interior point optimizer for linear programming: an implementation of the homogeneous algorithm. High Performance Optimization Techniques Frenk, J.B.G., Roos, K., Terlaky, T., Zhang, S., (eds.), pp. 197–232, Kluwer Academic Publishers, 1999
Andersen, E.D., Ye, Y.: A computational study of the homogeneous algorithm for large-scale convex optimization. Computational Optimization and Applications 10, 243–269 (1998)
Ariyawansa, K.A., Jiang, P.L.: Polynomial cutting plane algorithms for two-stage stochastic linear programs based on ellipsoids, volumetric centers and analytic centers, Working Paper. Department of Pure and Applied Mathematics, Washington State University, Pullman, USA, 1996
Berkelaar, A., Dert, C., Oldenkamp, B., Zhang, S.: A Primal-Dual Decomposition-Based Interior Point Approach to Two-Stage Stochastic Linear Programming. Operations Research 50, 904–915 (2002)
Bahn, O., du Merle, O., Goffin, J.-L., Vial, J.P.: A cutting plane method from analytic centers for stochastic programming. Mathematical Programming 69, 45–73 (1995)
Berger, A.J., Mulvey, J.M., Rothberg, E., Vanderbei, R.J.: Solving multistage stochastic programs using tree dissection, Technical Report SOR-95-07. Department of Civil Engineering and Operations Research, Princeton University, USA, 1995
Berger, A.J., Mulvey, J.M., Ruszczynski, A.: An extension of the DQA algorithm to convex stochastic programs. SIAM Journal on Optimization 4, 735–753 (1994)
Birge, J.R.: Decomposition and partitioning methods for multistage stochastic linear programs. Operations Research 33, 989–1007 (1985)
Birge, J.R., Donohue, C.J., Holmes, D.F., Svintsitski, O.G.: A parallel implementation of the nested decomposition algorithm for multistage stochastic linear programs. Mathematical Programming 75, 327–352 (1996)
Birge, J.R., Holmes, D.F.: Efficient solution of two-stage stochastic linear programs using interior point methods. Computational Optimization and Applications 1, 245–276 (1992)
Birge, J.R., Holmes, D.F.: A (PO)rtable (S)tochastic programming (T)est (S)et (POSTS). Northwestern University, http://users.iems.nwu.edu/ jrbirge//html/dholmes/POSTresults.html
Birge, J.R., Louveaux, F.: Introduction to Stochastic Programming. Springer, New York, 1997
Birge, J.R., Qi, L.: Computing block-angular Karmarkar projections with applications to stochastic programming. Management Science 34, 1472–1479 (1988)
Birge, J.R., Rosa, C.H.: Parallel decomposition of large-scale stochastic nonlinear programs. Annals of Operations Research 64, 39–65 (1996)
Choi, I.C., Goldfarb, D.: Exploiting special structure in a primal-dual path-following algorithm. Mathematical Programming 58, 33–52 (1993)
Felt, A.: Test-Problem Collection for Stochastic Linear Programming. University of Wisconsin-Stevens Point, http://www.uwsp.edu/math/afelt/slptestset.html
Czyzyk, J., Fourer, R., Mehrotra, S.: Using a massively parallel processor to solve large sparse linear programs by an interior-point method. SIAM Journal on Scientific Computing 19, 553–565 (1998)
Fragnière, E., Gondzio, J., Vial, J.-P.: Building and solving large-scale stochastic programs on an affordable distributed computing system. Annals of Operations Research 99, 167–187 (2000)
Gassmann, H.I.: The SMPS format for stochastic linear programs. Dalhousie University, http://www.mgmt.dal.ca/sba/profs/hgassmann/SMPS2.htm
Goldman, A.J., Tucker, A.W.: Polyhedral convex cones, in Kuhn, H.W., Tucker, A.W., (eds.), Linear Inequalities and Related Systems. Princeton University Press, New Jersey, pp. 19–40 (1956)
Gondzio, J., Kouwenberg, R.: High performance computing for asset liability management. Operations Research 49, 879–891 (2001)
Gonzaga, C.G.: Generation of Degenerate Linear Programming Problems. Federal University of Santa Catarina, http://jurere.mtm.ufsc.br/ clovis/files/degenerate.ps
Higle, J.L., Sen, S.: Stochastic Decomposition: a statistical method for large-scale stochastic linear programming, Kluwer Academic Publishers, Dordrecht, The Netherlands, 1996
Jessup, E.R., Yang, D., Zenios, S.A.: Parallel factorization of structured matrices arising in stochastic programming. SIAM Journal on Optimization 4, 833–846 (1994)
Kall, P., Wallace, S.W.: Stochastic Programming, John Wiley and Sons, Chichester, 1994
Luo, Z.Q., Sturm, J.F., Zhang, S.: Conic convex programming and self-dual embedding. Optimization Methods and Software 14, 169–218 (2000)
Lustig, I.J., Mulvey, J.M., Carpenter, T.J.: The formulation of stochastic programs for interior point methods. Operations Research 39, 757–770 (1991)
Mayer, J.: Stochastic Linear Programming Algorithms: A Comparison Based on a Model Management System, Gordon and Breach Science Publishers, 1998
Mulvey, J.M., Ruszczynski, A.: A new scenario decomposition method for large-scale stochastic optimization. Operations Research 43, 477–490 (1995)
Mulvey, J.M., Ziemba, W.T. (eds.): Asset and Liability Management from a Global Perspective. Cambridge University Press, 1998
Sturm, J.F.: Using SeDuMi 1.02, a MATLAB toolbox for optimization over symmetric cones. Optimization Methods and Software . Special issue on Interior Point Methods (CD supplement with software). 11–12, 625–653 (1999)
Terlaky, T. (ed.): Interior Point Methods of Mathematical Programming, Kluwer Academic Publishers, Dordrecht, 1996
Vanderbei, R.J.: LOQO. Princeton University, http://www.orfe.princeton.edu/ loqo/
Van Slyke, R., Wets, R.J.-B.: L-shaped linear programs with application to optimal control and stochastic programming. SIAM Journal on Applied Mathematics 17, 638–663 (1969)
Xu, X., Hung, P.F., Ye, Y.: A simplified homogeneous self-dual linear programming algorithm and its implementation. Annals of Operations Research 62, 151–171 (1996)
Yang, D., Zenios, S.A.: A Scalable parallel interior point algorithm for stochastic linear programming and robust optimization. Computational Optimization and Applications 7, 143–158 (1997)
Ye, Y., Todd, M.J., Mizuno, S.: An -iteration homogeneous and self-dual linear programming algorithm. Mathematics of Operations Research 19, 53–67 (1994)
Zhao, G.Y.: A Lagrangian dual method with self-concordant barrier for multi-stage stochastic convex nonlinear programming, Working paper. Department of Mathematics, National University of Singapore, 1998
Zhao, G.Y.: A log-barrier method with Benders decomposition for solving two-stage stochastic linear programs. Mathematical Programming 90, 507–536 (2001)
Author information
Authors and Affiliations
Corresponding author
Additional information
Research supported by Hong Kong RGC Earmarked Grant CUHK4233/01E.
Rights and permissions
About this article
Cite this article
Berkelaar, A., Gromicho, J., Kouwenberg, R. et al. A Primal-Dual Decomposition Algorithm for Multistage Stochastic Convex Programming. Math. Program. 104, 153–177 (2005). https://doi.org/10.1007/s10107-005-0575-6
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10107-005-0575-6
Keywords
- Multistage stochastic programming
- Convex objective
- Interior point method
- Homogeneous self-dual embedding