Abstract
This paper aims at showing that the class of augmented Lagrangian functions for nonlinear semidefinite programming problems can be derived, as a particular case, from a nonlinear separation scheme in the image space associated with the given problem. By means of the image space analysis, a global saddle point condition for the augmented Lagrangian function is investigated. It is shown that the existence of a saddle point is equivalent to a regular nonlinear separation of two suitable subsets of the image space. Without requiring the strict complementarity, it is proved that, under second order sufficiency conditions, the augmented Lagrangian function admits a local saddle point. The existence of global saddle points is then obtained under additional assumptions that do not require the compactness of the feasible set. Motivated by the result on global saddle points, we propose two modified primal-dual methods based on the augmented Lagrangian using different strategies and prove their convergence to a global solution and the optimal value of the original problem without requiring the boundedness condition of the multiplier sequence.
Similar content being viewed by others
References
Ben-Tal, A., Jarre, F., Kocvara, M., Nemirovski, A., Zowe, J.: Optimal design of trusses under a nonconvex global buckling constraints. Optim. Eng. 1, 189–213 (2000)
Birgin, E.G., Floudas, C.A., Martınez, J.M.: Global minimization using an augmented Lagrangian method with variable lower-level constraints. Math. Program. 125, 139–162 (2010)
Bonnans, J.F., Cominetti, R., Shapiro, A.: Second order necessary and sufficient optimality conditions under abstract constraintsff. SIAM J. Optim. 9, 466–492 (1999)
Bonnans, J.F., Shapiro, A.: Perturbation Analysis of Optimization Problems. Springer, New York (2000)
Chan, Z.X., Sun, D.: Constraint nondegeneracy, strong regularity and nonsingularity in semidefinite programming. SIAM J. Optim. 19, 370–396 (2008)
Coleman, T.F., Li, Y.: On the convergence of reflective Newton methods for largescale nonlinear minimization subject to bounds. Math. Program. 67, 189–224 (1994)
Coleman, T.F., Li, Y., Kaya, C.Y.: An interior trust region approach for nonlinear minimization subject to bounds. SIAM J. Optim. 6, 418–445 (1996)
Correa, R., Hector Ramirez, C.: A global algorithm for solving nonlinear semidefinite programming. SIAM J. Optim. 15, 303–318 (2004)
Fares, B., Apkarian, P., Noll, D.: An augmented Lagrangian method for a class of LMI-constrained problems in robust control theory. Int. J. Control 74, 348–360 (2001)
Fares, B., Noll, D., Apkarian, P.: Robust control via sequential semidefinite programming. SIAM J. Control Optim. 40, 1791–1820 (2002)
Forsgren, A.: Optimality conditions for nonconvex semidefinite programming. Math. Program. 88, 105–128 (2000)
Giannessi, F.: Theorems of the alternative and optimality conditions. J. Optim. Theory Appl. 42, 331–365 (1984)
Giannessi, F.: Constrained Optimization and Image Space Analysis. Springer, Berlin (2005)
Huang, X.X., Yang, X.Q., Teo, K.L.: Augmented Lagrangian and nonlinear semidefinite programs. In: Variational Analysis and Applications, Nonconvex Optimization and Its Applications, vol. 79, pp. 513–529 (2005)
Jarre, F.: An interior point method for semidefinite programs. Optim. Eng. 1, 347–372 (2000)
Li, D.: Zero duality gap for a class of nonconvex optimization problems. J. Optim. Theory Appl. 85, 309–324 (1995)
Li, D., Sun, X.L.: Existence of a saddle point in nonconvex constrained optimization. J. Glob. Optim. 21, 39–50 (2001)
Luo, H.Z., Mastroeni, G., Wu, H.X.: Separation approach for augmented Lagrangians in constrained nonconvex optimization. J. Optim. Theory Appl. 144, 275–290 (2010)
Luo, H.Z., Sun, X.L., Li, D.: On the convergence of augmented Lagrangian methods for constrained global optimization. SIAM J. Optim. 18, 1209–1230 (2007)
Luo, H.Z., Sun, X.L., Wu, H.X.: Convergence properties of augmented Lagrangian methods for constrained global optimization. Optim. Methods Softw. 23, 763–778 (2008)
Luo, H.Z., Sun, X.L., Xu, Y.F.: Convergence properties of modified and partially-augmented Lagrangian methods for mathematical programming with complementarity constraints. J. Optim. Theory Appl. 145, 489–506 (2010)
Luo, H.Z., Sun, X.L., Xu, Y.F., Wu, H.X.: On the convergence properties of modified augmented Lagrangian methods for mathematical programming with complementarity constraints. J. Glob. Optim. 46, 217–232 (2010)
Luo, H.Z., Wu, H.X., Chen, G.T.: On the convergence of augmented Lagrangian methods for nonlinear semidefinite programming. J. Glob. Optim. 54, 599–618 (2012)
Mastroeni, G.: Nonlinear separation in the image space with applications to penalty methods. Appl. Anal. 91, 1901–1914 (2012)
Mosheyev, L., Zibulevsky, M.: Penalty/barrier multiplier algorithm for semidefinite programming. Optim. Methods Soft. 13, 235–261 (2000)
Noll, D.: Local convergence of an augmented Lagrangian method for matrix inequality constrained programming. Optim. Methods Softw. 22, 777–802 (2007)
Qi, H.D.: Local duality of nonlinear semidefinite programming. Math. Oper. Res. 34, 124–141 (2009)
Rockafellar, R.T., Wets, R.J.-B.: Variational Analysis. Springer, Berlin (1998)
Shapiro, A.: First and second order analysis of nonlinear semidefinite programs. Math. Program. B. Ser. 77, 301–320 (1997)
Stingl, M.: On the solution of nonlinear semidefinite programs by augmented Lagrangian methods. PhD thesis, Institute of Applied Mathematics, Universitytat Erlangen-Nurnberg (2005)
Sun, D.: The strong second-order sufficient condition and constraint nondegeneracy in nonlinear semidefinite programming and their implications. Math. Oper. Res. 31, 761–776 (2006)
Sun, D., Sun, J., Zhang, L.W.: The rate of convergence of the augmented Lagrangian method for nonlinear semidefinite programming. Math. Program. 114, 349–391 (2008)
Sun, J., Zhang, L.W., Wu, Y.: Properties of the augmented Lagrangian in nonlinear semidefinite optimization. J. Optim. Theory Appl. 129, 437–456 (2006)
Sun, X.L., Li, D., McKinnon, K.I.M.: On saddle points of augmented Lagrangians for constrained nonconvex optimization. SIAM J. Optim. 15, 1128–1146 (2005)
Wu, H.X., Luo, H.Z.: A note on the existence of saddle points of \(p\)-th power Lagrangian for constrained nonconvex optimization. Optimization 61, 1331–1345 (2012)
Wu, H.X., Luo, H.Z.: Saddle points of general augmented Lagrangians for constrained nonconvex optimization. J. Glob. Optim. 53, 683–697 (2012)
Yamashita, H., Yabe, H.: A primal-dual interior point method for nonlinear semidefinite programming. Inst. Stat. Math. Cooper. Res. Rep. 203, 296–317 (2007)
Yamashita, H., Yabe, H., Harada, K.: A primal-dual interior point method for nonlinear semidefinite programming. Math. Program. 135, 89–121 (2012)
Acknowledgments
The authors would like to thank the two anonymous referees for the detailed comments and valuable suggestions which have improved the final presentation of the paper.
Author information
Authors and Affiliations
Corresponding author
Additional information
This work was supported by the National Natural Science Foundation of China under grant 11071219, the Postdoctoral Key Research Foundation of China under grant 201003242, and the Zhejiang Provincial Natural Science Foundation of China under grants LY13A010012 and LY13A010017.
Rights and permissions
About this article
Cite this article
Wu, H.X., Luo, H.Z. & Yang, J.F. Nonlinear separation approach for the augmented Lagrangian in nonlinear semidefinite programming. J Glob Optim 59, 695–727 (2014). https://doi.org/10.1007/s10898-013-0093-7
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10898-013-0093-7