Abstract
We prove a new local convergence property of some primal-dual methods for solving nonlinear optimization problems. We consider a standard interior point approach, for which the complementarity conditions of the original primal-dual system are perturbed by a parameter driven to zero during the iterations. The sequence of iterates is generated by a linearization of the perturbed system and by applying the fraction to the boundary rule to maintain strict feasibility of the iterates with respect to the nonnegativity constraints. The analysis of the rate of convergence is carried out by considering an arbitrary sequence of perturbation parameters converging to zero. We first show that, once an iterate belongs to a neighbourhood of convergence of the Newton method applied to the original system, then the whole sequence of iterates converges to the solution. In addition, if the perturbation parameters converge to zero with a rate of convergence at most superlinear, then the sequence of iterates becomes asymptotically tangent to the central trajectory in a natural way. We give an example showing that this property can be false when the perturbation parameter goes to zero quadratically.
Similar content being viewed by others
References
Armand, P., Benoist, J., Orban, D.: Dynamic updates of the barrier parameter in primal-dual methods for nonlinear programming. Comput. Optim. Appl. (2007)(to appear)
Byrd R.H., Liu G. and Nocedal J. (1997). On the local behaviour of an interior point method for nonlinear programming. In: Griffiths, D.F., Higham, D.J., and Watson, G.A. (eds) Numerical Analysis 1997., pp 37–56. Addison-Welsey, Harlow
Coleman T.F. and Li Y. (1994). On the convergence of interior-reflective Newton methods for nonlinear minimization subject to bounds. Math. Prog. 67: 189–224
Dussault J.P. (1995). Numerical stability and efficiency of penalty algorithms. SIAM J. Numer. Anal. 32: 296–317
Dussault J.P. and Elafia A. (2001). On the superlinear convergence order of the logarithmic barrier algorithm. Comput. Optim. Appl. 19: 31–53
El-Bakry A.S., Tapia R.A., Tsuchiya T. and Zhang Y. (1996). On the formulation and theory of the Newton interior-point method for nonlinear programming. J. Optim. Theory Appl. 89: 507–541
Fiacco A.V. and McCormick G.P. (1968). Nonlinear Programming: Sequential Unconstrained Minimization Techniques. Wiley, New York
Gay D.M., Overton M.L. and Wright M.H. (1998). A primal-dual interior method for nonconvex nonlinear programming. In: Yuan, Y (eds) Advances in Nonlinear Programming (Beijing, 1996)., pp 31–56. Kluwer, Dordrecht
Gould N.I.M., Orban D., Sartenaer A. and Toint P.L. (2001). Superlinear convergence of primal-dual interior point algorithms for nonlinear programming. SIAM J. Optim. 11: 974–1002
Gould N.I.M., Orban D., Sartenaer A. and Toint P.L. (2002). Componentwise fast convergence in the solution of full-rank systems of nonlinear equations. Math. Prog. 92: 481–508
Heinkenschloss M., Ulbrich M. and Ulbrich S. (1999). Superlinear and quadratic convergence of affine- scaling interior-point Newton methods for problems with simple bounds without strict complementarity assumption. Math. Prog. 86: 615–635
Martinez H.J., Parada Z. and Tapia R.A. (1995). On the characterization of Q-superlinear convergence of quasi-Newton interior-point methods for nonlinear programming. Bol. Soc. Mat. Mexicana 1: 137–148
Nocedal, J., Wächter, A., Waltz, R.A.: Adaptive barrier strategies for nonlinear interior methods. Technical Report, Northwestern Univeristy, IL, USA (2005)
Tits A.L., Wächter A., Bakhtiari S., Urban T.J. and Lawrence C.T. (2003). A primal-dual interior-point method for nonlinear programming with strong global and local convergence properties. SIAM J. Optim. 14: 173–199
Ulbrich M., Ulbrich S. and Vicente L.N. (2004). A globally convergent primal-dual interior-point filter method for nonlinear programming. Math. Prog. 100: 379–410
Vanderbei R.J. and Shanno D.F. (1999). An interior-point algorithm for nonconvex nonlinear programming. Comput. Optim. Appl. 13: 231–252
Vicente L.N. (2000). Local convergence of the affine-scaling interior-point algorithm for nonlinear programming. Comput. Optim. Appl. 17: 23–35
Vicente L.N. and Wright S.J. (2002). Local convergence of a primal-dual method for degenerate nonlinear programming. Comput. Optim. Appl. 22: 311–328
Wächter A. and Biegler L.T. (2006). On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming. Math. Prog. 106: 25–57
Waltz R.A., Morales J.L., Nocedal J. and Orban D. (2006). An interior algorithm for nonlinear optimization that combines line search and trust region steps. Math. Prog. 107: 391–408
Yabe H. and Yamashita H. (1997). Q-superlinear convergence of primal-dual interior point quasi-Newton methods for constrained optimization. J. Oper. Res. Soc. Jpn 40: 415–436
Yamashita H. and Yabe H. (1996). Superlinear and quadratic convergence of some primal-dual interior point methods for constrained optimization. Math. Prog. 75: 377–397
Yamashita H., Yabe H. and Tanabe T. (2005). A globally and superlinearly convergent primal-dual interior point trust region method for large scale constrained optimization. Math. Prog. 102: 111–151
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Armand, P., Benoist, J. A local convergence property of primal-dual methods for nonlinear programming. Math. Program. 115, 199–222 (2008). https://doi.org/10.1007/s10107-007-0136-2
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10107-007-0136-2
Keywords
- Constrained optimization
- Interior point methods
- Nonlinear programming
- Primal-dual methods
- Barrier methods