Abstract
Methods are developed and analyzed for estimating the distance to a local minimizer of a nonlinear programming problem. One estimate, based on the solution of a constrained convex quadratic program, can be used when strict complementary slackness and the second-order sufficient optimality conditions hold. A second estimate, based on the solution of an unconstrained nonconvex, nonsmooth optimization problem, is valid even when strict complementary slackness is violated. Both estimates are valid in a neighborhood of a local minimizer. An active set algorithm is developed for computing a stationary point of the nonsmooth error estimator. Each iteration of the algorithm requires the solution of a symmetric, positive semidefinite linear system, followed by a line search. Convergence is achieved in a finite number of iterations. The error bounds are based on stability properties for nonlinear programs. The theory is illustrated by some numerical examples.
Similar content being viewed by others
References
Andreani, R., Haeser, G., Martínez, J.M.: On sequential optimality conditions for smooth constrained optimization. Optimization 60, 627–641 (2011)
Andreani, R., Haeser, G., Schuverdt, M.L., Silva, P.J.S.: A relaxed constant positive linear dependence constraint qualification and applications. Math. Prog. 135, 255–273 (2012)
Dutta, J., Deb, K., Tulshyan, R., Arora, R.: Approximate KKT points and a proximity measure for termination. J. Global Optim. 56, 1463–1499 (2013)
Eckstein, J., Silva, P.J.S.: A practical relative error criterion for augmented Lagrangians. Math. Prog. 141, 319–348 (2013)
García-Esnaola, M., Peña, J.M.: A comparison of error bounds for linear complementarity problems of \(H\)-matrices. Linear Algebra Appl. 433, 956–964 (2010)
Hager, W.W., Gowda, S.: Stability in the presence of degeneracy and error estimation. Math. Prog. 85, 181–192 (1999)
Hager, W.W., Hearn, D.W.: Application of the dual active set algorithm to quadratic network optimization. Comput. Optim. Appl. 1, 349–373 (1993)
Himmelblau, D.M.: Applied Nonlinear Programming. McGraw-Hill, New York (1972)
Janin, R.: Directional derivative of the marginal function in nonlinear programming. Math. Prog. Stud. 21, 110–126 (1984)
Luo, Z.-Q., Tseng, P.: Error bound and reduced-gradient projection algorithms for convex minimization over a polyhedral set. SIAM J. Optim. 3, 43–59 (1993)
Mangasarian, O.L., Fromovitz, S.: The Fritz-John necessary optimality conditions in presence of equality and inequality constraints. J. Math. Anal. Appl. 17, 37–47 (1967)
Mathias, R., Pang, J.-S.: Error bounds for the linear complementarity problem with a \(P\) matrix. Linear Algebra Appl. 132, 123–136 (1990)
Minchenko, L., Stakhovski, S.: On relaxed constant rank regularity condition in mathematical programming. Optimization 60, 429–440 (2011)
Nocedal, J., Wright, S.J.: Numerical Optimization, 2nd edn. Springer, New York (2006)
Pang, J.-S.: Error bounds in mathematical programming. Math. Prog. 79, 299–332 (1997)
Qi, L., Wei, Z.: On the constant positive linear dependence condition and its application to SQP methods. SIAM J. Optim. 10, 963–981 (2000)
Acknowledgments
The authors gratefully acknowledge support by the Office of Naval Research under grant N00014-11-1-0068, and by the Defense Advanced Research Project Agency under contract HR0011-12-C-0011. The views expressed are those of the authors and do not reflect the official policy or position of the Department of Defense or the US Government. Approved for public release, distribution unlimited.
Author information
Authors and Affiliations
Corresponding author
Additional information
November 23, 2013, Revised March 25, 2014.
Rights and permissions
About this article
Cite this article
Hager, W.W., Mico-Umutesi, D. Error estimation in nonlinear optimization. J Glob Optim 59, 327–341 (2014). https://doi.org/10.1007/s10898-014-0186-y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10898-014-0186-y