Abstract
We present the adaptation and implementation of a composite-step trust region algorithm, developed in (Walther, SIAM J. Optim. 19(1):307–325, 2008), that incorporates the approximation of the Jacobian of the equality constraints with a specialized quasi-Newton method. The forming and/or factoring of the exact Jacobian in each optimization step is avoided. Hence, the presented approach is especially well suited for equality constrained optimization problems where the Jacobian of the constraints is dense.
In this study, we discuss the calculation of the normal and tangential steps and how the trust region radius is adapted to take the inaccurate first-order information into account. Results are presented for several examples from the CUTE test set and a simple periodic adsorption process.
Similar content being viewed by others
References
Byrd, R., Gilbert, J., Nocedal, J.: A trust region method based on interior point techniques for nonlinear programming. Math. Program. 89A, 149–185 (2000)
Griewank, A., Juedes, D., Utke, J.: ADOL-C: A package for the automatic differentiation of algorithms written in C/C++. ACM Trans. Math. Softw. 22, 131–167 (1996)
Griewank, A., Walther, A.: On constrained optimization by adjoint-based quasi-Newton methods. Optim. Methods Softw. 17, 869–889 (2002)
Griewank, A., Walther, A.: Evaluating Derivatives: Principles and Techniques of Algorithmic Differentiation, 2nd edn. SIAM, Philadelphia (2008)
Griewank, A., Walther, A., Korzec, M.: Maintaining factorized KKT systems subject to rank-one updates of Hessians and Jacobians. Optim. Methods Softw. 22, 279–295 (2007)
Heinkenschloss, M., Vicente, L.N.: Analysis of inexact trust-region SQP algorithms. SIAM J. Optim. 12(2), 283–302 (2001)
Jiang, L., Biegler, L.T., Fox, G.: Optimization of pressure swing adsorption systems for air separation. AIChE J. 49, 1140–1157 (2003)
Lalee, M., Nocedal, J., Plantenga, T.: On the implementation of an algorithm for large-scale equality constrained optimization. SIAM J. Optim. 8(3), 682–706 (1998)
Nocedal, J., Wright, S.: Numerical Optimization. Springer, Berlin (1999)
Vanderbei, R., Shanno, D.: An interior-point algorithm for nonconvex nonlinear programming. Comput. Optim. Appl. 13, 231–252 (1999)
Wächter, A., Biegler, L.: On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming. Math. Program. 106(1), 25–57 (2006)
Walther, A.: A first-order convergence analysis of trust-region methods with inexact Jacobians. SIAM J. Optim. 19(1), 307–325 (2008)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Walther, A., Biegler, L.T. Numerical experiments with an inexact Jacobian trust-region algorithm. Comput Optim Appl 48, 255–271 (2011). https://doi.org/10.1007/s10589-009-9247-4
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10589-009-9247-4