Abstract
Two dual methods for solving constrained optimization problems are presented: the Dual Active Set algorithm and an algorithm combining an unconstrained minimization scheme, an augmented Lagrangian and multiplier updates. A new preconditioner is introduced that has a significant impact on the speed of convergence.
Similar content being viewed by others
References
A.R. Conn, N.I.M. Gould and P.L. Toint, A globally convergent augmented Lagrangian algorithm for optimization with general constraints and simple bounds, SIAM J. Numer. Anal. 28(1991)545–572.
C.D. Ha, A generalization of the proximal point algorithm, SIAM J. Control Optim. 28(1990)503–512.
W.W. Hager, Dual techniques for constrained optimization, J. Optim. Theory Appl. 55(1987)37–71.
W.W. Hager, Dual techniques for constrained optimization, II,Proc. 28th IEEE Conf. on Decision and Control, Tampa, FL (1989) pp. 364–369.
W.W. Hager, Updating the inverse of a matrix, SIAM Rev. 31(1989)221–239.
W.W. Hager, The dual active set algorithm, Department of Mathematics, University of Florida, Gainesville, FL (August, 1990).
W.W. Hager, Analysis and implementation of a dual algorithm for constrained optimization, Department of Mathematics, University of Florida, Gainesville, FL (November, 1990).
W.W. Hager and D.W. Hearn, The dual active set algorithm and quadratic networks, Report No. 90-7, Department of Industrial and Systems Engineering, University of Florida, Gainesville, FL (June, 1990).
W.W. Hager and G.D. Ianculescu, Dual approximations in optimal control, SIAM J. Control Optim. 22(1984)423–465.
D.G. Luenberger,Introduction to Linear and Nonlinear Programming (Addison-Wesley, Reading, MA, 1984).
F.J. Luque, Asymptotic convergence analysis of the proximal point algorithm, SIAM J. Control Optim. 22(1984)277–293.
B. Martinet, Regularisation d'inèquations variationnelles par approximations successives, Rev. Française Informatique et Recherche Opérationnelle (1970)154–159.
B. Martinet, Determination approchée d'un point fixe d'une application pseudocontractante, C. R. des Séances de l'Académie des Sciences, Paris 274(1972)163–165.
E. Polak, On the global stabilization of locally convergent algorithms, Automatica 12(1976)337–342.
R.T. Rockafellar, Augmented Lagrange multiplier functions and duality in nonconvex programming, SIAM J. Control Optim. 12(1974)268–285.
R.T. Rockafellar, SIAM J. Control Optim. 14(1976)877–898.
J.E. Spingarn, Submonotone mappings and the proximal point algorithm, Numer. Functional Anal. Optim. 4(1982)123–150.
P.L. Toint and D. Tuyttens, On large scale nonlinear network optimization, Math. Progr. 48(1990)125–159.
Author information
Authors and Affiliations
Additional information
This research was supported by US Army Research Office Contract DAAL03-89-G-0082, and by National Science Foundation Grant DMS-9022899.
Rights and permissions
About this article
Cite this article
Hager, W.W. Dual active sets and constrained optimization. Ann Oper Res 43, 217–228 (1993). https://doi.org/10.1007/BF02025452
Issue Date:
DOI: https://doi.org/10.1007/BF02025452