Skip to main content
Log in

A Shifted-Barrier Primal-Dual Algorithm Model for Linearly Constrained Optimization Problems

  • Published:
Computational Optimization and Applications Aims and scope Submit manuscript

Abstract

In this paper we describe a Newton-type algorithm model for solving smooth constrained optimization problems with nonlinear objective function, general linear constraints and bounded variables. The algorithm model is based on the definition of a continuously differentiable exact merit function that follows an exact penalty approach for the box constraints and an exact augmented Lagrangian approach for the general linear constraints. Under very mild assumptions and without requiring the strict complementarity assumption, the algorithm model produces a sequence of pairs \(\{ x^k ,\lambda ^k \} \) converging quadratically to a pair \((\bar x,\bar \lambda )\) where \(\bar x\) satisfies the first order necessary conditions and \(\bar \lambda \) is a KKT multipliers vector associated to the linear constraints. As regards the behaviour of the sequence x k alone, it is guaranteed that it converges at least superlinearly. At each iteration, the algorithm requires only the solution of a linear system that can be performed by means of conjugate gradient methods. Numerical experiments and comparison are reported.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. J. F. Bonnans and C. Pola, “A trust region interior point algorithm for linearly constrained optimization,” SIAM J. on Optimization, vol. 7, pp. 717–731, 1997.

    Google Scholar 

  2. A. Ciancimino, G. Inzerillo, S. Lucidi and L. Palagi, “A mathematical programming approach for the solution of the railway yield management problem,” Transportation Science (to appear).

  3. F.H. Clarke, Optimization and Nonsmooth Analysis, John Wiley & Sons: New York, 1983.

    Google Scholar 

  4. A. Conn, N. Gould and P. Toint, Lancelot. A Fortan Package for Large-Scale Nonlinear Optimization (Release A), Springer-Verlag: Berlin, 1991.

    Google Scholar 

  5. A. R. Conn, N. Gould and Ph. L. Toint, “A primal-dual algorithm for minimizing a nonconvex function subject to bound and linear equality constraints,” Technical Report 96/9, Dept. of Mathematics, FUNDP, Namur (B), 1996.

    Google Scholar 

  6. A. R. Conn, N. Gould and Ph. L. Toint, “A globally convergent Lagrangian barrier algorithm for optimization with general inequality constraints and simple bounds,” Technical Report 92/7 (2nd revision), 1995.

  7. R. S. Dembo and T. Steihaug, “Truncated Newton algorithms for large scale unconstrained optimization,” Mathematical Programming, vol.26, pp.190–212, 1983.

    Google Scholar 

  8. G. Di Pillo, S. Lucidi and L. Palagi, “A superlinearly convergent algorithm for constrained nonlinear programming problems with bounded variables,” Technical Report DIS 02.99, 1999.

  9. G. Di Pillo, “Exact penalty methods,” in Algorithms for Continuous Optimization: the State of the Art, pages 1–45. Kluwer Ac. Press, Boston, (1994).

    Google Scholar 

  10. G. Di Pillo and L. Grippo, “An augmented Lagrangian for inequality constraints in nonlinear programming problems,” Journal of Optimization Theory and Applications, vol. 36, pp. 495–519, 1982.

    Google Scholar 

  11. G. Di Pillo and L. Grippo, “Exact penalty functions in constrained optimization,” SIAM Journal on Control and Optimization, vol. 27, pp. 1333–1360, 1989.

    Google Scholar 

  12. G. Di Pillo, L. Grippo and S. Lucidi, “Globally convergent exact penalty algorithms for constrained optimization,” Technical Report CNR-IASI no. 128, 1985.

  13. G. Di Pillo and S. Lucidi, “ On exact augmented Lagrangian functions in nonlinear programming,” in Nonlinear optimization and applications: Proceedings of the International School of Mathematics, Erice, Italy, 1995.

  14. G. Di Pillo and S. Lucidi, “An augmented Lagrangian function with improved exactness properties,” Technical Report DIS 18.95, 1995.

  15. G. Di Pillo, S. Lucidi and L. Palagi, “An exact penalty-Lagrangian approach for a class of constrained optimization problems with bounded variables,” Optimization, vol. 28, pp. 129–148, 1993.

    Google Scholar 

  16. F. Facchinei and S. Lucidi, “A class of methods for optimization problems with simple bounds,” Technical Report CNR-IASI no. 336, 1992.

  17. F. Facchinei and S. Lucidi, “Quadratically and superlinearly convergent algorithms for the solution of inequality constrained minimization problem,” J. of Optimization Theory and Application, vol. 85, pp. 265–289, 1995.

    Google Scholar 

  18. F. Facchinei, “Minimization of SC1 functions and the Maratos effect,” Operations Research Letters, vol. 17, pp. 131–137, 1995.

    Google Scholar 

  19. A. Forsgren and W. Murray, “Newton methods for large-scale linear inequality-constrained minimization,” SIAM J. on Optimization, vol. 7, pp. 162–176, 1997.

    Google Scholar 

  20. A. Forsgren and W. Murray, “Newton methods for large-scale linear equality-constrained minimization,” SIAM J. Matrix Anal. and Appl., vol. 14, pp. 560–587, 1993.

    Google Scholar 

  21. P. E. Gill, W. Murray and M. A. Saunders, “SNOPT: An SQP Algorithm for large-scale constrained optimization,” Technical Report NA 97–2, Dept. of Mathematics, University of California, San Diego, 1997.

    Google Scholar 

  22. L. Grippo, F. Lampariello and S. Lucidi, “A truncated Newton Method with nonmonotone line search for unconstrained optimization,” J. of Optimization Theory and Application, vol. 60, 1989.

  23. L. Grippo, F. Lampariello and S. Lucidi, “A class of nonmonotone stabilization methods in unconstrained optimization,” Numer. Math., vol. 59, pp. 779–805, 1991.

    Google Scholar 

  24. J.B. Hiriart-Urruty, J.J. Strodiot and V.H. Nguyen, “Generalized Hessian matrix and second-order optimality conditions for problems with C1,1 data,” Applied Mathematics and Optimization, vol. 11, pp. 43–56, 1984.

    Google Scholar 

  25. D. Klatte and K. Tammer, “On second-order sufficient optimality conditions for C1,1-optimization Problems,” Optimization, vol. 19, pp. 169–179, 1988.

    Google Scholar 

  26. S. Lucidi, “New results on a continuously differentiable exact penalty function,” J. of Optimization Theory and Application, vol. 2, pp. 558–574, 1992.

    Google Scholar 

  27. B. A. Murtagh and M. A. Saunders, “Large-scale linearly constrained optimization,” Mathematical Programming, vol. 14, pp. 41–72, 1978.

    Google Scholar 

  28. L. Qi and J. Sun, “A nonsmooth version of Newton's method,” Mathematical Programming, vol. 58, pp. 353–367, 1993.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Di Pillo, G., Lucidi, S. & Palagi, L. A Shifted-Barrier Primal-Dual Algorithm Model for Linearly Constrained Optimization Problems. Computational Optimization and Applications 12, 157–188 (1999). https://doi.org/10.1023/A:1008675917367

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1008675917367

Navigation