Skip to main content

Advertisement

Log in

A new trust region method for solving least-square transformation of system of equalities and inequalities

  • Original Paper
  • Published:
Optimization Letters Aims and scope Submit manuscript

Abstract

In this paper, a new nonmonotone trust region method with adaptive radius is proposed for solving system of equalities and inequalities. This method combines a new nonmonotone technique with a new adaptive strategy based on the Shi and Guo’s adaptive technique in (J Comput Appl Math 213:509–520, 2008), which makes full use of the current point information. Under some standard assumptions, the global convergence property as well as the superlinear convergence rate are established for the new method. Numerical results on some nonlinear systems of equalities and inequalities indicate the efficiency and robustness of the proposed method in practice.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  1. Ahookhosh, M., Amini, K.: A nonmonotone trust region method with adaptive radius for unconstrained optimization. Comput. Math. Appl. 60, 411–422 (2010)

    Article  MATH  MathSciNet  Google Scholar 

  2. Ahookhosh, M., Amini, K.: An efficient nonmonotone trust-region method for unconstrained opti-mization. Numer. Algor. 59, 523–540 (2012)

    Article  MATH  MathSciNet  Google Scholar 

  3. Ahookhosh, M., Amini, K., Peyghami, M.R.: A nonmonotone trust-region line search method for large-scale unconstrained optimization. Appl. Math. Model 36, 478–487 (2012)

    Article  MATH  MathSciNet  Google Scholar 

  4. Chamberlain, R.M., Powell, M.J.D., Lemarechal, C., Pedersen, H.C.: The watchdog technique for forcing convergence in algorithm for constrained optimization. Math. Program. Stud. 16, 1–17 (1982)

    Article  MATH  MathSciNet  Google Scholar 

  5. Cui, Z., Wu, B.: A new modified nonmonotone adaptive trust region method for unconstrained optimization. Comput. Optim. Appl. 53, 795–806 (2012)

    Article  MATH  MathSciNet  Google Scholar 

  6. Daniel, J.W.: Newton’s method for nonlinear inequalities. Numer. Math. 6, 381–387 (1973)

    Article  MathSciNet  Google Scholar 

  7. Dai, Y.H.: On the nonmonotone line search. J. Optim.Theory Appl. 112(2), 315–330 (2002)

    Article  MATH  MathSciNet  Google Scholar 

  8. Deng, N.Y., Xiao, Y., Zhou, F.J.: Nonmonotonic trust region algorithm. J. Optim.Theory Appl. 76, 259–285 (1993)

    Article  MATH  MathSciNet  Google Scholar 

  9. Dennis, J.E., El-Alem, M., Williamson, K.: A trust-region approach to nonlinear system of equalities and inequalities. SIAM J. Control Optim. 9, 291–315 (1999)

    Article  MATH  MathSciNet  Google Scholar 

  10. Dolan, E., Moré, J.J.: Benchmarking optimization software with performance profiles. Math. Program. 91, 201–213 (2002)

    Article  MATH  MathSciNet  Google Scholar 

  11. Fan, J.Y., Yuan, Y.X.: A new trust region algorithm with trust region radius converging to zero. In: Proceedings of the 5th International Conference on Optimization: Techniques and Applications (2001)

  12. Fletcher, R., Leyffer, S.: Filter-type algorithm for solving system of algebraic aquations and inequalities. In: Di Pillo, G., Murli, A. (eds.) High Performance Algorithms and Software for Nonlinear Optimization, pp. 259–278. Kluwer, Dordrecht (2003)

  13. Floudas, C.A., Pardalos, P.M., Adjiman, C.S., Esposito, W.R., Gumus, Z.H., Harding, S.T., Klepeis, J.L., Meyer, C.A., Schweiger, C.A.: Handbook of Test Problems in Local and Global Optimization, Nonconvex Optimization and its Applications, p. 33. Kluwer, Dordrecht (1999)

  14. Francisco, J.B., Krejis, N., Martinez, J.M.: An interior-point method for solving box-constraned unconstrained nonlinear system. J. Comput. Appl. Math. 177, 67–88 (2005)

    Article  MATH  MathSciNet  Google Scholar 

  15. Gould, N.I.M., Leyffer, S., Toint, Ph.L.: FILTRANE A Fortran 95 filter-trust-region package for solving nonlinear least-squers and nonlinear feasibility problems. ACM Trans. Math. Softw. 33, 3–25 (2007)

  16. Grippo, L., Lamparillo, F., Lucidi, S.: A nonmonotone line search technique for Newton’s method. SIAM J. Numer. Anal. 23, 707–716 (1986)

    Article  MATH  MathSciNet  Google Scholar 

  17. Grippo, L., Lamparillo, F., Lucidi, S.: A truncated Newton method with nonmonotone line search for unconstrained optimization. J. Optim. Theory Appl. 60(3), 401–419 (1989)

    Article  MATH  MathSciNet  Google Scholar 

  18. Hock, W., Schittkowski, K.: Test Examples for Nonlinear Programming Codes, Lecture Notes in Economics and Mathematical Systems, p. 187. Springer, Berlin (1981)

  19. Macconi, M., Morini, B., Porcelli, M.: Trust-region quadratic methods for nonlinear system of mixed equalities and inqualities. Appl. Numer. Math. 59, 859–876 (2009)

    Article  MATH  MathSciNet  Google Scholar 

  20. Mo, J., Liu, C., Yan, S.: A nonmonotone trust region method based on nonincreasing technique of weighted avrage of the successive function values. J. Comput. Appl. Math. 209, 97–108 (2007)

    Article  MATH  MathSciNet  Google Scholar 

  21. Moré, J.J., Garbow, B.S., Hilstron, K.E.: Testing unconstrained optimization software. ACM Trans. Math. Softw. 7, 17–41 (1981)

    Article  MATH  Google Scholar 

  22. Morini, B., Porcelli, M.: TRESNEI, a matlab trust-region solver for systems of nonlinear equalities and inequalities. Comput. Optim. Appl. 51(1), 27–49 (2012)

    Article  MATH  MathSciNet  Google Scholar 

  23. Nocedal, J., Yuan, Y.: Combining trust region and line search techniques. In: Yuan, Y. (ed.) Advances in Nonlinear Programming, pp. 152–175. Kluwer, Dordrecht (1996)

    Google Scholar 

  24. Nocedal, J., Wright, S.J.: Numerical Optimization. Springer, New York (2006)

    MATH  Google Scholar 

  25. Panier, E.R.: Avoiding the Maratos effect by means of a nonmonotone linesearch. SIAM J. Numer. Anal. 28, 1183–1195 (1991)

    Article  MATH  MathSciNet  Google Scholar 

  26. Porcelli, M.: On the convergence of an inexact Guass-Newton trust region method for nonlinear least squares problems with simple bounds. Optim. Lett. 7, 447–465 (2013)

    Article  MATH  MathSciNet  Google Scholar 

  27. Sang, Z., Sun, Q.: A self-adaptive trust region method with line search based on a simple subproblem model. J. Comput. Appl. Math. 232, 514–522 (2009)

    Google Scholar 

  28. Sartenaer, A.: Automatic determination of an initial trust region in nonlinear programming. SIAM J. Sci. Comput. 18(6), 1788–1803 (1997)

    Article  MATH  MathSciNet  Google Scholar 

  29. Shi, Z.J., Guo, J.H.: A new trust region methods for unconstrained optimization. J. Comput. Appl. Math. 213, 509–520 (2008)

    Article  MATH  MathSciNet  Google Scholar 

  30. Toint, Ph.L.: An assessment of nonmonotone line search technique for unconstrained optimization. SIAM J. Sci. Comput. 17, 725–739 (1996)

    Google Scholar 

  31. Toint, Ph.L.: Nonmonotone trust-region algorithm for nonlinear optimization subject to convex constraints. Math. Program 77, 69–94 (1997)

    Google Scholar 

  32. Zhang, H.: A nonmonotone line search technique and its application to unconstrained optimization. SIAM J. Optim. 14(4), 1043–1056 (2004)

    Article  MATH  MathSciNet  Google Scholar 

  33. Zhang, X.S., Zhang, J.L., Liao, L.Z.: An adaptive trust region method and its convergence. Sci. China. 45, 620–631 (2002)

    MATH  MathSciNet  Google Scholar 

  34. Zhang, X.S., Zhang, J.L., Liao, L.Z.: A nonmonotone adaptive trust region method and its convergence. Int. Comput. Math. Appl. 45, 1469–1477 (2003)

    Article  MATH  Google Scholar 

Download references

Acknowledgments

The authors would like to thank the Research Councils of K.N.Toosi University of Technology and Shahid Rajaee, Teacher Training University for supporting this research.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to M. Reza Peyghami.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Tarzanagh, D.A., Saeidian, Z., Peyghami, M.R. et al. A new trust region method for solving least-square transformation of system of equalities and inequalities. Optim Lett 9, 283–310 (2015). https://doi.org/10.1007/s11590-013-0711-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11590-013-0711-9

Keywords

Navigation