Abstract
Complex numerical methods often contain subproblems that are easy to state in mathematical form, but difficult to translate into software. Several algorithmic isues of this nature arise in implementing a Newton iteration scheme as part of a finite-difference method for two-point boundary value problems. We describe the practical as well as theoretical considerations behind the decisions included in the final code, with special emphasis on two “watchdog” strategies designed to improve reliability and allow early termination of the Newton iterates.
Zusammenfassung
Komplizierte numerische Methoden enthalten oft Teilprobleme, die sich leicht mathematisch formulieren lassen, die aber schwierig in Computerprogramme umgewandelt werden können. Mehrere solche Fragestellungen traten bei der Erstellung eines Newton-Verfahrens als Bestandteil eines Differenzenverfahrens für 2-Punkt Randwert-probleme auf. Wir beschreiben die praktischen und theoretischen Überlegungen, welche den Entscheidungen zugrunde liegen, die schließlich zum Computerprogramm führten. Insbesondere betonen wir dabei zwei “Watchdog”-Strategien, welche die Zuverlässigkeit verbessern und ein frühes Abbrechen der Newton-Iteration ermöglichen.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
[ACR79a] Ascher, U., Christiansen, J., Russell, R. D., A collocation solver for mixed order systems of boundary value problems, Math. Comp.33, 659–679, 1979.
[ACR79b] Ascher, U., Christiansen, J., Russell, R. D., COLSYS—A collocation code for boundary value problems, inCodes for Boundary Value Problems in Ordinary Differential Equations (B. Childs, M. Scott, J. W. Daniel, E. Denman and P. Nelson, eds.), 164–185, Lecture Notes in Computer Science 76, New York, Springer, 1979.
[ACR81] Ascher, U., Christiansen, J., Russell, R. D., Collocation software for boundary value ordinary differential equations, ACM Trans. Math. Software7, 209–222, 1981.
[AMR88] Ascher, U., Mattheij, R. M. M., Russell, R. D., Numerical Solution of Boundary Value Problems for Ordinary Differential Equations, Prentice-Hall, Englewood Cliffs, New Jersey, 1988.
[AO87] Ascher, U., Osborne, M. R., A note on solving nonlinear equations and the ‘natural’ criterion function, J. Opt. Th. Appl.55, 147–152, 1987.
[BA87] Bader, G., Ascher, U., A new basis implementation for a mixed order boundary value ODE solver, SIAM J. Sci. Stat. Comput.8, 483–500, 1987.
[BR80] Bank, R. E., Rose, D. J., Parameter selection for Newton-like methods applicable to nonlinear partial differential equations, SIAM J. Numer. Anal.17, 806–822, 1980.
[BR81] Bank, R. E., Rose, D. J., Global approximate Newton methods, Numerische Mathematik37, 279–295, 1981.
[Cash86] Cash, J. R., On the numerical integration of nonlinear two-point boundary value problems using iterated deferred corrections, Part 1: A survey and comparison of some one-step formulae, Comput. Math. Appl.12a, 1029–1048, 1986.
[Cash88] Cash, J. R., On the numerical integration of nonlinear two-point boundary value problems using iterated deferred corrections, Part 2: The development and analysis of highly stable deferred correction formulae, SIAM J. Numer. Anal.4, 862–882, 1988.
[Cash89] Cash, J. R., A comparison of some global methods for solving two-point boundary value problems, Appl. Math. Comput.31, 449–462, 1989.
[CRR90] Cash, J. R., Ren, Y., Russell, R. D., Boundary value problem continuation with moving meshes, to appear in: Computational Ordinary Differential Equations, Oxford University Press, 1990.
[CS82a] Cash, J. R., Singhal, A., Mono-implicit Runge-Kutta formulae for the numerical integration of stiff differential equations, IMA J. Numer. Anal.2, 211–227, 1982.
[CS82b] Cash, J. R., Singhal, A., High-order methods for the numerical solution of two-point boundary value problems, BIT22, 184–199, 1982.
[CW89a] Cash, J. R., Wright, M. H., A deferred correction method for nonlinear two-point boundary value problems: implementation and numerical evaluation, Computing Science Technical Report 146, AT&T Bell Laboratories, Murray Hill, New Jersey.
[CW89b] Cash, J. R., Wright M. H., Issues in implementation of a deferred correction algorithm for nonlinear two-point boundary value problems, Computing Science Technical Report 147, AT&T Bell Laboratories, Murray Hill, New Jersey.
[CLPP82] Chamberlain, R. M., Lemaréchal, C., Pedersen, H. C., Powell, M. J. D., The watchdog technique for forcing convergence in algorithms for constrained optimization, Mathematical Programming Study16, 1–17, 1982.
[Cody84] Cody, W. J., Observations on the mathematical software effort, in Sources and Development of Mathematical Software (W. R. Cowell, ed.), 1–19, Prentice-Hall, Englewood Cliffs, New Jersey, 1984.
[Cole68] Cole, J. D., Perturbation Methods in Applied Mathematics, Blaisdell, Waltham, Massachusetts, 1968.
[CS89] Coughran, W. M., Jr. Schryer, N. L., Private communication.
[Deufl79] Deuflhard, P., Nonlinear equation solvers in boundary value problem codes, in Codes for Boundary Value Problems in Ordinary Differential Equations (B. Childs, M. Scott, J. W. Daniel, E. Denman and P. Nelson, eds.), 40–66, Lecture Notes in Computer Science 76, New York, Springer 1979.
[GM74] Gill, P. E., Murray, W., Safeguarded steplength algorithms for optimization using descent methods, Report NAC 37, National Physical Laboratory, Teddington, England, 1974.
[GMW81] Gill, P. E., Murray, W., Wright, M. H., Practical Optimization, Academic Press, London, 1981.
[LenPer74] Lentini, M., Pereyra, V., A variable order finite difference method for nonlinear multipoint boundary value problems, Math. Comp.28, 981–1004, 1974.
[LK76] Lyness, J. N., Kaganove, J. J., Comments on the nature of automatic quadrature routines, ACM Transactions on Mathematical Software2, 65–81, 1976.
[OR70] Ortega, J. M., Rheinboldt, W. C., Iterative Solution of Nonlinear Equations in Several Variables, Academic Press, New York, 1970.
[Per68] Pereyra, V., Iterated deferred corrections for nonlinear boundary value problems, Numer. Math.11, 111–125, 1968.
[Per79] Pereyra, V., PASVA3: An adaptive finite difference Fortran program for first order nonlinear, ordinary boundary problems, in Codes for Boundary Value Problems in Ordinary Differential Equations (B. Childs, M. Scott, J. W. Daniel, E. Denman and P. Nelson, eds.), 67–88, Lecture Notes in Computer Science 76, New York, Springer, 1979.
[Russ82] Russell, R. D., Global codes for BVODE's and their comparison, in Numerical Integration of Differential Equations and Large Linear Systems (A. Dold and B. Eckmann, eds.), 256–268, Lecture Notes in Mathematics 968, New York, Springer, 1982.
Author information
Authors and Affiliations
Additional information
Dedicated to Professor Hans J. Stetter on the occasion of his 60th birthday
Rights and permissions
About this article
Cite this article
Cash, J.R., Wright, M.H. Implementation issues in solving nonlinear equations for two-point boundary value problems. Computing 45, 17–37 (1990). https://doi.org/10.1007/BF02250582
Received:
Issue Date:
DOI: https://doi.org/10.1007/BF02250582