Abstract
Frommer's nonlinear multisplitting methods for solving nonlinear systems of equations are extended to the asynchronous setting. Block methods are extended to include overlap as well. Several specific cases are discussed. Sufficient conditions to guarantee their local convergence are given. A numerical example is presented illustrating the performance of the new approach.
Similar content being viewed by others
References
J. Bahi, J.-C. Miellou and K. Rhofir, Asynchronous multisplitting methods for nonlinear fixed point problems, Numer. Algorithms 15 (1997) 315–345.
Z.-Z. Bai, On the convergence of parallel chaotic nonlinear multisplitting Newton-type methods, J. Comput. Appl. Math. 80 (1997) 317–334.
Z.-Z. Bai, V. Migallón, J. Penadés and D.B. Szyld, Block and asynchronous two-stage methods for mildly nonlinear systems, Numer. Math. 82 (1999) 1–20.
G.M. Baudet, Asynchronous iterative methods for multiprocessors, J. Assoc. Comput. Mach. 25 (1978) 226–244.
A. Berman and R.J. Plemmons, Nonnegative Matrices in the Mathematical Sciences, 3rd ed. (Academic Press, New York, 1979); reprinted (SIAM, Philadelphia, 1994).
D.P. Bertsekas and J.N. Tsitsiklis, Parallel and Distributed Computation (Prentice-Hall, Englewood Cliffs, NJ, 1989).
K. Blathras, D.B. Szyld and Y. Shi, Timing models and local stopping criteria for asynchronous iterative algorithms, J. Parallel Distributed Comput. 58 (1999) 446–465.
R. Bru, V. Migallón, J. Penadés and D.B. Szyld, Parallel, synchronous and asynchronous two-stage multisplitting methods, Electronic Trans. Numer. Anal. 3 (1995) 24–38.
D. Chazan and W. Miranker, Chaotic relaxation, Linear Algebra Appl. 2 (1969) 199–222.
D. El Baz, A method of terminating asynchronous iterative algorithms on message passing systems, Parallel Algorithms Appl. 9 (1996) 153–158.
M.N. El Tarazi, Some convergence results for asynchronous algorithms, Numer. Math. 39 (1982) 325–340.
D.J. Evans and D.-R. Wang, An asynchronous algorithm for solving a class of a nonlinear simultaneous equations, Parallel Computing 17 (1991) 165–180.
A. Frommer, Parallel nonlinear multisplitting methods, Numer. Math. 56 (1989) 269–282.
A. Frommer, H. Schwandt and D.B. Szyld, Asynchronous weighted additive Schwarz methods, Electronic Trans. Numer. Anal. 5 (1997) 48–61.
A. Frommer and D.B. Szyld, H-splittings and two-stage iterative methods, Numer. Math. 63 (1992) 345–356.
A. Frommer and D.B. Szyld, On asynchronous iterations, J. Comput. Appl. Math. 123 (2000) 201–216.
W. Mönch, Convergence of parallel nonlinear regular and weak regular multisplitting methods, Technical Report 96–10, Fakultät für Mathematik und Informatik, Technische Universität Bergakademie Freiberg (1996).
D.P. O'Leary and R.E. White, Multi-splittings of matrices and parallel solution of linear systems, SIAM J. Algebraic Discrete Methods 6 (1985) 630–640.
J.M. Ortega and W.C. Rheinboldt, Iterative Solution of Nonlinear Equations in Several Variables (Academic Press, New York, 1970).
S.A. Savari and D.P. Bertserkas, Finite termination of asynchronous iterative algorithms, Parallel Computing 22 (1996) 39–56.
A.H. Sherman, On Newton-iterative methods for the solution of systems of nonlinear equations, SIAM J. Numer. Anal. 15 (1978) 755–771.
Y. Shi, The SAG distributed programming model and its applications to scientific computing, in: Proc. of the 5th SIAM Conf. on Parallel Processing for Scientific Computing, eds. J. Dongarra, K. Kennedy, P. Messina, D. Sorensen and R. Voigt (SIAM, Philadelphia, PA, 1991); see also http://www.cis.temple.edu/_shi/synergy.
X. Sun, A generalization of parallel multisplitting methods for a nonlinear problem, Semiannual Journal of Nanjing University, Mathematics (Nan Jing Da Xue Xue Bao Shu Xue Ban Yue Kan) 1 (1992).
D.B. Szyld, Different models of parallel asynchronous iterations with overlapping blocks, Comput. Appl. Math. 17 (1998) 101–115.
R.S. Varga, Matrix Iterative Analysis (Prentice-Hall, Englewood Cliffs, NJ, 1962); 2nd ed., revised and expanded: (Springer, Berlin, 2000).
R.E. White, A nonlinear parallel algorithm with application to the Stefan problem, SIAM J. Numer. Anal. 23 (1986) 639–652.
R.E. White, Parallel algorithms for nonlinear problems, SIAMJ. Algebraic Discrete Methods 7 (1986) 137–149.
J.-J. Xu, Convergence of partially asynchronous block quasi-Newton methods for nonlinear systems of equations, J. Comput. Appl. Math. 103 (1999) 307–321.
J.-J. Xu and H.-H. Wang, A class of asynchronous block methods for nonlinear systems of equations, in: Proc. of the 7th SIAM Conf. on Parallel Processing for Scientific Computing, eds. D.H. Bailey et al. (SIAM, Phialdeplphia, PA, 1995) pp. 108–109.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Szyld, D.B., Xu, JJ. Convergence of some asynchronous nonlinear multisplitting methods. Numerical Algorithms 25, 347–361 (2000). https://doi.org/10.1023/A:1016617309072
Issue Date:
DOI: https://doi.org/10.1023/A:1016617309072