Abstract
Starting from a specific implementation of the Lanczos biorthogonalization algorithm, an iterative process for the solution of systems of linear equations with general non-Hermitian coefficient matrix is derived. Due to the orthogonalization of the underlying Lanczos process the resulting iterative scheme involves inner products leading to global communication and synchronization on parallel processors. For massively parallel computers, these effects cause considerable delays often preventing the scalability of the implementation. In the process proposed, all inner product-like operations of an iteration step are independent such that the implementation consists of only a single global synchronization point per iteration. In exact arithmetic, the process is shown to be mathematically equivalent to the biconjugate gradient method. The efficiency of this new variant is demonstrated by numerical experiments on a PARAGON system using up to 121 processors.
The work of this author was supported by the Graduiertenkolleg “Informatik und Technik”, RWTH Aachen, 52056 Aachen, Germany.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
H. M. Bücker and M. Sauren. A Parallel Version of the Quasi-Minimal Residual Method Based on Coupled Two-Term Recurrences. In J. Waśniewski, J. Dongarra, K. Madsen, and D. Olesen, editors, Applied Parallel Computing: Industrial Computation and Optimization, Proceedings of the Third International Workshop, PARA '96, Lyngby, Denmark, August 18–21, 1996, Volume 1184 of Lecture Notes in Computer Science, pages 157–165, Berlin, 1996. Springer.
H. M. Bücker and M. Sauren. A Parallel Version of the Unsymmetric Lanczos Algorithm and its Application to QMR. Internal Report KFA-ZAM-IB-9605, Research Centre Jülich, Jülich, Germany, March 1996.
H. M. Bücker and M. Sauren. A Variant of the Biconjugate Gradient Method Suitable for Massively Parallel Computing. Internal Report KFA-ZAM-IB-9702, Research Centre Jülich, Jülich, Germany, 1997.
J. K. Cullum and A. Greenbaum. Relations between Galerkin and Norm-Minimizing Iterative Methods for Solving Linear Systems. SIAM Journal on Matrix Analysis and Applications, 17(2):223–247, 1996.
R. Fletcher. Conjugate Gradient Methods for Indefinite Systems. In G. A. Watson, editor, Numerical Analysis Dundee 1975, volume 506 of Lecture Notes in Mathematics, pages 73–89, Berlin, 1976. Springer.
R. W. Freund. The Look-Ahead Lanczos Process for Large Nonsymmetric Matrices and Related Algorithms. In M. S. Moonen, G. H. Golub, and B. L. R. De Moor, editors, Linear Algebra for Large Scale and Real-Time Applications, volume 232 of NATO ASI Series E: Applied Sciences, pages 137–163. Kluwer Academic Publishers, Dordrecht, The Netherlands, 1993. Proceedings of the NATO Advanced Study Institute on Linear Algebra for Large Scale and Real-Time Applications, Leuven, Belgium, August 1992.
R. W. Freund, G. H. Golub, and N. M. Nachtigal. Iterative Solution of Linear Systems. In Acta Numerica 1992, pages 1–44. Cambridge University Press, Cambridge, 1992.
R. W. Freund, M. H. Gutknecht, and N. M. Nachtigal. An Implementation of the Look-Ahead Lanczos Algorithm for Non-Hermitian Matrices. SIAM Journal on Scientific Computing, 14(1):137–158, 1993.
R. W. Freund and N. M. Nachtigal. An Implementation of the QMR Method Based on Coupled Two-Term Recurrences. SIAM Journal on Scientific Computing, 15(2):313–337, 1994.
C. Lanczos. An Iteration Method for the Solution of the Eigenvalue Problem of Linear Differential and Integral Operators. Journal of Research of the National Bureau of Standards, 45(4):255–282, 1950.
C. Lanczos. Solutions of Systems of Linear Equations by Minimized Iterations. Journal of Research of the National Bureau of Standards, 49(1):33–53, 1952.
Y. Saad. Iterative Methods for Sparse Linear Systems. PWS Publishing Company, Boston, 1996.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1997 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Bücker, H.M., Sauren, M. (1997). A variant of the biconjugate gradient method suitable for massively parallel computing. In: Bilardi, G., Ferreira, A., Lüling, R., Rolim, J. (eds) Solving Irregularly Structured Problems in Parallel. IRREGULAR 1997. Lecture Notes in Computer Science, vol 1253. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-63138-0_7
Download citation
DOI: https://doi.org/10.1007/3-540-63138-0_7
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-63138-5
Online ISBN: 978-3-540-69157-0
eBook Packages: Springer Book Archive