Skip to main content
Log in

On nonsymmetric saddle point matrices that allow conjugate gradient iterations

  • Published:
Numerische Mathematik Aims and scope Submit manuscript

Abstract

Linear systems in saddle point form are usually highly indefinite,which often slows down iterative solvers such as Krylov subspace methods. It has been noted by several authors that negating the second block row of a symmetric indefinite saddle point matrix leads to a nonsymmetric matrix \({{\mathcal A}}\) whose spectrum is entirely contained in the right half plane. In this paper we study conditions so that \({{\mathcal A}}\) is diagonalizable with a real and positive spectrum. These conditions are based on necessary and sufficient conditions for positive definiteness of a certain bilinear form,with respect to which \({{\mathcal A}}\) is symmetric. In case the latter conditions are satisfied, there exists a well defined conjugate gradient (CG) method for solving linear systems with \({{\mathcal A}}\). We give an efficient implementation of this method, discuss practical issues such as error bounds, and present numerical experiments.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Ashby S.F., Holst M.J., Manteuffel T.A. and Saylor P.E. (2001). The role of the inner product in stopping criteria for conjugate gradient iterations. BIT 41: 26–52

    Article  MATH  MathSciNet  Google Scholar 

  2. Ashby S.F., Manteuffel T.A. and Saylor P.E. (1990). A taxonomy for conjugate gradient methods. SIAM J. Numer. Anal. 27: 1542–1568

    Article  MATH  MathSciNet  Google Scholar 

  3. Axelsson O. (1994). Iterative Solution Methods. Cambridge University Press, Cambridge

    MATH  Google Scholar 

  4. Benzi M., Golub G.H. and Liesen J. (2005). Numerical solution of saddle point problems. Acta Numer. 14: 1–137

    Article  MATH  MathSciNet  Google Scholar 

  5. Benzi M. and Simoncini V. (2006). On the eigenvalues of a class of saddle point matrices. Numer. Math. 103: 173–196

    Article  MATH  MathSciNet  Google Scholar 

  6. Bramble J.H. and Pasciak J.E. (1988). A preconditioning technique for indefinite systems resulting from mixed approximations of elliptic problems. Math. Comp. 50: 1–17

    Article  MATH  MathSciNet  Google Scholar 

  7. Elman, H.C., Silvester, D.J., Wathen, A.J.:Finite elements and fast iterative solvers: with applications in incompressible fluid dynamics. In: Numerical Mathematics and Scientific Computation. Oxford University Press, New York (2005)

  8. Fischer B., Ramage A., Silvester D.J. and Wathen A.J. (1998). Minimum residual methods for augmented systems. BIT 38: 527–543

    Article  MATH  MathSciNet  Google Scholar 

  9. Gantmacher F.R. (1959). The Theory of Matrices. Chelsea Publishing Co., New York

    MATH  Google Scholar 

  10. Givens W. (1952). Fields of values of a matrix. Proc. Am. Math. Soc. 3: 206–209

    Article  MATH  MathSciNet  Google Scholar 

  11. Hestenes M.R. and Stiefel E. (1952). Methods of conjugate gradients for solving linear systems. J. Res. Nat. Bur. Stand. 49: 409–436

    MATH  MathSciNet  Google Scholar 

  12. Householder A.S. (1975). The theory of matrices in numerical analysis (reprint of 1964 edition). Dover Publications Inc., New York

    Google Scholar 

  13. The MathWorks Company. Matlab, version 6.5.http://www.mathworks.com

  14. Paige C.C. and Saunders M.A. (1975). Solution of sparse indefinite systems of linear equations. SIAM J. Numer. Anal. 12: 617–629

    Article  MATH  MathSciNet  Google Scholar 

  15. Silvester, D.J., Elman, H.C., Ramage, A.: Incompressible Flow Iterative Solution Software (IFISS), version 2.2.http://www.manchester.ac.uk/ifiss

  16. Sleijpen G.L.G., van der Vorst H.A. and Modersitzki J. (2000). Differences in the effects of rounding errors in Krylov solvers for symmetric indefinite linear systems. SIAM J. Matrix Anal. Appl. 22: 726–751

    Article  MATH  MathSciNet  Google Scholar 

  17. Stoll, M., Wathen, A.: The Bramble–Pasciak preconditioner for saddlepoint problems. Numerical Analysis Group Research Report NA-07/13. Oxford University, Computing Laboratory (2007)

  18. Stoll, M., Wathen, A.: Combination preconditioning and self-adjointness in non-standard inner products with application to saddle point problems. Numerical Analysis Group Research Report NA-07/11. Oxford University, Computing Laboratory (2007)

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jörg Liesen.

Additional information

In memory of Gene Golub (1932–2007), our wonderful friend and colleague, who had a great interest in the conjugate gradient method and the numerical solution of saddle point problems.

The work of Jörg Liesen was supported by the Emmy Noether-Program and the Heisenberg-Program of the Deutsche Forschungsgemeinschaft.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Liesen, J., Parlett, B.N. On nonsymmetric saddle point matrices that allow conjugate gradient iterations. Numer. Math. 108, 605–624 (2008). https://doi.org/10.1007/s00211-007-0131-9

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00211-007-0131-9

Mathematics Subject Classification (2000)

Navigation