Skip to main content

SPAI (SParse Approximate Inverse)

  • Reference work entry
Encyclopedia of Parallel Computing

Synonyms

Sparse approximate inverse matrix

Definition

For a given sparse matrix A a sparse matrix \(M \approx {A}^{-1}\) is computed by minimizing \(\Vert AM - {I\Vert }_{F}\) in the Frobenius norm over all matrices with a certain sparsity pattern. In the SPAI algorithm the pattern of M is updated dynamically to improve the approximation until a certain stopping criterion is reached.

Discussion

Introduction

For applying an iterative solution method like the conjugate gradient method (CG), GMRES, BiCGStab, QMR, or similar algorithms, to a system of linear equations Ax = b with sparse matrix A, it is often crucial to include an efficient preconditioner. Here, the original problem Ax = b is replaced by the preconditioned system MAx = Mb or Ax = A(My) = b. In a parallel environment a preconditioner should satisfy the following conditions:

  • M can be computed efficiently in parallel.

  • Mc can be computed efficiently in parallel for any given vector c.

  • The iterative solver applied on AMx = b or MAx...

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 1,600.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 1,799.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Bibliography

  1. Alleon G, Benzi M, Giraud L (1997) Sparse approximate inverse preconditioning for dense linear systems arising in computational electromagnetics. Numer Algorith 16(1):1–15

    MATH  MathSciNet  Google Scholar 

  2. Barnard S, Grote M (1999) A block version of the SPAI preconditioner. Proceedings of the 9th SIAM conference on Parallel Processing for Scientific Computing, San Antonio, TX

    Google Scholar 

  3. Barnard ST, Clay RL (1997) A portable MPI implemention of the SPAI preconditioner in ISIS++. In: Heath M, et al (eds) Proceedings of the eighth SIAM conference on parallel processing for scientific computing, Philadelphia, PA

    Google Scholar 

  4. Benson MW, Frederickson PO (1982) Iterative solution of large sparse linear systems arising in certain multidimensional approximation problems. Utilitas Math 22:127–140

    MATH  MathSciNet  Google Scholar 

  5. Bröker O, Grote M, Mayer C, Reusken A (2001) Robust parallel smoothing for multigrid via sparse approximate inverses. SIAM J Scient Comput 23(4):1396–1417

    MATH  Google Scholar 

  6. Bröker O, Grote M (2002) Sparse approximate inverse smoothers for geometric and algebraic multigrid. Appl Num Math 41(1):61–80

    MATH  Google Scholar 

  7. Chan TFC, Mathew TP (1992) The interface probing technique in domain decomposition. SIAM J Matrix Anal Appl 13(1):212–238

    MATH  MathSciNet  Google Scholar 

  8. Chan TF, Tang WP, Wan WL (1997) Wavelet sparse approximate inverse preconditioners. BIT 37(3):644–660

    MATH  MathSciNet  Google Scholar 

  9. Chow E (2000) A priori sparsity patterns for parallel sparse approximate inverse preconditioners. SIAM J Sci Comput 21(5):1804–1822

    MATH  MathSciNet  Google Scholar 

  10. Cosgrove JDF, D´iaz JC, Griewank A (1992) Approximate inverse preconditionings for sparse linear systems. Int J Comput Math 44:91–110

    MATH  Google Scholar 

  11. Demko S, Moss WF, Smith PW (1984) Decay rates of inverses of band matrices. Math Comp 43:491–499

    MATH  MathSciNet  Google Scholar 

  12. Gould NIM, Scott JA (1995) On approximate-inverse preconditioners. Technical Report RAL-TR-95-026, Rutherford Appleton Laboratory, Oxfordshire, England

    Google Scholar 

  13. Grote MJ, Huckle T (1997) Parallel preconditioning with sparse approximate inverses. SIAM J Sci Comput 18(3):838–853

    MATH  MathSciNet  Google Scholar 

  14. Huckle T (2003) Factorized sparse approximate inverses for preconditioning. J Supercomput 25:109–117

    MATH  Google Scholar 

  15. Huckle T, Kallischko A (2007) Frobenius norm minimization and probing for preconditioning. Int J Comp Math 84(8):1225–1248

    MATH  MathSciNet  Google Scholar 

  16. Huckle T, Sedlacek M (2010) Smoothing and regularization with modified sparse approximate inverses. Journal of Electrical and Computer Engineering – Special Issue on Iterative Signal Processing in Communications, Appearing (2010)

    Google Scholar 

  17. Holland RM, Shaw GJ, Wathen AJ (2005) Sparse approximate inverses and target matrices. SIAM J Sci Comput 26(3):1000–1011

    MATH  MathSciNet  Google Scholar 

  18. Kaporin IE (1994) New convergence results and preconditioning strategies for the conjugate gradient method. Numer Linear Algebra Appl 1:179–210

    MATH  MathSciNet  Google Scholar 

  19. Kolotilina LY, Yeremin AY (1993) Factorized sparse approximate inverse preconditionings I: Theory. SIAM J Matrix Anal Appl 14(1):45–58

    MATH  MathSciNet  Google Scholar 

  20. Kolotilina LY, Yeremin AY (1995) Factorized sparse approximate inverse preconditionings II: Solution of 3D FE systems on massively parallel computers. Inter J High Speed Comput 7(2):191–215

    Google Scholar 

  21. Tang W-P (1999) Toward an effective sparse approximate inverse preconditioner. SIAM J Matrix Anal Appl 20(4):970–986

    MATH  MathSciNet  Google Scholar 

  22. Tang WP, Wan WL (2000) Sparse approximate inverse smoother for multigrid. SIAM J Matrix Anal Appl 21(4):1236–1252

    MATH  MathSciNet  Google Scholar 

  23. Zhang J (2002) A sparse approximate inverse technique for parallel preconditioning of general sparse matrices. Appl Math Comput 130(1):63–85

    MATH  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer Science+Business Media, LLC

About this entry

Cite this entry

Huckle, T., Sedlacek, M. (2011). SPAI (SParse Approximate Inverse). In: Padua, D. (eds) Encyclopedia of Parallel Computing. Springer, Boston, MA. https://doi.org/10.1007/978-0-387-09766-4_144

Download citation

Publish with us

Policies and ethics