Skip to main content
Log in

Finding Optimal Ordering of Sparse Matrices for Column-Oriented Parallel Cholesky Factorization

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

In this paper, we consider the problem of finding fill-preserving sparse matrix orderings for parallel factorization. That is, given a large sparse symmetric and positive definite matrix A that has been ordered by some fill-reducing ordering, we want to determine a reordering that is appropriate in terms of preserving the sparsity and minimizing the cost to perform the Cholesky factorization in parallel. Past researches on this problem all are based on the elimination tree model, in which each node represents the task for factoring a column, and thus, can be seen as a coarse-grained task dependence model. To exploit more parallelism, Joseph Liu proposed a medium-grained task model, called the column task graph, and showed that it is amenable to the shared-memory supercomputers. Based on the column task graph, we devise a greedy reordering algorithm, and show that our algorithm can find the optimal ordering among the class of all fill-preserving orderings of the given sparse matrix A.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. B. Aspvall and P. Heggernes. Finding minimum height elimination tree for interval graphs in polynomial time. BIT, 34:484-509, 1994.

    Google Scholar 

  2. J. R. S. Blair and B. W. Peyton. On finding minimum-diameter clique trees. Nordic Journal of Computing, 1:173-201, 1994.

    Google Scholar 

  3. A. George and J. W. H. Liu. Computer Solution of Large Sparse Positive Definite Systems. Prentice Hall, EnglewoodCliffs, NJ, 1981.

    Google Scholar 

  4. J. R. Gilbert and R. Schreiber. Highly parallel sparse Cholesky factorization. SIAM Journal on Scientific and Statistic Computing, 13:1151-1172, 1992.

    Google Scholar 

  5. M. T. Heath, E. Ng and B. W. Peyton. Parallel algorithms for sparse linear systems. SIAM Review, 33:420-460, 1991.

    Google Scholar 

  6. J. A. G. Jess and H. G. M. Kess. A data structure for parallel L/U decomposition. IEEE Transactions on Computers 31:231-239, 1982.

    Google Scholar 

  7. C. E. Leiserson and J. G. Lewis. Orderings for parallel sparse symmetric factorization. In G. Rodrigure, ed., Proceedings of the Fourth SIAM Conference on Parallel Processing for Scientific Computing, pp. 27-32, SIAM, 1989.

  8. J. G. Lewis, B. W. Peyton and A. Pothen. A fast algorithm for reordering sparse matrices for parallel factorization. SIAM Journal on Scientific and Statistic Computing, 10:1146-1173, 1989.

    Google Scholar 

  9. W.-Y. Lin and C.-L. Chen. Minimum completion time criterion for parallel sparse Cholesky factorization. In Proceedings of International Conference on Parallel Processing, pp. III 107-114. St. Charles, IL, 1993.

  10. W.-Y. Lin and C.-L. Chen. Minimum communication cost reordering for parallel sparse Cholesky factorization. Parallel Computing, 25:943-967, 1999.

    Google Scholar 

  11. W.-Y. Lin and C.-L. Chen. On optimal fill-preserving orderings of sparse matrices for parallel Cholesky factorizations. In Proceedings of International Parallel and Distributed Processing Symposium, pp. 799-805. Cancun, Mexico, 2000.

  12. J. W.-H. Liu. Modification of the minimum degree algorithm by multiple elimination. ACM Transactions on Mathematical Software, 12:141-153, 1985.

    Google Scholar 

  13. J. W.-H. Liu. Computational models and task scheduling for parallel sparse Cholesky factorization. Parallel Computing, 3:327-342, 1986.

    Google Scholar 

  14. J. W.-H. Liu. Reordering sparse matrices for parallel elimination. Parallel Computing, 11:73-91, 1989.

    Google Scholar 

  15. J. W.-H. Liu and A. Mirzaian. A linear reordering algorithm for parallel pivoting of Chordal graphs. SIAM Journal on Discrete Mathematics, 2:100-107, 1989.

    Google Scholar 

  16. F. Manne. Reducing the height of an elimination tree through local reorderings. Technical report CS-91-51. University of Bergen, Norway, 1991.

    Google Scholar 

  17. D. J. Rose. A graph-theoretic study of the numerical solution of sparse positive definite systems of linear equations. In R. C. Read, ed., Graph Theory and Computing, pp. 183-217. Academic Press, New York, 1972.

    Google Scholar 

  18. E. Rothberg. Performance of panel and block approaches to sparse Cholesky factorization on the iPSC/860 and P aragon multicomputers. SIAM Journal on Scientific Computing, 17:699-713, 1996.

    Google Scholar 

  19. A. Pothen. The complexity of optimal elimination trees. Technical report CS-88-16. Department of Computer Science, Pennsylvania State University, 1988.

  20. R. Schreiber. A new implementation of sparse Gaussian elimination. ACM Transactions on Mathematical Software, 8:256-276, 1982.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Lin, WY. Finding Optimal Ordering of Sparse Matrices for Column-Oriented Parallel Cholesky Factorization. The Journal of Supercomputing 24, 259–277 (2003). https://doi.org/10.1023/A:1022032830105

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1022032830105

Navigation