Abstract
In this paper, we consider the problem of finding fill-preserving sparse matrix orderings for parallel factorization. That is, given a large sparse symmetric and positive definite matrix A that has been ordered by some fill-reducing ordering, we want to determine a reordering that is appropriate in terms of preserving the sparsity and minimizing the cost to perform the Cholesky factorization in parallel. Past researches on this problem all are based on the elimination tree model, in which each node represents the task for factoring a column, and thus, can be seen as a coarse-grained task dependence model. To exploit more parallelism, Joseph Liu proposed a medium-grained task model, called the column task graph, and showed that it is amenable to the shared-memory supercomputers. Based on the column task graph, we devise a greedy reordering algorithm, and show that our algorithm can find the optimal ordering among the class of all fill-preserving orderings of the given sparse matrix A.
Similar content being viewed by others
References
B. Aspvall and P. Heggernes. Finding minimum height elimination tree for interval graphs in polynomial time. BIT, 34:484-509, 1994.
J. R. S. Blair and B. W. Peyton. On finding minimum-diameter clique trees. Nordic Journal of Computing, 1:173-201, 1994.
A. George and J. W. H. Liu. Computer Solution of Large Sparse Positive Definite Systems. Prentice Hall, EnglewoodCliffs, NJ, 1981.
J. R. Gilbert and R. Schreiber. Highly parallel sparse Cholesky factorization. SIAM Journal on Scientific and Statistic Computing, 13:1151-1172, 1992.
M. T. Heath, E. Ng and B. W. Peyton. Parallel algorithms for sparse linear systems. SIAM Review, 33:420-460, 1991.
J. A. G. Jess and H. G. M. Kess. A data structure for parallel L/U decomposition. IEEE Transactions on Computers 31:231-239, 1982.
C. E. Leiserson and J. G. Lewis. Orderings for parallel sparse symmetric factorization. In G. Rodrigure, ed., Proceedings of the Fourth SIAM Conference on Parallel Processing for Scientific Computing, pp. 27-32, SIAM, 1989.
J. G. Lewis, B. W. Peyton and A. Pothen. A fast algorithm for reordering sparse matrices for parallel factorization. SIAM Journal on Scientific and Statistic Computing, 10:1146-1173, 1989.
W.-Y. Lin and C.-L. Chen. Minimum completion time criterion for parallel sparse Cholesky factorization. In Proceedings of International Conference on Parallel Processing, pp. III 107-114. St. Charles, IL, 1993.
W.-Y. Lin and C.-L. Chen. Minimum communication cost reordering for parallel sparse Cholesky factorization. Parallel Computing, 25:943-967, 1999.
W.-Y. Lin and C.-L. Chen. On optimal fill-preserving orderings of sparse matrices for parallel Cholesky factorizations. In Proceedings of International Parallel and Distributed Processing Symposium, pp. 799-805. Cancun, Mexico, 2000.
J. W.-H. Liu. Modification of the minimum degree algorithm by multiple elimination. ACM Transactions on Mathematical Software, 12:141-153, 1985.
J. W.-H. Liu. Computational models and task scheduling for parallel sparse Cholesky factorization. Parallel Computing, 3:327-342, 1986.
J. W.-H. Liu. Reordering sparse matrices for parallel elimination. Parallel Computing, 11:73-91, 1989.
J. W.-H. Liu and A. Mirzaian. A linear reordering algorithm for parallel pivoting of Chordal graphs. SIAM Journal on Discrete Mathematics, 2:100-107, 1989.
F. Manne. Reducing the height of an elimination tree through local reorderings. Technical report CS-91-51. University of Bergen, Norway, 1991.
D. J. Rose. A graph-theoretic study of the numerical solution of sparse positive definite systems of linear equations. In R. C. Read, ed., Graph Theory and Computing, pp. 183-217. Academic Press, New York, 1972.
E. Rothberg. Performance of panel and block approaches to sparse Cholesky factorization on the iPSC/860 and P aragon multicomputers. SIAM Journal on Scientific Computing, 17:699-713, 1996.
A. Pothen. The complexity of optimal elimination trees. Technical report CS-88-16. Department of Computer Science, Pennsylvania State University, 1988.
R. Schreiber. A new implementation of sparse Gaussian elimination. ACM Transactions on Mathematical Software, 8:256-276, 1982.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Lin, WY. Finding Optimal Ordering of Sparse Matrices for Column-Oriented Parallel Cholesky Factorization. The Journal of Supercomputing 24, 259–277 (2003). https://doi.org/10.1023/A:1022032830105
Issue Date:
DOI: https://doi.org/10.1023/A:1022032830105