Abstract
This paper describes a hybrid two-level parallel method with MPI/OpenMP for computing the eigenvalues of dense symmetric matrices on cluster of SMP’s environments. The eigenvalue computation is Based on both the Householder tridiagonalization method and a divide-and-conquer algorithm of tridiagonal eigenproblem. In hybrid parallel design, We take a coarse-grain approach to OpenMP shared-memory parallelization, which keeps BLAS-3 operations in tridiagonalization. Moreover, dynamic work sharing is used in the divide-and-conquer algorithm of tridiagonal eigenproblem. So the amount of synchronization has also been reduced, and these could have an effect on the load balance. In addition, we analyze the communication overhead between hybrid MPI/ OpenMP and pure MPI. An experimental analysis on the Deepcomp6800 shows the hybrid algorithm performs good scalability.
This work was partially supported by the National Natural Science Foundation of China (No.60533020, No.60373060, No.60673064), 973 Program(2005CB321702).
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Bova, S.W., Breshears, C., Cuicchi, C., Demirbilek, Z., Gabb, H.A.: Dual-level parallel analysis of harbor wave response using MPI and OpenMP. Int. J. Perform Comput. Appl. 14, 49–64 (2000)
Rabense, R., Wellein, G.: Communication and optimization aspects of parallel programming models on hybrid architecture. International Journal of High performance Computing Applications 17(1), 49–62 (2003)
Dong, S., Karniadakis, G.E.: Dual_level parallelism for high-order CFD methods. Parallell Computing 30, 1–20 (2004)
Cappello, F., Etiemble, D.: MPI versus MPI+OpenMP on IBM SP for the NAS benchmarks. In: Proceedings of the 2000 ACM/IEEE conference on Supercomputing, Dallas, Texas, USA (2000)
Blackford, L.S., Choi, J., Cleary, A., D’Azevedo, E., Demmel, J., Dhillon, I.S., et al.: ScaLAPACK Users’s Guide. SIAM, USA (1997)
Luong, P., Breshears, C.P., Ly, L.N.: Coastal ocean modeling of the U.S. west coast with multiblock grid and dual-level parallelism. In: Supercomputing 2001: High Performance Networking and Computing (SC2001)
Loft, R.D., Thomas, S.J., Dennis, J.M.: Terascale spectral element dynamical core for atmospheric general circulation models. Supercomputing 2001: High Performance Networking and Computing (SC2001)
Hendrickson, B., Jessup, E., Smith, C.: Toward an efficent parallel eigensolver for dense symmetric matrices. SIAM J.Sci. Compute. 20(3), 1132–1154 (1999)
Demmel, J.: In: Applied Numerical Linear Algebra. SIAM, USA (1997)
Zhao, Y., Chen, J., Chi, X.B.: Solving the symmetric tridiagonal eigenproblem using MPI/OpenMP hybrid parallelization. In: Cao, J., Nejdl, W., Xu, M. (eds.) APPT 2005. LNCS, vol. 3756, pp. 164–173. Springer, Heidelberg (2005)
Cuppen, J.J.M.: A divide and conquer method for symmetric tridiagonal eigenproblem. Numer. Mathematik. 2(36), 177–195 (1981)
Sameh, A., Kuck, D.: A parallel QR algorithm for symmetric tridiagonal matrices. IEEE tans. Comput. C-26, 81–91 (1977)
LI, T.Y., Zeng, Z.: Lagurre’s iteration in solving the symmetric tridiagonal eigenproblem. SIAM J. Scientific Comput. 15, 1145–1173 (1994)
Gu, M., Eisenstat, S.C.: A divide-and conquer algorithm for symmetric tridiagonal eigenproblem. SIAM J. Mat. Anal. Appl. 16(1), 172–191 (1995)
Dhillon, I.S., Parlett, B.N.: Multiple representations compute orthogonal eigenvertors of symmetric tridiagonal matrices. Lin. Alg. Appl. 387, 1–28 (2004)
http://www.hpcx.ac.uk/support/documentation/IBMdocuments/a2272734.pdf
Philadelphia, 1997 Bischof, C. Gerorge, W. Huss-Lederman, S. Sun, X., Tsao, A., Turnbull, T.: Prism software (1997), http://www.mcs.anl.gov/Projects/PRISM/lib/software.html
Alpatov, P., Baker, G., Edwards, C., Gunnels, J., Morrow, G., Overfelt, J., van de Gejin, R., Wu, Y.-J.J.: PLAPACK: Parallel linear algebra package - design overview. In: Processing of SC 1997 (1997)
Fann, G., Littlefield, R.: Performance of a fully parallel dense real symmetric eigensolver in quantum chemistry applications. In: Proceedings of the Sixth SIAM Conference on Parallel Processing for Scientific Computation. SIAM (1994)
Treffz, C., Huanf, C.C.: A scalable eigenvalue solver for symmetric tridiagonal matrices. Parallel Computing 21, 1213–1240 (1995)
Liu, W., Zheng, W.M., Zheng, X.W.: The concept of node-oriented speedup on SMP cluster. Computer engineering and design, vol. 21(5) (October 2000)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zhao, Y., Chi, X., Cheng, Q. (2007). An Implementation of Parallel Eigenvalue Computation Using Dual-Level Hybrid Parallelism. In: Jin, H., Rana, O.F., Pan, Y., Prasanna, V.K. (eds) Algorithms and Architectures for Parallel Processing. ICA3PP 2007. Lecture Notes in Computer Science, vol 4494. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-72905-1_10
Download citation
DOI: https://doi.org/10.1007/978-3-540-72905-1_10
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-72904-4
Online ISBN: 978-3-540-72905-1
eBook Packages: Computer ScienceComputer Science (R0)