Abstract
In this work we describe three sequential algorithms and their parallel counterparts for solving nonlinear systems, when the Jacobian matrix is symmetric and positive definite. This case appears frequently in unconstrained optimization problems. Two of the three algorithms are based on Newton’s method. The first solves the inner iteration with Cholesky decomposition while the second is based on the inexact Newton methods family, where a preconditioned CG method has been used for solving the linear inner iteration. In this latter case and to control the inner iteration as far as possible and avoid the oversolving problem, we also parallelized several forcing term criteria and used parallel preconditioning techniques. The third algorithm is based on parallelizing the BFGS method. We implemented the parallel algorithms using the SCALAPACK library. Experimental results have been obtained using a cluster of Pentium II PC’s connected through a Myrinet network. To test our algorithms we used four different problems. The algorithms show good scalability in most cases.
Work supported by Spanish CICYT. Project TIC 2000-1683-C03-03.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Anderson, E., Bai, Z., Bischof, C., Demmel, J., Dongarra, J., Du Croz, J., Greenbaum, A., Hammarling, S., Mackenney, A., Ostrouchov, S., Sorensen, D.: LAPACK Users’ Guide, 2nd edn. SIAM Publications, Philadelphia (1995)
Alonso, J.M., Alvarruiz, F., Guerrero, D., Hernández, V., Vidal, A.M., et al.: Parallel Computing in Water Network Analysis and Leakage Minimizations. Journal of Water Resources Planning and Management 126(4), 251–260 (2000)
Anton, H.: Elementary Linear Algebra. John Wiley and Sons, New York (1991)
Blackford, L.S., Choi, J., Cleary, A., D’Azevedo, E., Demmel, J., Dhillon, I., Dongarra, J., Hammarling, S., Henry, G., Petitet, A., Stanley, K., Walker, D., Whaley, R.C.: SCALAPACK Users’ Guide. SIAM Publications, Philadelphia (1997)
Dennis, J.E., Schnabel, R.: Numerical Methods for Unconstrained Optimization and Nonlinear Equations. In: Prentice-Hall Series in Computational Mathematics. Cleve Moler Advisor (1983)
Einsestat, S.C., Walker, S.C.: Choosing the Forcing Terms in an Inexact Newton Method. Center for Research on Parallel computation. Technical Report CRPRPC-TR94463. Rice University (1994)
Frayssé, V., Giraud, L.: A Set of Conjugate Gradient routines for Real and Complex Arithmetics. CERFACS Technical Report TR/PA/00/47 (2000)
Golub, G.H., Van Loan, C.F.: Matrix Computations, 3rd edn. John Hopkins University Press, Baltimore (1996)
Kelley, C.T.: Iterative Methods for Linear and Nonlinear Equations. In: Frontiers in Applied Mathematics. SIAM Publications, Philadelphia (1995)
Kumar, R., Grama, A., Gupta, A., Karypis, G.: Introduction to Parallel Computing: Design and Analysis of Algorithms. The Benjamin Cumimngs Publishing Company (1994)
Myrinet.Myrinet overview, http://www.myri.com/
Peinado, J., Vidal, A.M.: A Parallel Newton-GMRES Algorithm for Solving Large Scale Nonlinear Systems. In: Palma, J.M.L.M., Sousa, A.A., Dongarra, J., Hernández, V. (eds.) VECPAR 2002. LNCS, vol. 2565, pp. 328–342. Springer, Heidelberg (2003)
Peinado, J.: Ph.D. Thesis. Parallel Resolution of Nonlinear Systems, DSIC-UPV (September 2003)
Saad, Y., Schultz, M.: GMRES: A generalized minimal residual algorithm for solving nonsymmetric linear systems. SIAM J. Sci. Stat, Comput. 7, 856–869 (1986)
Skjellum, A.: Using MPI: Portable Programming with Message-Passing Interface. MIT Press Group, Cambridge (1994)
Whaley, R.C.: (BLACS): Analysis and Implementation Across Multiple Parallel Architectures. Computer Science Dept. Technical Report CS 94-234, University of Tennesee, Knoxville (1994)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Peinado, J., Vidal, A.M. (2005). Three Parallel Algorithms for Solving Nonlinear Systems and Optimization Problems . In: Daydé, M., Dongarra, J., Hernández, V., Palma, J.M.L.M. (eds) High Performance Computing for Computational Science - VECPAR 2004. VECPAR 2004. Lecture Notes in Computer Science, vol 3402. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11403937_49
Download citation
DOI: https://doi.org/10.1007/11403937_49
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-25424-9
Online ISBN: 978-3-540-31854-5
eBook Packages: Computer ScienceComputer Science (R0)