Skip to main content
Log in

Parallel Numerical Picard Iteration Methods

  • Published:
Journal of Scientific Computing Aims and scope Submit manuscript

Abstract

In this work, we propose a new class of parallel time integrators for initial-value problems based on the well-known Picard iteration. To this end, we first investigate a class of sequential integrators, known as numerical Picard iteration methods, which falls into the general framework of deferred correction methods. We show that the numerical Picard iteration methods admit a \(\min (J,M+1)\)-order rate of convergence, where J denotes the number of Picard iterations and \(M+1\) is the number of collocation points. We then propose a class of parallel solvers so that J Picard iterations can be proceeded simultaneously and nearly constantly. We show that the parallel solvers yield the same convergence rate as that of the numerical Picard iteration methods. The main features of the proposed parallelized approach are as follows. (1) Instead of computing the solution point by point [as in revisionist integral deferred correction (RIDC) methods], the proposed methods proceed segment by segment. (2) The proposed approach leads to a higher speedup; the speedup is shown to be \(J(M+1)\) (while the speedup of the Jth order RIDC is, at most, J). (3) The approach is applicable for non-uniform points, such as Chebyshev points. The stability region of the proposed methods is analyzed in detail, and we present numerical examples to verify the theoretical findings.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

Availability of Data and Materials

The datasets generated and/or analyzed during the current study are available from the corresponding author on reasonable request.

References

  1. Atkinson, K.: An Introduction to Numerical Analysis. Wiley, Hoboken (1989)

    MATH  Google Scholar 

  2. Bai, X., Junkins, J.L.: Modified Chebyshev–Picard iteration methods for orbit propagation. J. Astronaut. Sci. 58(4), 583–613 (2011)

    Article  Google Scholar 

  3. Brenan, K.E., Campbell, S.L., Petzold, L.R.: Numerical Solution of Initial Value Problems in Differential-Algebraic Equations. SIAM, Philadelphia (1995)

    Book  MATH  Google Scholar 

  4. Burrage, K.: Parallel and Sequential Methods for Ordinary Differential Equations. Numerical Mathematics and Scientific Computation. The Clarendon Press, Oxford University Press, New York (1995)

    MATH  Google Scholar 

  5. Butcher, J.: The Numerical Analysis of Ordinary Differential Equations: Runge–Kutta and General Linear Methods. Wiley, New Fork (1987)

    MATH  Google Scholar 

  6. Christlieb, A., Ong, B.W., Qiu, J.: Integral deferred correction methods constructed with high order Runge–Kutta integrators. Math. Comput. 79(270), 761–783 (2010)

    Article  MathSciNet  MATH  Google Scholar 

  7. Christlieb, A.J., Haynes, R.D., Ong, B.W.: A parallel space-time algorithm. SIAM J. Sci. Comput. 34(5), C233–C248 (2012)

    Article  MathSciNet  MATH  Google Scholar 

  8. Christlieb, A.J., Macdonald, C.B., Ong, B.W.: Parallel high-order integrators. SIAM J. Sci. Comput. 32(2), 818–835 (2010)

    Article  MathSciNet  MATH  Google Scholar 

  9. Clenshaw, C.W.: The numerical solution of linear differential equations in Chebyshev series. Math. Proc. Camb. Philos. Soc. 53, 134–149 (1957)

    Article  MathSciNet  MATH  Google Scholar 

  10. Clenshaw, C.W., Curtis, A.R.: A method for numerical integration on an automatic computer. Numer. Math. 2(1), 197–205 (1960)

    Article  MathSciNet  MATH  Google Scholar 

  11. Clenshaw, C.W., Norton, H.J.: The solution of nonlinear ordinary differential equations in Chebyshev series. Comput. J. 6(1), 88–92 (1963)

    Article  MathSciNet  MATH  Google Scholar 

  12. Dutt, A., Greengard, L., Rokhlin, V.: Spectral deferred correction methods for ordinary differential equations. BIT 40(2), 241–266 (2000)

    Article  MathSciNet  MATH  Google Scholar 

  13. Gander, M.J.: 50 years of time parallel time integration. In: Carraro, T., Geiger, M., Körkel, S., Rannacher, R. (eds.) Multiple Shooting and Time Domain Decomposition Methods, pp. 69–113. Springer International Publishing, Cham (2015)

    Chapter  Google Scholar 

  14. Gander, M.J., Liu, J., Wu, S.L., Yue, X., Zhou, T.: Paradiag: Parallel-in-Time Algorithms Based on the Diagonalization Technique (2020). arXiv:2005.09158

  15. Gear, C.W.: Numerical Initial Problems in Ordinary Differential Equations. Prentice-Hall, Englewood Cliffs (1971)

    MATH  Google Scholar 

  16. Hairer, E., Nøsett, S.P., Wanner, G.: Solving Ordinary Differential Equations I. Non-stiff Problems. Springer, Berlin (1993)

    Google Scholar 

  17. Lambert, J.D.: Numerical Methods for Ordinary Differential Equations. Wiley, New York (1991)

    MATH  Google Scholar 

  18. Lindelöf, E.: Sur l’application de la méthode des approximations successives aux équations différentielles ordinaires du premier ordre. C R Hebd Séances Acad Sci 114, 454–457 (1894)

    MATH  Google Scholar 

  19. Lions, J.L., Maday, Y., Turinici, G.: A “parareal’’ in time discretization of PDE’s. C. R. Acad. Sci. Paris Sér. I-Math. 332, 661–668 (2001)

    Article  MathSciNet  MATH  Google Scholar 

  20. Nievergelt, J.: Parallel methods for integrating ordinary differential equations. Commun. ACM 7(12), 731–733 (1964)

    Article  MathSciNet  MATH  Google Scholar 

  21. Ong, B.W., Spiteri, R.J.: Deferred correction methods for ordinary differential equations. J. Sci. Comput. 83(60), 1–29 (2020)

    MathSciNet  MATH  Google Scholar 

  22. Ong, B.W., Schroder, J.B.: Applications of time parallelization. Comput. Vis. Sci. 23, 1–4 (2020)

    Article  MathSciNet  Google Scholar 

  23. Peano, G.: Resto nelle formule di quadrature, espresso con un integrale definito. Rom. Acc. L. Rend. 22, 562–569 (1913)

    MATH  Google Scholar 

  24. Tang, T., Xie, H., Yin, X.: High-order convergence of spectral deferred correction methods on general quadrature nodes. J. Sci. Comput. 56(1), 1–13 (2012)

    Article  MathSciNet  MATH  Google Scholar 

  25. Tang, T., Xu, X.: Accuracy enhancement using spectral postprocessing for differential equations and integral equations. Commun. Comput. Phys. 2–4, 779–792 (2009)

    MathSciNet  MATH  Google Scholar 

  26. Woollands, R., Bani Younes, A., Junkins, J.: New solutions for the perturbed Lambert problem using regularization and Picard iteration. J. Guid. Control. Dyn. 38(9), 1548–1562 (2011)

    Article  Google Scholar 

  27. Woollands, R., Junkins, J.L.: Nonlinear differential equation solvers via adaptive Picard Chebyshev iteration: applications in astrodynamics. J. Guid. Control. Dyn. 42(5), 1007–1022 (2019)

    Article  Google Scholar 

Download references

Acknowledgements

The authors would like to express their most sincere thanks to the anonymous referees for their valuable comments. This research was partially supported by the National Natural Science Foundation of China (Grant No. 12201635, 62231026, 12271523), the Natural Science Foundation of Hunan Province, China (Grant No. 2022JJ40541) and the Research Fund of National University of Defense Technology (Grant No. ZK19-19).

Funding

The authors have not disclosed any funding.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yinkun Wang.

Ethics declarations

Conflict of interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wang, Y. Parallel Numerical Picard Iteration Methods. J Sci Comput 95, 27 (2023). https://doi.org/10.1007/s10915-023-02156-y

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10915-023-02156-y

Keywords

Navigation