Skip to main content
SpringerLink
Log in

Revolve-Based Adjoint Checkpointing for Multistage Time Integration

  • Conference paper
  • First Online:
Computational Science – ICCS 2021 (ICCS 2021)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 12742))

Included in the following conference series:

Abstract

We consider adjoint checkpointing strategies that minimize the number of recomputations needed when using multistage timestepping. We demonstrate that we can improve on the seminal work based on the Revolve algorithm. The new approach provides better performance for a small number of time steps or checkpointing storage. Numerical results illustrate that the proposed algorithm can deliver up to two times speedup compared with that of Revolve and avoid recomputation completely when there is sufficient memory for checkpointing. Moreover, we discuss a tailored implementation that is arguably better suited for mature scientific computing libraries by avoiding central control assumed in the original checkpointing strategy. The proposed algorithm has been included in the PETSc library.

This work was supported in part by the U.S. Department of Energy, Office of Science, Office of Advanced Scientific Computing Research, Scientific Discovery through Advanced Computing (SciDAC) program through the FASTMath Institute under Contract DE-AC02-06CH11357 at Argonne National Laboratory.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 99.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 129.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://bitbucket.org/caidao22/pkg-revolve.git.

References

  1. Aupy, G., Herrmann, J.: Periodicity in optimal hierarchical checkpointing schemes for adjoint computations. Optim. Methods Softw. 32(3), 594–624 (2017). https://doi.org/10.1080/10556788.2016.1230612

    Article  MathSciNet  MATH  Google Scholar 

  2. Aupy, G., Herrmann, J., Hovland, P., Robert, Y.: Optimal multistage algorithm for adjoint computation. SIAM J. Sci. Comput. 38(3), C232–C255 (2016)

    Article  MathSciNet  Google Scholar 

  3. Balay, S., et al.: PETSc Users Manual. Technical report ANL-95/11 - Revision 3.7, Argonne National Laboratory (2016)

    Google Scholar 

  4. Griewank, A., Walther, A.: Algorithm 799: revolve: an implementation of checkpointing for the reverse or adjoint mode of computational differentiation. ACM Trans. Math. Softw. 26(1), 19–45 (2000). https://doi.org/10.1145/347837.347846

    Article  MATH  Google Scholar 

  5. Nagel, W.E., Walter, W.V., Lehner, W. (eds.): Euro-Par 2006. LNCS, vol. 4128. Springer, Heidelberg (2006). https://doi.org/10.1007/11823285

    Book  MATH  Google Scholar 

  6. Hundsdorfer, W., Ruuth, S.J.: IMEX extensions of linear multistep methods with general monotonicity and boundedness properties. J. Comput. Phys. 225(2007), 2016–2042 (2007). https://doi.org/10.1016/j.jcp.2007.03.003

    Article  MathSciNet  MATH  Google Scholar 

  7. Schanen, M., Marin, O., Zhang, H., Anitescu, M.: Asynchronous two-level checkpointing scheme for large-scale adjoints in the spectral-element solver Nek5000. Procedia Comput. Sci. 80, 1147–1158 (2016). https://doi.org/10.1016/j.procs.2016.05.444

    Article  Google Scholar 

  8. Stumm, P., Walther, A.: MultiStage approaches for optimal offline checkpointing. SIAM J. Sci. Comput. 31(3), 1946–1967 (2009). https://doi.org/10.1137/080718036

    Article  MathSciNet  MATH  Google Scholar 

  9. Stumm, P., Walther, A.: New algorithms for optimal online checkpointing. SIAM J. Sci. Comput. 32(2), 836–854 (2010). https://doi.org/10.1137/080742439

    Article  MathSciNet  MATH  Google Scholar 

  10. Wang, Q., Moin, P., Iaccarino, G.: Minimal repetition dynamic checkpointing algorithm for unsteady adjoint calculation. SIAM J. Sci. Comput. 31(4), 2549–2567 (2009). https://doi.org/10.1137/080727890

    Article  MathSciNet  MATH  Google Scholar 

  11. Zhang, H., Constantinescu, E.M., Smith, B.F.: PETSc TSAdjoint: a discrete adjoint ODE solver for first-order and second-order sensitivity analysis. CoRR abs/1912.07696 (2020), http://arxiv.org/abs/1912.07696

  12. Zhang, H., Sandu, A.: FATODE: a library for forward, adjoint, and tangent linear integration of ODEs. SIAM J. Sci. Comput. 36(5), C504–C523 (2014). https://doi.org/10.1137/130912335

Download references

Author information

Authors and Affiliations

  1. Mathematics and Computer Science Division, Argonne National Laboratory, Lemont, IL, 60439, USA

    Hong Zhang & Emil Constantinescu

Authors
  1. Hong Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Emil Constantinescu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hong Zhang .

Editor information

Editors and Affiliations

  1. AGH University of Science and Technology, Krakow, Poland

    Maciej Paszynski

  2. Ludwig-Maximilians-Universität München, Munich, Germany

    Dieter Kranzlmüller

  3. University of Amsterdam, Amsterdam, The Netherlands

    Valeria V. Krzhizhanovskaya

  4. University of Tennessee at Knoxville, Knoxville, TN, USA

    Jack J. Dongarra

  5. University of Amsterdam, Amsterdam, The Netherlands

    Peter M. A. Sloot

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Zhang, H., Constantinescu, E. (2021). Revolve-Based Adjoint Checkpointing for Multistage Time Integration. In: Paszynski, M., Kranzlmüller, D., Krzhizhanovskaya, V.V., Dongarra, J.J., Sloot, P.M.A. (eds) Computational Science – ICCS 2021. ICCS 2021. Lecture Notes in Computer Science(), vol 12742. Springer, Cham. https://doi.org/10.1007/978-3-030-77961-0_37

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-77961-0_37

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-77960-3

  • Online ISBN: 978-3-030-77961-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation