Skip to main content
SpringerLink
Log in

Automatic Differentiation: Parallel Computation

  • Reference work entry
Encyclopedia of Optimization

  • 291 Accesses

Article Outline

Keywords

Background

Implementation Approaches

AD of Parallel Programs

AD-Enabled Parallelism

  Data Parallelism

  Time Parallelism

Parallel AD Tools

Summary

See also

References

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 2,500.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 2,499.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Abate J, Bischof Ch, Carle A, Roh L (1997) Algorithms and design for a second-order automatic differentiation module. Proc. Internat. Symp. Symbolic and Algebraic Computing (ISSAC) '97, ACM, New York, pp 149–155

    Google Scholar 

  2. Benary J (1996) Parallelism in the reverse mode. In: Berz M, Bischof Ch, Corliss G, Griewank A (eds) Computational Differentiation: Techniques, Applications, and Tools. SIAM, Philadelphia, pp 137–147

    Google Scholar 

  3. Berz M, Bischof Ch, Corliss G, Griewank A (1996) Computational differentiation: Techniques, applications, and tools. SIAM, Philadelphia

    MATH  Google Scholar 

  4. Bischof ChH (1991) Issues in parallel automatic differentiation. In: Griewank A, Corliss G (eds) Automatic Differentiation of Algorithms. SIAM, Philadelphia, pp 100–113

    Google Scholar 

  5. Bischof Ch, Carle A, Corliss G, Griewank A, Hovland P (1992) ADIFOR: Generating derivative codes from Fortran programs. Scientif Program 1(1):11–29

    Google Scholar 

  6. Bischof Ch, Carle A, Khademi P, Mauer A (1996) ADIFOR 2.0: Automatic differentiation of Fortran 77 programs. IEEE Comput Sci Eng 3(3):18–32

    Google Scholar 

  7. Bischof Ch, Green L, Haigler K, Knauff T (1994) Parallel calculation of sensitivity derivatives for aircraft design using automatic differentiation. Proc. 5th AIAA/NASA/USAF/ISSMO Symp. Multidisciplinary Analysis and Optimization, AIAA-94-4261, Amer Inst Aeronautics and Astronautics, Reston, VA, pp 73–84

    Google Scholar 

  8. Bischof ChH, Haghighat MR (1996) On hierarchical differentiation. In: Berz M, Bischof Ch, Corliss G, Griewank A (eds) Computational Differentiation: Techniques, Applications, and Tools. SIAM, Philadelphia, pp 83–94

    Google Scholar 

  9. Bischof Ch, Roh L, Mauer A (1997) ADIC – An extensible automatic differentiation tool for ANSI-C. Software Practice and Experience 27(12):1427–1456

    Google Scholar 

  10. Bischof Ch, Wu Po-Ting (1997) Time-parallel computation of pseudo-adjoints for a leapfrog scheme. Preprint Math and Computer Sci Div Argonne Nat Lab no. ANL/MCS-P639-0197

    Google Scholar 

  11. Carle A (1997) ADIFOR-MP – A prototype automatic differentiation tool for Fortran 77 with message-passing extensions. Personal communication

    Google Scholar 

  12. Foster IT, Chandy KM (1995) Fortran M: A language for modular parallel programming. J Parallel Distributed Comput 25(1)

    Google Scholar 

  13. Geist A, Beguelin A, Dongarra J, Jiang W, Manchek R, Sunderam V (1994) PVM – Parallel virtual machine: A users' guide and tutorial for network parallel computing. MIT, Cambridge, MA

    Google Scholar 

  14. Giering R, Kaminski Th (1996) Recipes for adjoint code construction. Max-Planck Inst Meteorologie, Hamburg no. 212

    Google Scholar 

  15. Griewank A (1989) On automatic differentiation. In: Iri M, Tanabe K (eds) Mathematical Programming: Recent Developments and Applications. Kluwer, Dordrecht, pp 83–108

    Google Scholar 

  16. Griewank A (1992) Achieving logarithmic growth of temporal and spatial complexity in reverse automatic differentiation. Optim Methods Softw 1(1):35–54

    MathSciNet  Google Scholar 

  17. Griewank A, Corliss G (1991) Automatic differentiation of algorithms. SIAM, Philadelphia

    MATH  Google Scholar 

  18. Griewank A, Juedes D, Utke J (1996) ADOL-C, a package for the automatic differentiation of algorithms written in C/C++. ACM Trans Math Softw 22(2):131–167

    MATH  Google Scholar 

  19. Grimm J, Pottier L, Rostaing-Schmidt N (1996) Optimal time and minimum space time product for reversing a certain class of programs. In: Berz M, Bischof Ch, Corliss G, Griewank A (eds) Computational Differentiation, Techniques, Applications, and Tools. SIAM, Philadelphia, pp 95–106

    Google Scholar 

  20. Gropp W, Lusk E, Skjellum A (1994) Using MPI – Portable parallel programming with the message passing interface. MIT, Cambridge, MA

    Google Scholar 

  21. Herley K (1993) On the NP-completeness of optimum accumulation by vertex elimination. Unpublished Manuscript

    Google Scholar 

  22. Hinkins R L (Sept. 1994) Parallel computation of automatic differentiation applied to magnetic field calculations. MSc Thesis Univ Calif

    Google Scholar 

  23. Hovland P (1997) Automatic differentiation of parallel programs. PhD Thesis Univ. Illinois at Urbana-Champaign

    Google Scholar 

  24. Hovland P, Bischof Ch (1998) Automatic differentiation of message-passing parallel programs. Proc. First Merged Internat. Parallel Processing Symp. and Symp. on Parallel and Distributed Processing, IEEE Computer Soc Press, New York

    Google Scholar 

  25. Hovland P, Bischof Ch, Spiegelman D, Casella M (1997) Efficient derivative codes through automatic differentiation and interface contraction: An application in biostatistics. SIAM J Sci Comput 18(4):1056–1066

    MathSciNet  MATH  Google Scholar 

  26. Koelbel C, Loveman D, Schreiber R, Steele G Jr, Zosel M (1994) The high performance Fortran handbook. MIT, Cambridge, MA

    Google Scholar 

  27. Roh L (1997) Personal Communication

    Google Scholar 

  28. Rostaing N, Dalmas St, Galligo A (Oct. 1993) Automatic differentiation in Odyssee. Tellus 45a(5):558–568

    Google Scholar 

  29. Shiriaev D, Griewank A (1996) ADOL-F: Automatic differentiation of Fortran codes. In: Berz M, Bischof Ch, Corliss G, Griewank A (eds) Computational Differentiation: Techniques, Applications, and Tools. SIAM, Philadelphia, pp 375–384

    Google Scholar 

  30. Snir M, Otto SW, Huss-Lederman S, Walker DW, Dongarra Jack (1996) MPI: The complete reference. MIT, Cambridge, MA

    Google Scholar 

  31. WEB http://www.mcs.anl.gov/autodiff/adtools/

  32. Zhang Y, Bischof Ch, Easter R, Wu Po-Ting (1997) Sensitivity analysis of O3 and photochemical indicators using a mixed-phase chemistry box model and automatic differentiation techniques. 90th Air and Waste Management Assoc. Annual Meeting and Exhibition June 8-13, 1997, Toronto. vol 97-WA68A.04, Air and Waste Management Assoc, Pittsburgh, PA, pp 1–16

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Institute Sci. Computing, University Technol., Flachen, Germany

    Christian H. Bischof

  2. Math. and Computer Sci. Div., Argonne National Lab., Argonne, USA

    Paul D. Hovland

Authors
  1. Christian H. Bischof
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Paul D. Hovland
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Chemical Engineering, Princeton University, Princeton, NJ, 08544-5263, USA

    Christodoulos A. Floudas

  2. Center for Applied Optimization, Department of Industrial and Systems Engineering, University of Florida, Gainesville, FL, 32611-6595, USA

    Panos M. Pardalos

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag

About this entry

Cite this entry

Bischof, C.H., Hovland, P.D. (2008). Automatic Differentiation: Parallel Computation . In: Floudas, C., Pardalos, P. (eds) Encyclopedia of Optimization. Springer, Boston, MA. https://doi.org/10.1007/978-0-387-74759-0_27

Download citation

Publish with us

Policies and ethics

Search

Navigation