Skip to main content

Adaptive Load Balancing for Massively Parallel Multi-Level Monte Carlo Solvers

  • Conference paper
  • First Online:
Book cover Parallel Processing and Applied Mathematics (PPAM 2013)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 8384))

  • 1595 Accesses

Abstract

The Multi-Level Monte Carlo algorithm was shown to be a robust solver for uncertainty quantification in the solutions of multi-dimensional systems of stochastic conservation laws. For random fluxes or random initial data with large variances, the time step of the explicit time stepping scheme becomes random due to the random CFL stability restriction. Such sample path dependent complexity of the underlying deterministic solver renders our static load balancing of the MLMC algorithm very inefficient. We introduce an adaptive load balancing procedure based on two key ingredients: (1) pre-computation of the time step size for each draw of random inputs (realization), (2) distribution of the samples using the greedy algorithm to “workers” with heterogeneous speeds of execution. Numerical experiments showing strong scaling are presented.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. ALSVID-UQ, v3.0. http://www.sam.math.ethz.ch/alsvid-uq

  2. Dandamudi, S.P.: Sensitivity evaluation of dynamic load sharing in distributed systems. IEEE Concurrency 6(3), 62–72 (1998)

    Article  Google Scholar 

  3. Graham, R.L.: Bounds on multiprocessing timing anomalies. SIAM J. Appl. Math. 17(2), 416–429 (1969)

    Article  MATH  MathSciNet  Google Scholar 

  4. LeVeque, R.A.: Numerical Solution of Hyperbolic Conservation Laws. Cambridge University Press, Cambridge (2005)

    Google Scholar 

  5. Mishra, S., Risebro, N.H., Schwab, C., Tokareva, S.: Multi-level Monte Carlo finite volume methods for scalar conservation laws with random flux. Technical Report, SAM, 2012. http://www.sam.math.ethz.ch/reports/2012/35

  6. Mishra, S., Schwab, C., Šukys, J.: Multi-level monte carlo finite volume methods for uncertainty quantification in nonlinear systems of balance laws. In: Bijl, H., Lucor, D., Mishra, S., Schwab, C. (eds.) Uncertainty Quantification in Computational Fluid Dynamics. Lecture Notes in Computational Science and Engineering, vol. 92, pp. 225–294. Springer, Zurich (2013)

    Chapter  Google Scholar 

  7. Mishra, S., Schwab, C.: Sparse tensor multi-level monte carlo finite volume methods for hyperbolic conservation laws with random initial data. Math. Comp. 280(81), 1979–2018 (2012)

    Article  MathSciNet  Google Scholar 

  8. Šukys, J., Schwab, C., Mishra, S.: Multi-level Monte Carlo finite difference and finite volume methods for stochastic linear hyperbolic systems. In: Dick, J., et al. (eds.) Monte Carlo and Quasi-Monte Carlo Methods 2012, vol. 65, pp. 649–666. Springer, Berlin (2013) http://www.sam.math.ethz.ch/reports/2012/19

  9. Šukys, J., Mishra, S., Schwab, C.: Static load balancing for multi-level Monte Carlo finite volume solvers. In: Wyrzykowski, R., Dongarra, J., Karczewski, K., Waśniewski, J. (eds.) PPAM 2011, Part I. LNCS, vol. 7203, pp. 245–254. Springer, Heidelberg (2012)

    Google Scholar 

  10. MPI: A Message-Passing Interface Standard. Version 2.2, 2009. http://www.mpi-forum.org/docs/mpi-2.2/mpi22-report.pdf

  11. Rosa, Swiss National Supercomputing Center (CSCS), Lugano, www.cscs.ch

Download references

Acknowledgments

This work is performed under ETH interdisciplinary research grant CH1-03 10-1 and CSCS production project grant ID S366.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jonas Šukys .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Šukys, J. (2014). Adaptive Load Balancing for Massively Parallel Multi-Level Monte Carlo Solvers. In: Wyrzykowski, R., Dongarra, J., Karczewski, K., Waśniewski, J. (eds) Parallel Processing and Applied Mathematics. PPAM 2013. Lecture Notes in Computer Science(), vol 8384. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-55224-3_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-55224-3_5

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-55223-6

  • Online ISBN: 978-3-642-55224-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics