Skip to main content
SpringerLink
Log in
Book cover

International Conference on High Performance Computing

ISC High Performance 2015: High Performance Computing pp 497–505Cite as

Hunting Down Load Imbalance: A Moving Target

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 9137))

Abstract

Load imbalance is known to be a major bottleneck to scalability, particularly when aiming for large parallel partitions. Apart from re-balancing the distribution of the input data, several cures have been proposed. Pretty much all of them assume that the load imbalance is coming from a fixed source. This paper presents an investigation for the climate modelling version CCLM of the weather forecast code COSMO [4]. An adapted MPI trace library is used to collect information about the load imbalance thus introducing a load imbalance measure. Using the visualization software OpenDX [6], this information is correlated to geography and weather forecast results. The resulting pictures show that the locations of high computational load move in space and time. They appear to be correlated to some weather phenomena. In principle this correlation is known for many years [8], but now it has been made visible.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Amdahl, G.M.: Validity of the single processor approach to achieving large scale computing capabilities. In: Proceedings of the Spring Joint Computer Conference, 18–20 April 1967, pp. 483–485. ACM (1967)

    Google Scholar 

  2. Crovella, M.E., LeBlanc, T.J.: Parallel performance prediction using lost cycles analysis. In: Proceedings of the 1994 ACM/IEEE Conference on Supercomputing, pp. 600–609. IEEE Computer Society Press (1994)

    Google Scholar 

  3. Dalhousie University, Department of Oceanography: Data explorer tutorials (1995). http://www.phys.ocean.dal.ca/docs/DX_tutorial.html. Accessed 13 February 2015

  4. Doms, G.: A description of the nonhydrostatic regional cosmo model. part 1: Dynamics and numerics. DWD, Offenbach, Germany (2011). http://www.cosmo-model.org/content/model/documentation/core/cosmoDyncsNumcs.pdf. Accessed 13 February 2015

  5. John, L.: Reevaluating Amdahl’s law. Commun. ACM 31(5), 532–533 (1988)

    Article  Google Scholar 

  6. IBM OpenDX. Open visualization data explorer (2002). http://www.opendx.org/. Accessed 13 February 2015

  7. Pospiech, C.: Hunting down load imbalance: a moving target (2015). https://youtu.be/wPIplbq8fDA. Accessed 05 April 2015

  8. Xue, M., Droegemeier, K., Weber, D.: Numerical prediction of high-impact local weather: a driver for petascale computing. In: Petascale Computing: Algorithms and Applications, pp. 103–124 (2007)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Lenovo Deutschland GmbH, Stuttgart, Germany

    Christoph Pospiech

Authors
  1. Christoph Pospiech
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Christoph Pospiech .

Editor information

Editors and Affiliations

  1. Deutsches Klimarechenzentrum (DKRZ), Hamburg, Germany

    Julian M. Kunkel

  2. Deutsches Klimarechenzentrum (DKRZ), Hamburg, Germany

    Thomas Ludwig

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Pospiech, C. (2015). Hunting Down Load Imbalance: A Moving Target. In: Kunkel, J., Ludwig, T. (eds) High Performance Computing. ISC High Performance 2015. Lecture Notes in Computer Science(), vol 9137. Springer, Cham. https://doi.org/10.1007/978-3-319-20119-1_35

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-20119-1_35

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-20118-4

  • Online ISBN: 978-3-319-20119-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation