Skip to main content
SpringerLink
Log in

A Case Study - Cost of Preemption for Urgent Computing on SuperMUC

  • Conference paper
  • First Online:
High Performance Computing (ISC High Performance 2015)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 9137))

Included in the following conference series:

Abstract

Urgent computing requires computations to commence in short order and complete within a stipulated deadline so as to support mitigation activities in preparation, response and recovery from an event that requires immediate attention. As such, acquiring computation resources swiftly is crucial. Preemptive scheduling, terminating an existing job(s) to make way for an urgent job, is one of the most common approach considered. However, public resource providers are typically faced with policy restrictions that forbid them from allowing preemption. The interruption of existing jobs is believed to have a significant consequence, i.e. cost, to the users and resource providers. This case study on a public HPC resource, SuperMUC, hosted at Leibniz Supercomputing Centre aims to study the cost of preemption. Two cost models, least cost and least disruptive, will be used. With this, we want to demonstrate that the cost of preemption is in fact much lower in comparison to the loss mitigation that can be achieved by allowing an urgent computation. The ultimate aim is to provide evidence to convince policy makers on the feasibility and benefits of supporting urgent computing on public resources.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    http://www-01.ibm.com/support/knowledgecenter/SSFJTW_5.1.0/com.ibm.cluster.loadl.v5r1.load100.doc/am2ug_preemptgang.htm.

  2. 2.

    http://slurm.schedmd.com/preempt.html.

  3. 3.

    https://www.xsede.org/.

  4. 4.

    http://www.lrz.de/services/compute/supermuc/systemdescription.

  5. 5.

    http://aws.amazon.com/ec2/pricing/.

  6. 6.

    http://aws.amazon.com/ec2/instance-types.

  7. 7.

    http://www.xe.com/.

  8. 8.

    http://top500.org/system/178321.

  9. 9.

    https://spark.apache.org/.

References

  1. Baruah, S., Mok, A., Rosier, L.: Preemptively scheduling hard-real-time sporadic tasks on one processor. In: Proceedings of the 11th RTSS, pp. 182–190, December 1990

    Google Scholar 

  2. Beckman, P., Nadella, S., Trebon, N., Beschastnikh, I.: SPRUCE: a system for supporting urgent high-performance computing. In: Gaffney, P.W., Pool, J.C.T. (eds.) Grid-Based Problem Solving Environments. IFIP, vol. 239, pp. 295–311. Springer, Boston (2007)

    Chapter  Google Scholar 

  3. Blanton, B., McGee, J., et al.: Urgent computing of storm surge for North Carolina’s coast. In: ICCS. Procedia Computer Science, vol. 9, pp. 1677–1686. Elsevier (2012)

    Google Scholar 

  4. Cohen, M.: A taxonomy of oil spill costs - what are the likely costs of the deepwater horizon spill? Technical report, Resources for the Future (2010)

    Google Scholar 

  5. Dolfman, M., Wasser, S., Bergman, B.: The effects of Hurricane Katrina on the New Orleans economy. Technical report, Bureau of Labor Statistics of the U.S. Department of Labor (2007)

    Google Scholar 

  6. Gennies, S., Funk, A., et al.: Hochwasser-Bilanz 2013 Wie schlimm war die Flut wirklich? June 2013. http://www.tagesspiegel.de/politik/hochwasser-bilanz-2013-wie-schlimm-war-die-flut-wirklich/8416770.html

  7. Leong, S.H., Frank, A., Kranzlmüller, D.: Leveraging e-infrastructures for urgent computing. In: ICCS. Procedia Computer Science, vol. 18, pp. 2177–2186. Elsevier (2013)

    Google Scholar 

  8. Leong, S.H., Kranzlmüller, D.: Towards a general definition of urgent computing. To be published in Proceedings of ICCS 2015

    Google Scholar 

  9. Marru, S., Gannon, D., et al.: LEAD cyberinfrastructure to track real-time storms using SPRUCE urgent computing. CTWatch Q. 4(1), 5–16 (2008)

    Google Scholar 

  10. Nanto, D., Cooper, W., Donnelly, J.: Japans 2011 earthquake and tsunami- economic effects and implications for the United States. Technical report, Congressional Research Service(2011)

    Google Scholar 

  11. Scaife, N., Caspi, P.: Integrating model-based design and preemptive scheduling in mixed time- and event-triggered systems. In: Proceedings of the 16th Real-Time Systems, ECRTS, pp. 119–126, June 2004

    Google Scholar 

  12. Trick, M.A.: A dynamic programming approach for consistency and propagation for knapsack constraints. In: Annals of Operations Research, pp. 113–124 (2001)

    Google Scholar 

  13. Ujikane, K.: Japan Forecasts Earthquake Damage May Swell to \({\$}\)309 Billion, March 2011. http://www.bloomberg.com/news/articles/2011-03-23/japan-sees-quake-damage-bill-of-up-to-309-billion-almost-four-katrinas

  14. Yoshimoto, K.K., Choi, D.J., et al.: Implementations of urgent computing on production HPC systems. In: ICCS. Procedia Computer Science, vol. 9, pp. 1687–1693. Elsevier (2012)

    Google Scholar 

Download references

Acknowledgments

The author would like to thank Anthes, Heller, DRG group, etc. at Leibniz Supercomputing Centre for their valuable motivations, suggestions, feedbacks and support. A big thanks to Brehm for sharing the cost information on SuperMUC.

Author information

Authors and Affiliations

  1. Leibniz Supercomputing Centre, Garching Near Munich, Germany

    Siew Hoon Leong & Dieter Kranzlmüller

  2. Ludwig-Maximilians-Universität München, Munich, Germany

    Siew Hoon Leong & Dieter Kranzlmüller

Authors
  1. Siew Hoon Leong
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Dieter Kranzlmüller
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Siew Hoon Leong .

Editor information

Editors and Affiliations

  1. Deutsches Klimarechenzentrum (DKRZ), Hamburg, Germany

    Julian M. Kunkel

  2. Deutsches Klimarechenzentrum (DKRZ), Hamburg, Germany

    Thomas Ludwig

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Leong, S.H., Kranzlmüller, D. (2015). A Case Study - Cost of Preemption for Urgent Computing on SuperMUC. In: Kunkel, J., Ludwig, T. (eds) High Performance Computing. ISC High Performance 2015. Lecture Notes in Computer Science(), vol 9137. Springer, Cham. https://doi.org/10.1007/978-3-319-20119-1_30

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-20119-1_30

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-20118-4

  • Online ISBN: 978-3-319-20119-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation