skip to main content
10.1145/3432261.3439866acmotherconferencesArticle/Chapter ViewAbstractPublication PageshpcasiaConference Proceedingsconference-collections
poster

Performance Modeling of HPC Applications on Overcommitted Systems

Published: 20 January 2021 Publication History

Abstract

Recently, the use of interactive jobs in addition to traditional batch jobs are getting common in supercomputer systems. We expect overcommitting scheduling, in which multiple HPC jobs share one computational resource, to accept them in a single system and to make effective use of resources. On the other hand, the performance of a job must be affected when it is in an overcommitted state. Therefore, we need to investigate the impact of the overcommitted state. We evaluated the performance change when a single computational resource was shared by multiple HPC jobs, and built a model to predict the performance change using performance counters as input variables. The model could predict the performance in the overcommitted state with good accuracy, and the fatal mispredictions occupied only 1.4% of the total cases.

References

[1]
PAPI Contributors. 2020. Performance Application Programming Interface. Retrieved November 3, 2020 from https://icl.utk.edu/papi/
[2]
NASA. 2020. NAS Parallel Benchmarks. Retrieved November 3, 2020 from https://www.nas.nasa.gov/publications/npb.html
[3]
SILC Partners. 2020. VI-HPS :: Projects :: Score-P. Retrieved November 3, 2020 from https://www.vi-hps.org/tools/score-p.html

Cited By

View all
  • (2021)Measurement and Modeling of Performance of HPC Applications Towards Overcommitting Scheduling SystemsJob Scheduling Strategies for Parallel Processing10.1007/978-3-030-88224-2_4(59-79)Online publication date: 21-May-2021

Index Terms

  1. Performance Modeling of HPC Applications on Overcommitted Systems
        Index terms have been assigned to the content through auto-classification.

        Recommendations

        Comments

        Information & Contributors

        Information

        Published In

        cover image ACM Other conferences
        HPCAsia '21: The International Conference on High Performance Computing in Asia-Pacific Region
        January 2021
        143 pages
        ISBN:9781450388429
        DOI:10.1145/3432261
        Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        Published: 20 January 2021

        Check for updates

        Author Tags

        1. Job scheduling
        2. Overcommitting system
        3. Performance modeling

        Qualifiers

        • Poster
        • Research
        • Refereed limited

        Funding Sources

        • JSPS KAKENHI

        Conference

        HPC Asia 2021

        Acceptance Rates

        Overall Acceptance Rate 69 of 143 submissions, 48%

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • Downloads (Last 12 months)6
        • Downloads (Last 6 weeks)0
        Reflects downloads up to 12 Feb 2025

        Other Metrics

        Citations

        Cited By

        View all
        • (2021)Measurement and Modeling of Performance of HPC Applications Towards Overcommitting Scheduling SystemsJob Scheduling Strategies for Parallel Processing10.1007/978-3-030-88224-2_4(59-79)Online publication date: 21-May-2021

        View Options

        Login options

        View options

        PDF

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        HTML Format

        View this article in HTML Format.

        HTML Format

        Figures

        Tables

        Media

        Share

        Share

        Share this Publication link

        Share on social media