Skip to main content

Part of the book series: Lecture Notes in Computer Science ((LNPSE,volume 4192))

  • 1203 Accesses

Abstract

Comparing the performance of different HPC platforms with different hardware, MPI libraries, compilers or sets of runtime options is a frequent task for implementors and users as well. Comparisons based on just a few numbers gained from a single execution of one benchmark or application are of very limited value as soon as the system is to run not only this software in exactly this configuration. However, the amount of data produced for thorough comparisons across a multidimensional parameter space quickly becomes hard to manage, and the relevant performance differences hard to locate. We deployed perfbase [3] as a system to perform performance comparisons based on a large number of test results yet being able to immediately recognize relevant performance differences.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions

Similar content being viewed by others

References

  1. Bailey, D.H., et al.: The nas parallel benchmarks. The International Journal of Supercomputer Applications 5(3), 63–73 (Fall 1991)

    Article  Google Scholar 

  2. N.N.: Intel MPI Benchmarks: Users Guide and Methodolgy Description. Intel GmbH (2004), http://www.intel.com

  3. Worringen, J.: Experiment management and analysis with perfbase. In: IEEE Cluster (2005) (Publication Database) IEEE Computer Society, http://www.ccrl-nece.de

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2006 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Worringen, J. (2006). Automated Performance Comparison. In: Mohr, B., Träff, J.L., Worringen, J., Dongarra, J. (eds) Recent Advances in Parallel Virtual Machine and Message Passing Interface. EuroPVM/MPI 2006. Lecture Notes in Computer Science, vol 4192. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11846802_56

Download citation

  • DOI: https://doi.org/10.1007/11846802_56

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-39110-4

  • Online ISBN: 978-3-540-39112-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics