Abstract
Comparing the performance of different HPC platforms with different hardware, MPI libraries, compilers or sets of runtime options is a frequent task for implementors and users as well. Comparisons based on just a few numbers gained from a single execution of one benchmark or application are of very limited value as soon as the system is to run not only this software in exactly this configuration. However, the amount of data produced for thorough comparisons across a multidimensional parameter space quickly becomes hard to manage, and the relevant performance differences hard to locate. We deployed perfbase [3] as a system to perform performance comparisons based on a large number of test results yet being able to immediately recognize relevant performance differences.
Similar content being viewed by others
References
Bailey, D.H., et al.: The nas parallel benchmarks. The International Journal of Supercomputer Applications 5(3), 63–73 (Fall 1991)
N.N.: Intel MPI Benchmarks: Users Guide and Methodolgy Description. Intel GmbH (2004), http://www.intel.com
Worringen, J.: Experiment management and analysis with perfbase. In: IEEE Cluster (2005) (Publication Database) IEEE Computer Society, http://www.ccrl-nece.de
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Worringen, J. (2006). Automated Performance Comparison. In: Mohr, B., Träff, J.L., Worringen, J., Dongarra, J. (eds) Recent Advances in Parallel Virtual Machine and Message Passing Interface. EuroPVM/MPI 2006. Lecture Notes in Computer Science, vol 4192. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11846802_56
Download citation
DOI: https://doi.org/10.1007/11846802_56
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-39110-4
Online ISBN: 978-3-540-39112-8
eBook Packages: Computer ScienceComputer Science (R0)