Abstract
The HPC world is waking up to the importance of storage as an integral part of an HPC solution. Many HPC sites are realizing that HPC class storage coupled with classic enterprise features such as snapshots, replication, disaster recovery, and ILM (Integrated Life Cycle Management), can result in the maximum performance and uptime for HPC applications. However, the biggest problem that HPC centers face is that they don’t understand how their applications perform IO (i.e. IO pattern). This means that they can’t define meaningful requirements for HPC storage. Knowledge of the IO patterns allows better definition of requirements including both time and money. This paper presents a technique for obtaining IO information and analyzing it to present IO pattern information. The technique is independent of the application.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Skamarock, W.C., Klemp, J.B., Dudhia, J., Gill, D.O., Barker, D.M., Wang, W., Powers, J.G.: A description of the advanced research WRF version 2. Technical Report NCAR/TN-468+STR, National Center for Atmospheric Research (January 2007)
Dudhia, J., Gill, D., Henderson, T., Klemp, J., Skamarock, W., Wang, W.: The Weather Research and Forecast Model: Software Architecture and Performance. In: Zwieflhofer, W., Mozdzynski, G. (eds.) Proceedings of the Eleventh ECMWF Workshop on the Use of High Performance Computing in Meteorology, pp. 156–168. World Scientific, Singapore (2005)
Cluster Buffer, strace_analyzer, http://clusterbuffer.wetpaint.com
Grace plotting tool, http://plasma-gate.weizmann.ac.il/Grace/
NetCDF (network Common Data Form), http://www.unidata.ucar.edu/software/netcdf/
Running strace with MPI applications, http://www.delltechcenter.com/page/4-21-2008+-+strace+MPI+-+Comments
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Layton, J. (2010). IO Pattern Characterization of HPC Applications. In: Mewhort, D.J.K., Cann, N.M., Slater, G.W., Naughton, T.J. (eds) High Performance Computing Systems and Applications. HPCS 2009. Lecture Notes in Computer Science, vol 5976. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-12659-8_22
Download citation
DOI: https://doi.org/10.1007/978-3-642-12659-8_22
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-12658-1
Online ISBN: 978-3-642-12659-8
eBook Packages: Computer ScienceComputer Science (R0)