Abstract
I/O performance of large-scale HPC systems grows at a significantly slower rate than compute performance. In this article we investigate architectural options and technologies for a tiered storage system to mitigate this problem. Using GPFS and flash memory cards a prototype is implemented and evaluated. We compare performance numbers obtained by running synthetic benchmarks on a petascale BlueGene/Q system connected to our prototype. Based on these results an assessment of the architecture and technology is performed.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Gray, J., Shenoy, P.: Rules of Thumb in Data Engineering, pp. 3–10 (2000)
Bell, G., Gray, J., Szalay, A.: Petascale computational systems. Computer 39(1), 110–112 (2006)
Hitachi, https://www1.hgst.com/hdd/technolo/overview/storagetechchart.html (accessed: January 26, 2013)
Stevens, R., White, A., et al. (2010), http://www.exascale.org/mediawiki/images/d/db/planningforexascaleapps-steven.pdf (accessed: January 26, 2013)
Mueller-Wicke, D., Mueller, C.: TSM for Space Management for UNIX – GPFS Integration (2010)
Miller, E.L., Katz, R.H.: Input/output Behavior of Supercomputing Applications. In: SC 1991, pp. 567–576. ACM, New York (1991)
Wickberg, T., Carothers, C.: The RAMDISK Storage Accelerator: a Method of Accelerating I/O Performance on HPC Systems using RAMDISKs. In: ROSS 2012, pp. 5:1–5:8. ACM, New York (2012)
Abbasi, H., Wolf, M., Eisenhauer, G., Klasky, S., Schwan, K., Zheng, F.: DataStager: Scalable Data Staging Services for Petascale Applications. In: HPDC 2009, pp. 39–48. ACM, New York (2009)
Abbasi, H., Wolf, M., Eisenhauer, G., Klasky, S., Schwan, K., Zheng, F.: DataStager: Scalable Data Staging Services for Petascale Applications. Cluster Computing 13(3), 277–290 (2010)
Kannan, S., Gavrilovska, A., Schwan, K., Milojicic, D., Talwar, V.: Using active NVRAM for I/O staging. In: PDAC 2011, pp. 15–22. ACM, New York (2011)
Frings, W., Wolf, F., Petkov, V.: Scalable Massively Parallel I/O to Task-local Files. In: SC 2009, pp. 17:1–17:11. ACM, New York (2009)
Borrill, J., Oliker, L., Shalf, J., Shan, H.: Investigation of Leading HPC I/O Performance Using a Scientific-application Derived Benchmark. In: SC 2007, pp. 10:1–10:12. ACM, New York (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
El Sayed, S. et al. (2013). Using GPFS to Manage NVRAM-Based Storage Cache. In: Kunkel, J.M., Ludwig, T., Meuer, H.W. (eds) Supercomputing. ISC 2013. Lecture Notes in Computer Science, vol 7905. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-38750-0_33
Download citation
DOI: https://doi.org/10.1007/978-3-642-38750-0_33
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-38749-4
Online ISBN: 978-3-642-38750-0
eBook Packages: Computer ScienceComputer Science (R0)