Output Performance Study on a Production Petascale Filesystem

Xie, Bing; Chase, Jeffrey; Dillow, David; Klasky, Scott A.; Lofstead, Jay; Oral, H Sarp; Podhorszki, Norbert

doi:10.1007/978-3-319-67630-2_16

Title: Output Performance Study on a Production Petascale Filesystem

Conference · Thu Jun 01 00:00:00 EDT 2017

DOI:https://doi.org/10.1007/978-3-319-67630-2_16· OSTI ID:1399522

Xie, Bing ^[1]; Chase, Jeffrey ^[1]; Dillow, David ^[2];

^[3]; Lofstead, Jay ^[4];

^[3];

^[3]

Duke University
None
ORNL
Sandia National Laboratories (SNL)

View Conference

Cite

Export

Save

Research Organization:: Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States). Oak Ridge Leadership Computing Facility (OLCF)

Sponsoring Organization:: USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR)

DOE Contract Number:: AC05-00OR22725

OSTI ID:: 1399522

Resource Relation:: Journal Volume: 10524; Conference: HPC I/O in the Data Center Workshop (HPC-IODC) - Frankfurt, , Germany - 6/22/2017 8:00:00 AM-

Country of Publication:: United States

Language:: English

References (16)

Characterizing output bottlenecks in a supercomputer Xie, Bing; Chase, Jeffrey; Dillow, David 2012 SC - International Conference for High Performance Computing, Networking, Storage and Analysis, 2012 International Conference for High Performance Computing, Networking, Storage and Analysis https://doi.org/10.1109/SC.2012.28	conference	November 2012
Characterizing and predicting the I/O performance of HPC applications using a parameterized synthetic benchmark Shan, Hongzhang; Antypas, Katie; Shalf, John 2008 SC - International Conference for High Performance Computing, Networking, Storage and Analysis https://doi.org/10.1109/SC.2008.5222721	conference	November 2008
Understanding and Improving Computational Science Storage Access through Continuous Characterization Carns, Philip; Harms, Kevin; Allcock, William ACM Transactions on Storage, Vol. 7, Issue 3, p. 1-26 https://doi.org/10.1145/2027066.2027068	journal	October 2011
A non-staggered, conservative, , finite-volume scheme for 3D implicit extended magnetohydrodynamics in curvilinear geometries Chacón, L. Computer Physics Communications, Vol. 163, Issue 3 https://doi.org/10.1016/j.cpc.2004.08.005	journal	November 2004
I/O performance challenges at leadership scale Lang, Samuel; Carns, Philip; Latham, Robert Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis - SC '09 https://doi.org/10.1145/1654059.1654100	conference	January 2009
24/7 Characterization of petascale I/O workloads Carns, Philip; Latham, Robert; Ross, Robert 2009 IEEE International Conference on Cluster Computing and Workshops https://doi.org/10.1109/CLUSTR.2009.5289150	conference	August 2009
Input/output characteristics of scalable parallel applications Crandall, Phyllis E.; Aydt, Ruth A.; Chien, Andrew A. Proceedings of the 1995 ACM/IEEE conference on Supercomputing (CDROM) - Supercomputing '95 https://doi.org/10.1145/224170.224396	conference	January 1995
A Multiplatform Study of I/O Behavior on Petascale Supercomputers Luu, Huong; Winslett, Marianne; Gropp, William Proceedings of the 24th International Symposium on High-Performance Parallel and Distributed Computing - HPDC '15 https://doi.org/10.1145/2749246.2749269	conference	January 2015
Workload characterization of a leadership class storage cluster Kim, Youn; Gunasekaran, Raghul; Shipman, Galen M. 2010 5th Petascale Data Storage Workshop (PDSW), 2010 5th Petascale Data Storage Workshop (PDSW '10) https://doi.org/10.1109/PDSW.2010.5668066	conference	November 2010
Scalable Earthquake Simulation on Petascale Supercomputers Cui, Yifeng; Olsen, Kim B.; Jordan, Thomas H. 2010 SC - International Conference for High Performance Computing, Networking, Storage and Analysis, 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis https://doi.org/10.1109/SC.2010.45	conference	November 2010
A study of I/O behavior of Perfect benchmarks on a multiprocessor Reddy, A. L. N.; Banerjee, P. [1990] Proceedings. The 17th Annual International Symposium on Computer Architecture https://doi.org/10.1109/ISCA.1990.134541	conference	January 1990
File-access characteristics of parallel scientific workloads Nieuwejaar, N.; Kotz, D.; Purakayastha, A. IEEE Transactions on Parallel and Distributed Systems, Vol. 7, Issue 10 https://doi.org/10.1109/71.539739	journal	January 1996
Predicting Output Performance of a Petascale Supercomputer Xie, Bing; Huang, Yezhou; Chase, Jeffrey S. Proceedings of the 26th International Symposium on High-Performance Parallel and Distributed Computing - HPDC '17 https://doi.org/10.1145/3078597.3078614	conference	January 2017
Architectural requirements of parallel scientific applications with explicit communication Cypher, R.; Ho, A.; Konstantinidou, S. Proceedings of the 20th annual international symposium on Computer architecture - ISCA '93 https://doi.org/10.1145/165123.165124	conference	January 1993
Adaptable, metadata rich IO methods for portable high performance IO Lofstead, Jay; Zheng, Fang; Klasky, Scott Distributed Processing (IPDPS), 2009 IEEE International Symposium on Parallel & Distributed Processing https://doi.org/10.1109/IPDPS.2009.5161052	conference	May 2009
Parallel I/O performance: From events to ensembles Uselton, Andrew; Howison, Mark; Wright, Nicholas J. 2010 IEEE International Symposium on Parallel & Distributed Processing (IPDPS) https://doi.org/10.1109/IPDPS.2010.5470424	conference	April 2010

Similar Records

Predicting Output Performance of a Petascale Supercomputer

Conference · Thu Jun 01 00:00:00 EDT 2017 · OSTI ID:1399522

Xie, Bing; Huang, Yezhou; Chase, Jeffrey; +4 more

Predicting Output Performance of a Petascale Supercomputer.

Conference · Sat Jul 01 00:00:00 EDT 2017 · OSTI ID:1399522

Xie, Bing; Huang, Yezhou; Chase, Jeffrey; +4 more

Applying Machine Learning to Understand Write Performance of Large-scale Parallel Filesystems

Conference · Fri Nov 01 00:00:00 EDT 2019 · OSTI ID:1399522

Xie, Bing; Tan, Zilong; Carns, Philip; +6 more

Title: Output Performance Study on a Production Petascale Filesystem

Citation Formats

References (16)

Similar Records

Related Subjects