Synonyms
Definition
The serial netCDF library has long provided scientists with a portable, self-describing file format and a straightforward programming interface based on multidimensional arrays of typed variables (more detail in the History section). Parallel-NetCDF provides an API for parallel access to traditionally formatted netCDF files. Parallel-NetCDF both produces and consumes files compatible with serial netCDF, while providing a programming interface similar, though not identical, to netCDF. Parallel-netCDF API modifications provide a more appropriate interface when expressing parallel I/O.
Discussion
Parallel-NetCDF is one of a family of libraries built to meet the needs of computational scientists, as opposed to lower-level I/O libraries that deal more with the details of underlying storage. Before going into more detail about Parallel-NetCDF, let us see how it fits in the bigger picture of scientific computing and application I/O.
Parallel-...
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsBibliography
Gao K, Liao WK, Choudhary A, Ross R, Latham R (2009) Combining i/o operations for multiple array variables in parallel netcdf. In: Proceedings of the workshop on interfaces and architectures for scientifc data storage, held in conjunction with the IEEE Cluster Conference, New Orleans, Louisiana, September 2009
Li J, Liao WK, Choudhary A, Ross R, Thakur R, Gropp W, Latham R, Siegel A, Gallagher B, Zingale M (2003) Parallel netCDF: a high-performance scientific I/O interface. In: Proceedings of SC2003: high performance networking and computing, Phoenix, AZ, November 2003. IEEE Computer Society Press, Los Alamitos
Prost JP, Treumann R, Hedges R, Jia B, Koniges A (2001) MPI-IO/GPFS, an optimized implementation of MPI-IO on top of GPFS. In: Proceedings of SC2001, November 2001
Thakur R, Gropp W, Lusk E (1999) Data sieving and collective I/O in ROMIO. In: Proceedings of the Seventh Symposium on the Frontiers of Massively Parallel Computation, IEEE Computer Society Press, pp 182–189, February 1999
The HDF Group (2008) HDF5. http://www.hdfgroup.org
The MPI Forum. MPI-2: extensions to the message-passing interface, July 1997. http://www.mpi-forum.org/docs/docs.html
Unidata. netCDF4. http://www.unidata.ucar.edu/software/netcdf/index.html
Acknowledgments
This work was supported in part by the U.S. Dept. of Energy under Contract DE-AC02-06CH11357.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer Science+Business Media, LLC
About this entry
Cite this entry
Latham, R. (2011). NetCDF I/O Library, Parallel. In: Padua, D. (eds) Encyclopedia of Parallel Computing. Springer, Boston, MA. https://doi.org/10.1007/978-0-387-09766-4_235
Download citation
DOI: https://doi.org/10.1007/978-0-387-09766-4_235
Publisher Name: Springer, Boston, MA
Print ISBN: 978-0-387-09765-7
Online ISBN: 978-0-387-09766-4
eBook Packages: Computer ScienceReference Module Computer Science and Engineering