Skip to main content

A software architecture for massively parallel input-output

  • Conference paper
  • First Online:
Applied Parallel Computing Industrial Computation and Optimization (PARA 1996)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 1184))

Included in the following conference series:

Abstract

For an increasing number of data intensive scientific applications, parallel I/O concepts are a major performance issue. Tackling this issue, we provide an outline of an input/output system designed for highly efficient, scalable and conveniently usable parallel I/O on distributed memory systems. The main focus of this paper is the parallel I/O runtime system support provided for software-generated programs produced by parallelizing compilers in the context of High Performance FORTRAN efforts. Specifically, our design is presented in the context of the Vienna Fortran Compilation System.

The work described in this paper is being carried out as part of the research project “Language, Compiler and Advanced Data Structure Support for Parallel I/O Operations” supported by the Austrian Research Foundation (FWF Grant P11006-MAT).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. S. Benkner. Vienna Fortran 90 and its Compilation. Ph.D. Thesis, University of Vienna, September, 1994.

    Google Scholar 

  2. S. Benkner et al. Vienna Fortran Compilation System — Version 1.2 — User's Guide, University of Vienna, October 1995.

    Google Scholar 

  3. R. Bennett, K. Bryant, A. Sussman, R. Das, and J. Saltz. Jovian: A Framework for Optimizing Parallel I/O. In Proceedings of the 1994 Scalable Parallel Libraries Conference, IEEE Computer Society Press, Oct. 1994

    Google Scholar 

  4. P. Brezany, T. Mueck, E. Schikuta. Language, Compiler and Parallel Database Support for I/O Intensive Applications. Proc. HPCN Europe 1996, Milan, Italy, May 1995, Springer-Verlag, pp. 14–20.

    Google Scholar 

  5. P. Brezany, T. Mück, and E. Schikuta: Mass storage support for a parallelizing compilation system. In Proceedings of the Conference EUROSIM — HPCN Challenges 1996, North Holland, Elsevier, June 1996.

    Google Scholar 

  6. P. Brezany, T. Mück, and E. Schikuta: A Software Architecture for Massively Parallel Input-Output. Technical Report, Department of Data Engineering, University of Vienna, September 1996.

    Google Scholar 

  7. A. Choudhary et al. PASSION: Parallel And Scalable Software for Input-Output. Technical Report CRPC-TR94483-S, Syracuse University, Syracuse, NY, 1994.

    Google Scholar 

  8. P. F. Corbett, D. G. Feitelson. Design and Implementation of the Vesta Parallel File System. In Proc. Scalable High Performance Computing Conference, Knoxville, May 1994, pp. 63–70.

    Google Scholar 

  9. P. Corbett et al. MPI-IO: A parallel file I/O Interface for MPI. Version 0.3. Technical Report NAS-95-002, NAS, January 1995.

    Google Scholar 

  10. T.C. Mowry. Tolerating Latency Through Software-Controlled Data Prefetching. Ph.D.Thesis, Standford University, March 1994.

    Google Scholar 

  11. S. A. Moyer, V. S. Sunderam. PIOUS: A Scalable Parallel I/O System for Distributed Computing Environments. In Proc. Scalable High Performance Computing Conference, Knoxville, May 1994, pp. 71–78.

    Google Scholar 

  12. High Performance Fortran Forum. High Performance Fortran Language Specification. Scientific Programming, Vol. 2, No. 1, 2, 1993.

    Google Scholar 

  13. Message Passing Interface Forum. MPI: A Message-Passing Interface Standard. April 1994.

    Google Scholar 

  14. K. E. Seamons. Panda: Fast Access to Persistent Arrays Using High Level Interfaces and Server Directed Input/Output. Ph.D.Thesis, University of Illinois at Urbana-Champaign, 1996.

    Google Scholar 

  15. H. Zima, P. Brezany, B. Chapman, P. Mehrotra, and A. Schwald. Vienna Fortran — a Language Specification. ACPC Technical Report Series, University of Vienna, Vienna, Austria, 1992.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Jerzy Waśniewski Jack Dongarra Kaj Madsen Dorte Olesen

Rights and permissions

Reprints and permissions

Copyright information

© 1996 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Brezany, P., Mueck, T.A., Schikuta, E. (1996). A software architecture for massively parallel input-output. In: Waśniewski, J., Dongarra, J., Madsen, K., Olesen, D. (eds) Applied Parallel Computing Industrial Computation and Optimization. PARA 1996. Lecture Notes in Computer Science, vol 1184. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-62095-8_10

Download citation

  • DOI: https://doi.org/10.1007/3-540-62095-8_10

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-62095-2

  • Online ISBN: 978-3-540-49643-4

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics