Skip to main content
SpringerLink
Log in

COMPASSION: A parallel I/O runtime system including chunking and compression for irregular applications

  • Regular Talks
  • Conference paper
  • First Online:
Solving Irregularly Structured Problems in Parallel (IRREGULAR 1998)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 1457))

Abstract

In this paper we present an experimental evaluation of COMPASSION, a runtime system for irregular applications based on collective I/O techniques. It provides a “Collective I/O” model, enhanced with “Pipelined” operations and compression. All processors participate in the I/O simultaneously, alone or grouped, making scheduling of I/O requests simpler and providing support for contention management. In-memory compression mechanisms reduce the total execution time by diminishing the amount of I/O requested and the I/O contention. Our experiments, executed on an Intel Paragon and on the ASCI/Red teraflops machine, demonstrate that COMPASSION can obtain significantly high-performance for I/O above what has been possible so far.

This work was supported in part by Sandia National Labs award AV-6193 under the ASCI program, and in part by NSF Young Investigator Award CCR-9357840 and NSF CCR-9509143. Jesús Carretero is a postdoctoral fellow at NWU supported by the NATO Science Fellowships Programme.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. J. Carretero, J. No, S. Park, A. Choudhary, and P. Chen. Compassion: a parallel i/o runtime system including chunking and compression for irregular applications. In Proceedings of the International Conference on High-Performance Computing and Networking 1998, Amsterdam, Holland, April 1998.

    Google Scholar 

  2. Alok Choudhary, Rajesh Bordawekar, Michael Harry, Rakesh Krishnaiyer, Ravi Ponnusamy, Tarvinder Singh, and Rajeev Thakur. PASSION: parallel and scalable software for input-output. Technical Report SOCS-636, ECE Dept., NPAC and CASE Center, Syracuse University, September 1994.

    Google Scholar 

  3. Juan Miguel del Rosario and Alok Choudhary. High performance I/O for parallel computers: Problems and prospects. IEEE Computer, 27(3):59–68, March 1994.

    Google Scholar 

  4. T. Mattson and G. Henry. The asci option red supercomputer. In Intel Supercomputer Users Group. Thirteenth Annual Conference, Albuquerque, USA, June 1997.

    Google Scholar 

  5. J. No, S. Park, J. Carretero, A. Choudhary, and P. Chen. Design and implementation of a parallel i/o runtime system for irregular applications. In Proceedings of the 12th International Parallel Processing Symposium, Orlando, USA, March 1998.

    Google Scholar 

  6. K. É. Seamons and M. Winslett. A data management approach for handling large compressed arrays in high performance computing. In Proceedings of the Fifth Symposium on the Frontiers of Massively Parallel Computation, pages 119–128, February 1995.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Arquitectura y Tecnologfa de Sistemas Informâticos, Universidad Politécnica de Madrid, Spain

    Jesus Carretero

  2. Dept. of Electrical Engineering and Computer Science, Syracuse University, USA

    Jaechun No

  3. Sandia National Laboratories, USA

    Pang Chen

Authors
  1. Jesus Carretero
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jaechun No
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Pang Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Alfonso Ferreira José Rolim Horst Simon Shang-Hua Teng

Rights and permissions

Reprints and permissions

Copyright information

© 1998 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Carretero, J., No, J., Chen, P. (1998). COMPASSION: A parallel I/O runtime system including chunking and compression for irregular applications. In: Ferreira, A., Rolim, J., Simon, H., Teng, SH. (eds) Solving Irregularly Structured Problems in Parallel. IRREGULAR 1998. Lecture Notes in Computer Science, vol 1457. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0018545

Download citation

  • DOI: https://doi.org/10.1007/BFb0018545

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-64809-3

  • Online ISBN: 978-3-540-68533-3

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation