Skip to main content
SpringerLink
Log in

The Subgroup Method for Collective I/O

  • Conference paper
Parallel and Distributed Computing: Applications and Technologies (PDCAT 2004)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 3320))

Abstract

Because many scientific applications require large data processing, the importance of parallel I/O has been increasingly recognized. For collective I/O, one of the considerable features of parallel I/O, we suggest the subgroup method. It is the way of using collective I/O of MPI effectively in terms of application programs. From the experimental results, we could conclude that the subgroup method for collective I/O is more efficient than plain collective I/O.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. May, J.M.: Parallel I/O for High Performance Computing. Morgan Kaufmann, San Francisco (2000)

    Google Scholar 

  2. MPICH-A Portable Implementation of MPI, http://www-unix.mcs.anl.gov/mpi/mpich

  3. LAM/MPI Parallel Computing, http://www.lam-mpi.org

  4. Ching, A., Choudhary, A., Liao, W.-k., Ross, R., Gropp, W.: Noncontiguous I/O through PVFS. In: Proc. IEEE International Conference on Cluster Computing, pp. 405–414 (2002)

    Google Scholar 

  5. Carns, P.H., Ligon III, W. B., Ross, R.B., Thakur, R.: PVFS: A Parallel File System for Linux Clusters. In: Proc. 4th Annual Linux Showcase and Conference, pp. 317–327 (2000)

    Google Scholar 

  6. Kotz, D.: Disk-directed I/O for MIMD multiprocessors. ACM Transactions on Computer Systems 15(1), 41–74 (1997)

    Article  MathSciNet  Google Scholar 

  7. Bordawekar, R.: Implementation of collective I/O in the Intel Paragon parallel file system: initial experiences. In: Proc. 11th international conference on Supercomputing, pp. 20–27 (1997)

    Google Scholar 

  8. Gropp, W., Lusk, E., Thakur, R.: Using MPI-2: Advanced Features of the Message Passing Interface. The MIT Press, Cambridge (1999)

    Google Scholar 

  9. Taki, H., Utard, G.: MPI-IO on a parallel file system for cluster of workstations. In: Proc. 1st IEEE Computer Society International Workshop on Cluster Computing, pp. 150–157 (1999)

    Google Scholar 

  10. ROMIO: A High-Performance, Portable MPI-IO Implementation, http://www-unix.mcs.anl.gov/romio

Download references

Author information

Authors and Affiliations

  1. Supercomputing Center, Korea Institute of Science and Technology Information, 52 Eoeun, Yu-seong, Daejon, 305-806, Korea

    Kwangho Cha, Taeyoung Hong & Jeongwoo Hong

Authors
  1. Kwangho Cha
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Taeyoung Hong
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jeongwoo Hong
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Nanyang Centre for Supercomputing and Visualisation School of Mechanical and Production Engineering, Nanyang Technological University, 50 Nanyang Avenue, 639 798, Singapore

    Kim-Meow Liew

  2. School of Computer Science, The University of Adelaide,  

    Hong Shen

  3. Asia Pacific Science and Technology Center, Sun Microsystems Inc., 50 Nanyang Avenue, N3-1c-10, 639798, Singapore

    Simon See

  4. School of Computer Engineering, Nanyang Technological University, 639798, Singapore

    Wentong Cai

  5. Southwest Jiaotong University,  

    Pingzhi Fan

  6. Tohoku University ,  

    Susumu Horiguchi

Rights and permissions

Reprints and permissions

Copyright information

© 2004 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Cha, K., Hong, T., Hong, J. (2004). The Subgroup Method for Collective I/O. In: Liew, KM., Shen, H., See, S., Cai, W., Fan, P., Horiguchi, S. (eds) Parallel and Distributed Computing: Applications and Technologies. PDCAT 2004. Lecture Notes in Computer Science, vol 3320. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-30501-9_63

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-30501-9_63

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-24013-6

  • Online ISBN: 978-3-540-30501-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation