Skip to main content
SpringerLink
Log in

A Comparison of MPICH Allgather Algorithms on Switched Networks

  • Conference paper
Recent Advances in Parallel Virtual Machine and Message Passing Interface (EuroPVM/MPI 2003)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 2840))

Abstract

This study evaluates the performance of MPI_Allgather() in MPICH 1.2.5 on a Linux cluster. This implementation of MPICH improves on the performance of allgather compared to previous versions by using a recursive doubling algorithm. We have developed a dissemination allgather based on the dissemination barrier algorithm. This algorithm takes log2 p stages for any values of p. We experimentally evaluate MPICH allgather and our implementations on a Linux cluster of dual-processor nodes using both TCP over FastEthernet and GM over Myrinet. We show that on Myrinet, variations of the dissemination algorithm perform best for both large and small messages. However, when using TCP, the dissemination allgather algorithm performs poorly because data is not exchanged in a pair-wise fashion. Therefore, we recommend the dissemination allgather for low-latency switched networks.

This work was supported by the the W. M. Keck Foundation.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Argonne National Laboratory. MPICH - A Portable Implementation of MPI (2003), http://www-unix.mcs.anl.gov/mpi/mpich/

  2. Hensgen, D., Finkel, R., Manber, U.: Two algorithms for barrier synchronization. International Journal of Parallel Programming 17(1), 1–17 (1988)

    Article  MATH  Google Scholar 

  3. Indiana University. LAM / MPI Parallel Computing (2003), http://www.lam-mpi.org/

  4. Lawrence Berkeley National Laboratory. tcpdump (2003), http://www.tcpdump.org/

  5. Worsch, T., Reussner, R.H., Augustin, W.: On benchmarking collective MPI operations. In: Kranzlmüller, D., Kacsuk, P., Dongarra, J., Volkert, J. (eds.) PVM/MPI 2002. LNCS, vol. 2474, p. 271. Springer, Heidelberg (2002)

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Keck Cluster Research Group, Department of Computer Science, University of San Francisco, 2130 Fulton Street, San Francisco, CA, 94117-1080, USA

    Gregory D. Benson, Cho-Wai Chu, Qing Huang & Sadik G. Caglar

Authors
  1. Gregory D. Benson
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Cho-Wai Chu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Qing Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Sadik G. Caglar
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Computer Science Department, University of Tennessee, 37996-3450, Knoxville, TN, USA

    Jack Dongarra

  2. Information Science and Technologies Institute (ISTI), The Italian National Research Council (CNR), Area della Ricerca, Via Giuseppe Moruzzi, 1, I-56126, Pisa, Italy

    Domenico Laforenza

  3. Department of Computer Science, Ca’ Foscari University of Venice, Italy

    Salvatore Orlando

Rights and permissions

Reprints and permissions

Copyright information

© 2003 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Benson, G.D., Chu, CW., Huang, Q., Caglar, S.G. (2003). A Comparison of MPICH Allgather Algorithms on Switched Networks. In: Dongarra, J., Laforenza, D., Orlando, S. (eds) Recent Advances in Parallel Virtual Machine and Message Passing Interface. EuroPVM/MPI 2003. Lecture Notes in Computer Science, vol 2840. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-39924-7_47

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-39924-7_47

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-20149-6

  • Online ISBN: 978-3-540-39924-7

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation