Skip to main content
SpringerLink
Log in

Characterization of communication patterns in message-passing parallel scientific application programs

  • Conference paper
  • First Online:
Network-Based Parallel Computing Communication, Architecture, and Applications (CANPC 1998)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 1362))

Abstract

This paper examines the communication patterns of parallel scientific programs, including some of the NAS benchmarks and the Miami Isopycnic Coordinate Ocean Model (MICOM), that use explicit message-passing. Communication locality, including communication event locality, message destination locality, and message size locality, is proposed and studied in addition to the widely accepted metrics of message size, destination, and generation distributions. We find that the locality metrics are relatively insensitive to system and problem size variations making them robust metrics for characterizing the communication patterns of parallel applications. We observe that the communication patterns of the benchmark programs are consistent with those of the actual application. The results of this study will be useful for understanding parallel applications' communication behavior and for designing more realistic synthetic benchmarks.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Bailey, D., Barszcz, E., Barton, J., Browning, D., Carter, Ft., Darum, L., Fatoohi, R., Fineberg, S., Frederickson, P., Lasinski, T., Schreiber, R., Simon, H., Venkatakrishnan, V., Weeratunga, S.: The NAS Parallel Benchmarks. NAS Report RNR-94-007. (March 1994)

    Google Scholar 

  2. Chodnekar, S., Srinivasan, V., Vaidya, A., Sivasubramaniam, A., Das, C: Towards a Communication Characterization Methodology for Parallel Applications. High-Performance Computer Architecture. (1997)

    Google Scholar 

  3. R. Cypher, A. Ho, S. Konstantinidou, and P. Messina, Architectural Requirements of Parallel Scientific Applications with Explicit Communication. International Symposium on Computer Architecture. (1993) 2–13.

    Google Scholar 

  4. Hsieh, J., Du, D., Troullier, N., Lin, M.: Enhanced PVM Communications over a HIPPI Networks. Proceedings of the Second International Workshop on High-Speed Network Computing. (April 1996)

    Google Scholar 

  5. Fatoohi, R., Weeratunga, S.: Performance Evaluation of Three Distributed Computing Environments for Scientific Applications. Supercomputing'94. (1994) 400–409

    Google Scholar 

  6. Frymoyer, E.: Fibre Channel Fusion: Low Latency, High Speed. Data Communications Magazine. (February 1995)

    Google Scholar 

  7. Geist, A., Beguelin, A., Dongarra, J., Jiang, W., Manchek, R., Sunderam, V.: PVM: Parallel Virtual Machine — A Users' Guide and Tutorial for Networked Parallel Computing. The MIT Press. (1994)

    Google Scholar 

  8. Hsu, J., Banerjee, P.: Performance Measurement and Trace Driven Simulation of Parallel CAD and Numeric Applications on a Hypercube Multicomputer. International Symposium on Computer Architecture. (1990) 260–269

    Google Scholar 

  9. Kim, J., Lilja, D.: Exploiting Multiple Heterogeneous Networks to Reduce Communication Costs in Parallel Programs. Heterogeneous Computing Workshop, International Parallel Processing Symposium. (April 1997) 83–95

    Google Scholar 

  10. Kim, J., Lilja, D.: Utilizing Heterogeneous Networks in Distributed Parallel Computing Systems. International Symposium on High Performance Distributed Computing. (August 1997) 336–345

    Google Scholar 

  11. Message Passing Interface Forum: MPI: A Message-Passing Interface Standard. Version 1.1 (June 1995)

    Google Scholar 

  12. Sawdey, A.: Using the Parallel MICOM on SGI Multiprocessors and the Cray T3D. The MICOM User's Group Meeting. (February 1995)

    Google Scholar 

  13. Tolmie, D., Flanagan, D.: HIPPI: It's Not Just for Supercomputers Anymore. Data Communications Magazine. (May 1995)

    Google Scholar 

  14. VanderWiel, S., Nathanson, D., Lilja, D.: Complexity and Performance in Parallel Programming Languages. International Workshop on High-Level Parallel Programming Models and Supportive Environments, International Parallel Processing Symposium. (April 1997) 3–12

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Electrical and Computer Engineering, University of Minnesota, 200 Union St. SE, 55455, Minneapolis, MN

    JunSeong Kim & David J. Lilja

Authors
  1. JunSeong Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. David J. Lilja
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Dhabaleswar K. Panda Craig B. Stunkel

Rights and permissions

Reprints and permissions

Copyright information

© 1998 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Kim, J., Lilja, D.J. (1998). Characterization of communication patterns in message-passing parallel scientific application programs. In: Panda, D.K., Stunkel, C.B. (eds) Network-Based Parallel Computing Communication, Architecture, and Applications. CANPC 1998. Lecture Notes in Computer Science, vol 1362. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0052218

Download citation

  • DOI: https://doi.org/10.1007/BFb0052218

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-64140-7

  • Online ISBN: 978-3-540-69693-3

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation