skip to main content
10.1145/1341811.1341826acmotherconferencesArticle/Chapter ViewAbstractPublication Pagesmardi-grasConference Proceedingsconference-collections
research-article

Latency hiding by redundant processing: a technique for grid-enabled, iterative, synchronous parallel programs

Published: 29 January 2008 Publication History

Abstract

The increase in interconnected computational resources brought about by the Grid creates the possibility to port multiple parallel programming techniques to it. Porting parallel applications to the Grid could reduce the total computation time, or it could be used to create solutions with higher degrees of resolution. However, the Grid brings with it network state conditions that all too often work to the detriment of expediency in parallel applications. This paper proposes an algorithm designed to significantly reduce the amount of Wide Area Network (WAN) latency experienced when running an interactive synchronous parallel program on the Grid. The algorithm is called Latency Hiding by Redundant Processing (LHRP) and in tests done on two Grid nodes with emulated latency, it complemented Latency Hiding (LH) by performing better than LH on jobs with low internal computation time and performing worst than LH when the computation time was enough to hide the latency.

References

[1]
Allen, Gabrielle; Benger, Werner; Dramlitsh, Thomas; Goodale, Tom; Hege, Hans-Christian; Lanfermann, Gerd; Merzky, Andre; Radke, Thomas; Seidel, Edward; Shalf, John. Cactus Tools for Grid Applications. Cluster Computing, pages 179--188, November 2004.
[2]
Berman, Francine; Chien, Andrew; Cooper, Keith; Dongarra, Jack; Foster, Ian; Gannon, Dennis; Johnsson, Lennart; Kennedy, Ken; Kesselman, Carl; Mellor-Crumme, John; Reed, Dan; Torczon, Linda; Wolski, Rich. The GrADS Project: Software Support for High-Level Grid Application Development, International Journal of High Performance Computing Applications, pages 327--344, 2001.
[3]
El Maghraoui, K. A Framework for the Dynamic Reconfiguration of Scientific Applications in Grid Environments. Doctor of Philosophy dissertation, Rensselaer Polytechnic Institute at Troy, New York, 2007
[4]
Foster, Ian; Kesselman, Carl. Globus: a Metacomputing Infrastructure Toolkit, International Journal of High Performance Computing Applications, pages 115--128, 1997.
[5]
Globus. The Globus Toolkit, July 2007. URL: http://www.globus.org/tookit/
[6]
Java PVM (JPVM). The JPVM Home Page, September 2007. URL: http://www.cs.virginia.edu/~ajf2j/jpvm.html
[7]
Kale, Laxmikant; Krishnan, Sanjeev. Charm++:Aportable concurrent object oriented system based on C++, Proceedings, Conference on Object Oriented Programming Systems, Languages and Applications, September 1993.
[8]
Karonis, Nicholas; Toonen, Brian; Foster, Ian. MPICH-G2: A Grid-enabled implementation of the Message Passing Interface, Journal of Parallel and Distributed Computing, Volume 63, Issue 5, Special Issue on Computational Grids, Pages 551--563, May 2003.
[9]
Koenig, Gregory; Kale, Laxmikant. Using message-driven objects to mask latency in grid computing applications. Proceedings of IEEE International Parallel & Distributed Processing Symposium (IPDPS), 2005.
[10]
Li, Z. Parashar, M. A Decentralized Computational Infrastructure for Grid-Based Parallel Asynchronous Iterative Applications. Journal of Grid Computing, 2006.
[11]
Mehta, V. LeanMD: A Charm++ framework for high performance molecular dynamics simulation on large parallel machines. Master's thesis, Univeristy of Illinois at Urbana-Champaign, 2004.
[12]
Strumpen, V.; Casavant, T. L. Exploiting communication latency hiding for parallel network computing: model and analysis. International Conference on Parallel and Distributed Systems, pages 622--627, December 1994.
[13]
Tisue, S.; Wilensky, U. NetLogo: A Simple Environment for Modeling Complexity. Proc. International Conference on Complex Systems (2004).
[14]
Wilkinson, Barry; Allen, Michael. Parallel Programming, Techniques and Applications Using Networked Workstations and Parallel Computers 2nd Ed. Prentice Hall, New Jersey, 2005.

Cited By

View all
  • (2012)Fundamentals of Multicore Hardware and Parallel ProgrammingFundamentals of Multicore Software Development10.1201/b11417-4(9-29)Online publication date: 9-Jan-2012

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
MG '08: Proceedings of the 15th ACM Mardi Gras conference: From lightweight mash-ups to lambda grids: Understanding the spectrum of distributed computing requirements, applications, tools, infrastructures, interoperability, and the incremental adoption of key capabilities
January 2008
178 pages
ISBN:9781595938350
DOI:10.1145/1341811
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

  • National e-Science Institute (Edinburgh, UK)
  • Louisiana State University (USA)

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 January 2008

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. grid
  2. latency hiding
  3. parallel
  4. synchronous

Qualifiers

  • Research-article

Conference

Mardi Gras'08
Sponsor:
Mardi Gras'08: 15th Mardi Gras Conference on Distributed Applications
January 29 - February 3, 2008
Louisiana, Baton Rouge, USA

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 19 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2012)Fundamentals of Multicore Hardware and Parallel ProgrammingFundamentals of Multicore Software Development10.1201/b11417-4(9-29)Online publication date: 9-Jan-2012

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media