Persistence and Communication State Transfer in an Asynchronous Pipe Mechanism

Persistence and Communication State Transfer in an Asynchronous Pipe Mechanism

Philip Chan, David Abramson
Copyright: © 2009 |Volume: 1 |Issue: 3 |Pages: 19
ISSN: 1938-0259|EISSN: 1938-0267|ISSN: 1938-0259|EISBN13: 9781616920920|EISSN: 1938-0267|DOI: 10.4018/jghpc.2009070102
Cite Article Cite Article

MLA

Chan, Philip, and David Abramson. "Persistence and Communication State Transfer in an Asynchronous Pipe Mechanism." IJGHPC vol.1, no.3 2009: pp.18-36. http://doi.org/10.4018/jghpc.2009070102

APA

Chan, P. & Abramson, D. (2009). Persistence and Communication State Transfer in an Asynchronous Pipe Mechanism. International Journal of Grid and High Performance Computing (IJGHPC), 1(3), 18-36. http://doi.org/10.4018/jghpc.2009070102

Chicago

Chan, Philip, and David Abramson. "Persistence and Communication State Transfer in an Asynchronous Pipe Mechanism," International Journal of Grid and High Performance Computing (IJGHPC) 1, no.3: 18-36. http://doi.org/10.4018/jghpc.2009070102

Export Reference

Mendeley
Favorite Full-Issue Download

Abstract

Wide-area distributed systems offer new opportunities for executing large-scale scientific applications. On these systems, communication mechanisms have to deal with dynamic resource availability and the potential for resource and network failures. Connectivity losses can affect the execution of workflow applications, which require reliable data transport between components. We present the design and implementation of p-channels, an asynchronous and fault-tolerant pipe mechanism suitable for coupling workflow components. Fault-tolerant communication is made possible by persistence, through adaptive caching of pipe segments while providing direct data streaming. We present the distributed algorithm for implementing: (a) caching of pipe data segments; (b) asynchronous read operation; and (c) communication state transfer to handle dynamic process joins and leaves.

Request Access

You do not own this content. Please login to recommend this title to your institution's librarian or purchase it from the IGI Global bookstore.