Ian Taylor
Carlo Mastroianni
ABSTRACT
This paper discusses the motivation for the design of a decentralised data-caching scheme for Internet scale distributed computing applications. We provide three target applications in distributed cycle sharing applications, music information retrieval workflows and for workflow-based audio visual searching across distributed information servers. We argue that extensions are needed in existing toolkits to advance super peer topologies to support the caching of application data as well as adverts for specific applications. We discuss the Alchemist system that defines super peers style overlays for caching application-data by employing the use of dynamic groups, which are flexible in defining replicating, forwarding and security policies. This framework is built on top of existing technologies, such as P2PS and WSPeer and exploits standardised Web Services technologies as well as SOAP and more recently defined Web Services specifications. We present results to indicate the usefulness of such a data caching approach for distributing workflows and application data, and discuss future simulations that aim to sustain the evolution of the system.
- G. Allen, K. Davis, K. N. Dolkas, N. D. Doulamis, T. Goodale, T. Kielmann, A. Merzky, J. Nabrzyski, J. Pukacki, T. Radke, M. Russell, E. Seidel, J. Shalf, and I. Taylor. Enabling applications on the grid: A gridlab overview. International Journal of High Performance Computing Applications: Special Issue on Grid Computing: Infrastructure and Applications, 17(4):449--466, November 2003.Google Scholar
Digital Library
- T. Andrews, F. Curbera, H. Dholakia, Y. Goland, J. Klein, F. Leymann, K. Liu, D. Roller, D. Smith, S. Thatte, I. Trickovic, and S. Weerawarana. Business Process Execution Language for Web Services Version 1.1.Google Scholar
- D. Brookshier. BitVault Security. Technical report, 321 Products Inc.Google Scholar
- A. L. Chervenak. Applying Peer-to-Peer Techniques to Grid Replica Location Services. Journal of Grid Computing, to be published.Google Scholar
- I. Clarke, S. G. Miller, O. Sandberg, B. Wiley, and T. W. Hong. Protecting free expression online with freenet. IEEE Internet Computing, pages 40--49, January, February 2002. Google ScholarDigital Library
- E. Deelman, C. Kesselman, G. Mehta, L. Meshkat, L. Pearlman, K. Blackburn, P. Ehrens, A. Lazzarini, R. Williams, and S. Koranda. GriPhyN and LIGO, building a virtual data grid for gravitational wave scientists. In HPDC, pages 225--, 2002. Google ScholarDigital Library
- I. Foster et al. Modeling Stateful Resource with Web Services. http://www.ibm.com/developerworks/library/ws-resource/ws-modelingresources.pdf.Google Scholar
- I. Foster, C. Kesselman, J. Nick, and S. Tuecke. The Physiology of the Grid: An Open Grid Services Architecture for Distributed Systems Integration. Technical report, Open Grid Service Infrastructure WG, Global Grid Forum, 2002.Google Scholar
- J. Frey, T. Tannenbaum, M. Livny, I. Foster, and S. Tuecke. Condor-G: A Computation Management Agent for Multi-Institutional Grids. In Proceedings of the 10th IEEE International Symposium on High Performance Distributed Computing (HPCD'01), 2001. Google ScholarDigital Library
- E. Gallopoulos, E. N. Houstis, and J. R. Rice. Computer as Thinker/Doer :Problem-Solving Environments for Computational Science. IEEE Computational Science and Engineering, 1(2):11--23, 1994. Google ScholarDigital Library
- The Globus Alliance. http://www.globus.org.Google Scholar
- A. Harrison and I. Taylor. The Web Services Resource Framework In A Peer-To-Peer Context. Journal of Grid Computing, 4(4):425--445, December 2006.Google ScholarCross Ref
- B. Ludäscher, I. Altintas, C. Berkley, D. G. Higgins, E. Jaeger, M. Jones, E. A. Lee, and Y. Zhao. Scientific workflow management and the kepler system. concurrency and computation: Practice and experience. Concurrency and Computation: Practice and Experience, Special Issue on Scientific Workflows, 2006. to appear. Google ScholarDigital Library
- T. Oinn, M. Greenwood, M. Addis, M. N. Alpdemir, J. Ferris, K. Glover, C. Goble, A. Goderis, D. Hull, D. Marvin, P. Li, P. Lord, M. R. Pocock, M. Senger, R. Stevens, A. Wipat, and C. Wroe. Taverna: Lessons in creating a workflow environment for the life sciences. Concurrency and Computation: Practice and Experience, special issue on Grid Workflow, accepted for publication, 2006. Google ScholarDigital Library
- D. T. Pasquale Cozza, Carlo Mastroianni and I. Taylor. A Super-Peer Protocol for Multiple Job Submission on a Grid. In Proceedings of the CoreGRID Workshop on Grid Middleware Workshop in conjunction with Euro-Par, Dresden. To be Published. Springer, August 28-29 2006. Google ScholarDigital Library
- M. Ripeanu. Peer-to-peer architecture case study: Gnutella network. In proceedings of IEEE 1st International Conference on Peer-to-peer Com- puting (P2P2001), Linkoping, Sweden, August 27 to 29 2001. http://people.cs.uchicago.edu/ matei/PAPERS/P2P2001.pdf. Google ScholarDigital Library
- SOAP Service Description Language (SSDL). http://www.ssdl.org/.Google Scholar
- I. Taylor. Triana Generations. In Scientific Workflows and Business workflow standards in e-Science in conjunction with Second IEEE International Conference on e-Science, Amsterdam, Netherlands, December 2-4 2006. Google ScholarDigital Library
- I. Taylor, E. Deelman, D. Gannon, and M. Shields (Eds.). Workflows for e-Science. Springer, New York, Secaucus, NJ, USA, 2007.Google Scholar
- I. Taylor, I. Downard, B. Adamson, and J. Macker. Agentj: Enabling java ns-2 simulations for large scale distributed multimedia applications. In Second International Conference on Distributed Frameworks for Multimedia DFMA 2006, Penang, Malaysia, 14th to 17th May 2006.Google ScholarCross Ref
- I. Taylor and B. Schutz. Triana - A Quicklook Data Analysis System for Gravitational Wave Detectors. In Second Workshop on Gravitational Wave Data Analysis, pages 229--237. Editions Frontières, 1998.Google Scholar
- I. Taylor, M. Shields, I. Wang, and O. Rana. Triana Applications within Grid Computing and Peer to Peer Environments. Journal of Grid Computing, 1(2):199--217, 2003.Google ScholarCross Ref
- I. Wang. P2PS (Peer-to-Peer Simplified). In Proceedings of 13th Annual Mardi Gras Conference - Frontiers of Grid Applications and Technologies, pages 54--59. Louisiana State University, February 2005.Google Scholar
Index Terms
- Cache for workflows
Recommendations
An Efficient Hybrid Peer-to-Peer System for Distributed Data Sharing
Peer-to-peer overlay networks are widely used in distributed systems. Based on whether a regular topology is maintained among peers, peer-to-peer networks can be divided into two categories: structured peer-to-peer networks in which peers are connected ...
Multiple co-existing grouping overlays
UPGRADE '07: Proceedings of the second workshop on Use of P2P, GRID and agents for the development of content networksThis talk discusses issues in defining multiple overlays within P2P networks for the caching of application-data as well as conventional metadata i.e. adverts, or locations to data. I will discuss work carried out at Cardiff in this area that is being ...
Subjective and Objective Types of Trustworthiness in Peer-to-Peer(P2P) Overlay Networks
WAINA '10: Proceedings of the 2010 IEEE 24th International Conference on Advanced Information Networking and Applications WorkshopsSystems using peer-to-peer (P2P) overlay networks are getting a central position in information systems. P2P systems are in nature fully distributed with no centralized coordinator and each peer is autonomous. Each peer has to obtain information on ...
Comments