Cited By
View all- Castellano MMastronardi GBellotti RTarricone G(2009)A bioinformatics knowledge discovery in text application for grid computingBMC Bioinformatics10.1186/1471-2105-10-S6-S2310:S6Online publication date: 16-Jun-2009
Generic support for bulk operations in grid applications
Authors: 
Stephan Hirmer, Hartmut Kaiser, Andre Merzky, Andrei Hutanu, Gabrielle AllenAuthors Info & Claims
Stephan Hirmer, Hartmut Kaiser, Andre Merzky, Andrei Hutanu, Gabrielle AllenAuthors Info & ClaimsPage 9
Abstract
Within grid environments, latencies for remote operations of any kind can, as the number of operations increases, become a dominant factor for overall application performance. Amongst various approaches for latency hiding, bulk operations provide one possible solution to reduce latencies for large numbers of similar operations. The identification of bulks can, however, pose a non-trivial exercise for application developers, often requiring changes to the implemented remote API, and hence direct code modifications to the application themselves.In this paper we show how bulk operations can be integrated into existing API implementations, and identify the required properties of the API to make this approach feasible. We also show that our approach considers any type of bulk operation, and is independent of the underlying middleware support for bulks. We further describe a prototype implementation (within the SAGA C++ reference implementation effort), and present performance measurements for bulks of remote file copy operations.
References
[1]
J. Waldo, G. Wyant, A. Wollrath, and S. Kendall. A Note on Distributed Computing. Mobile Object Systems, Lecture Notes in Computer Science, No, 1222:49--64, 1997.
[2]
R. M. J. Badia, J. J. Labarta, R. J. Sirvent, J. M. J. Pérez, J. M. J. Cela, and R. J. Grima. Programming Grid Applications with GRID Superscalar. Journal of Grid Computing, 1(2):151--170, 2003.
[3]
Gabrielle Allen, Kelly Davis, Tom Goodale, Andrei Hutanu, Hartmut Kaiser, Thilo Kielmann, Andre Merzky, Rob van Nieuwpoort, Alexander Reinefeld, Florian Schintke, Thorsten Schütt, Ed Seidel, and Brygg Ullmer. The Grid Application Toolkit: Towards Generic and Easy Application Programming Interfaces for the Grid. Proceedings of the IEEE, 2004.
[4]
H. Rajic, I. A. Inc, W. Chan, I.B.M.F. Ferstl, A. Haas, and J. Tollefsrud. Distributed Resource Management Application API Specification. Technical report, Global Grid Forum, September 2002. GFD.22.
[5]
K. Seymour, H. Nakada, S. Matsuoka, J. Dongarra, C. Lee, and H. Casanova. Overview of GridRPC: A Remote Procedure Call API for Grid Computing. 3rd International Workshop on Grid Computing, 2002.
[6]
Gregor von Laszewski, Ian Foster, Jarek Gawor, and Peter Lane. A Java commodity grid kit. Concurrency and Computation: Practice and Experience, 13(8-9):645--662, 2001.
[7]
Andre Merzky and Shantenu Jha. A Requirements Analysis for a Simple API for Grid Applications. Technical report, Global Grid Forum, 2006. GFD.71.
[8]
Tom Goodale, Shantenu Jha, Hartmut Kaiser, Thilo Kielmann, Pascal Kleijer, Gregor von Laszewski, Craig Lee, Andre Merzky, Hrabri Rajic, and John Shalf. SAGA: A Simple API for Grid Applications - High-Level Application Programming on the Grid. Computational Methods in Science and Technology: special issue "Grid Applications: New Challenges for Computational Methods", 8(2), SC05, November 2005.
[9]
Andre Merzky and Shantenu Jha. Simple API for Grid Applications - Use Case Document. Technical report, Global Grid Forum, March 2006. GFD.70.
[10]
Rüdiger Berlich, Marcel Kunze, and Kilian Schwarz. Grid computing in Europe: from research to deployment. In CRPIT '44: Proceedings of the 2005 Australasian workshop on Grid computing and e-research, pages 21--27, Darlinghurst, Australia, 2005. Australian Computer Society, Inc.
[11]
W. Allcock, J. Bresnahan, R. Kettimuthu, M. Link, C. Dumitrescu, I. Raicu, and I. Foster. The Globus Striped GridFTP Framework and Server. SC'2005.
[12]
EF Walker, R. Floyd, and P. Neves. Asynchronous remote operation execution in distributed systems. Distributed Computing Systems, 1990. Proceedings., 10th International Conference on, pages 253--259.
[13]
Andrei Hutanu, Stephan Hirmer, Gabrielle Allen, and Andre Merzky. Analysis of Remote Execution Models for Grid Middleware. In Submitted to the 4th International Workshop on Middleware for Grid Computing), Melbourne, Australia, 2006. ACM.
[14]
Thorsten Schütt, Andre Merzky, Andrei Hutanu, and Florian Schintke. Remote Partial File Access using Compact Pattern Descriptions. In IEEE/ACM 4th Intl. Symp. on Cluster Computing and the Grid - CCGrid-2004, pages 1--8, April 2004. Workshop on Adaptive Grid Middleware.
Index Terms
- Generic support for bulk operations in grid applications
Recommendations
Seamless integration of generic bulk operations in grid applications
OTM'06: Proceedings of the 2006 international conference on On the Move to Meaningful Internet Systems: AWeSOMe, CAMS, COMINF, IS, KSinBIT, MIOS-CIAO, MONET - Volume Part IWithin grid environments, as the number of remote operations increases, the latencies for these operations become a dominant factor for application performance Bulk operations represent one potential methodology to reduce latencies for large numbers of ...
Invocation of operations from script-based Grid applications
In this paper we address the complexity of building and running modern scientific applications on various Grid systems with heterogeneous middleware. As a solution we have proposed the Grid Operation Invoker (GOI) which offers an object-oriented method ...
Accessing grid resources from portals and applications
ICAI'08: Proceedings of the 9th WSEAS International Conference on International Conference on Automation and InformationThe users of Grid-based applications and portals must be able to access Grid resources from different contexts, using high-level abstraction and full control of access parameters. Globus Toolkit, which is the most important solution for building Grid ...
Comments
Information & Contributors
Information
Published In
November 2006
109 pages
ISBN:1595935819
DOI:10.1145/1186675
- Conference Chairs:
- Bruno Schulze,
- David Abramson,
- Radha Nandkumar,
- Rajkumar Buyya
Copyright © 2006 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 27 November 2006
Check for updates
Qualifiers
- Article
Conference
Middleware06
Sponsor:
Middleware06: 7th International Middleware Conference
November 27 - December 1, 2006
Melbourne, Australia
Acceptance Rates
Overall Acceptance Rate 14 of 36 submissions, 39%
Upcoming Conference
MIDDLEWARE '25
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 169Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 08 Mar 2025
Other Metrics
Citations
Cited By
View all- Castellano MMastronardi GBellotti RTarricone G(2009)A bioinformatics knowledge discovery in text application for grid computingBMC Bioinformatics10.1186/1471-2105-10-S6-S2310:S6Online publication date: 16-Jun-2009
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in