Abstract
Current peer to peer (P2P) methods employing distributed hash tables (DHT) for resource discovery in a Grid environment suffer from these problems: (i) the risk of network congestion due to the sent messages for updating data on resources and (ii) the risk of the churn effect if a large number of nodes want to update their data at the same time. These problems form big challenges in a large scale dynamic Grid environment. In this paper we propose a method of resource discovery and selection for large scale query optimization in a Grid environment. The resource discovery extends the P2P system Pastry. DHT are used to save only static data on resources. We retrieve the dynamic properties of these resources during the resource selection by a monitoring tool. First, the originality of our approach is to delay the monitoring of resources to the phase of resource selection. This strategy will avoid a global monitoring of the system that is often employed in the current resource discovery systems. Second, the method is executed in a decentralized way in order to help the database optimizer to better discover and select resources.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Min Cai, Martin Frank, Jinbo Chen, Pedro Szekely, “MAAN: A Multi-Attribute Addressable Network for Grid Information Services”, Grid Computing, 2003. Proceedings. Fourth International Workshop on 17 Nov. 2003 Page(s):184 – 191.
Adeep S. Cheema, Moosa Muhammad, and Indranil Gupta, “Peer-to-peer Discovery of Computational Resources for Grid Applications”, Grid Computing Workshop 2005, 2005 IEEE.
K. Czajkowski, I. Foster, N. Karonis, C. Kesselman, S. Martin, W. Smith, and S. Tuecke. “A resource management architecture for metacomputing systems”. Lecture Notes in Computer Science, 1459, 1998.
K. Czajkowski, S. Fitzgerald, I. Foster, and C. Kesselman. “Grid information services for distributed resource sharing”. In 10th IEEE Symp. On High Performance Distributed Computing, 2001.
M. El Samad, J. Gossa, F. Morvan, A. Hameurlain, J-M. Pierson, L. Brunie, A monitoring service for large scale dynamic query optimization in a Grid environment. International Journal of Web and Grid Services (IJWGS), to appear.
A. Gounaris, R. Sakellariou, N. W. Paton, A.A. Fernandes, “Resource Scheduling for Parallel Query Processing on Computational Grids”, Proceedings of the Fifth IEEE/ACM International Workshop on Grid Computing (GRID’04).
V. F. V. Da Silva, M. L.Dutra, F. Porto, B. Schulze, A. C. Barbosa and J. C. de Oliveira, An adaptive parallel query processing middleware for the Grid, CONCURRENCY AND COMPUTATION: PRACTICE AND EXPERIENCE, Concurrency Computat.: Pract. Exper. 2006; 18:621–634, Wiley InterScience.
I. Foster, C. Kesselman and S. Tuecke, The Anatomy of the Grid Enabling Scalable Virtual Organizations, International Journal on Supercomputer Applications, 15(3), 2001.
I. Foster, The Grid: A New Infrastructure for 21st Century Science, Physics Today, Vol. 55 #2, p. 42, 2002.
G. Kakarontzas, I. K. Savvas, “Agent-Based Resource Discovery and Selection for Dynamic Grids”, 15th IEEE International Workshops on Enabling Technologies: Infrastructure for Collaborative Enterprises (WETICE’06) pp. 195-200.
S. Liu, H.A. Karimi, Grid query optimizer to improve query processing in grids, Future Generation Computer Systems (2007), doi:10.1016/j.future.2007.06.003S. Liu, Hassan A. Karimi, Grid query optimizer to improve query processing in grids.
] M. Marzolla, M. Mordacchini, S. Orlando, “Resource Discovery in a Dynamic Grid Environment”, Proceedings of the 16th International Workshop on Database and Expert Systems Applications (DEXA’05), 2005 IEEE.
A. Padmanabhan, S. Wang, S. Ghosh , and R. Briggs, “A Self-Organized Grouping (SOG) Method for Efficient Grid Resource Discovery”, Grid Computing Workshop 2005, IEEE.
T. G. Ramos, A. C. M. A. de Melo, “An Extensible Resource Discovery Mechanism for Grid Computing Environments”, Sixth IEEE International Symposium on Cluster Computing and the Grid (CCGRID’06) pp. 115-122.
A. Rowstron, P. Druschel, “Pastry: Scalable, distributed object location and routing for large-scale peer-to-peer systems”, Appears in Proc. of the 18th IFIP/ACM International Conference on Distributed Systems Platforms (Middleware 2001). Heidelberg, Germany, November 2001.
J. M. Schopf, Grid resource management: state of the art and future trends. Norwell, MA, USA: Kluwer, Academic Publishers, 2004, ch. Ten actions when Grid scheduling: the user as a Grid scheduler, pp. 15–23.
K. M. Soe, A. A. Nwe, T. N. Aung, T. T. Naing, N. L. Thein, Efficient Scheduling of Resources for Parallel Query Processing on Grid-based Architecture, APSITT 2005 Proceedings. 6th Asia-Pacific Symposium 2005, IEEE.
I. Stoica, R. Morris, D. Karger, M. F. Kaashoek, H. Balakrishnan, “Chord: A Scalable Peer-to-Peer Lookup Service for Internet Applications”, Proceedings of the 2001 ACM SIGCOMM Conference.
D. Talia, P. Trunfio, “Peer-to-Peer protocols and Grid services for resource discovery on Grids”, in: L. Grandinetti (Ed.), Grid Computing: The New Frontier of High Performance Computing, in: Advances in Parallel Computing, vol. 14, Elsevier Science, 2005.
P. Trunfio, et al., “Peer-to-Peer resource discovery in Grids: Models and systems”, Future Generation Computer Systems (2007), doi:10.1016/j.future.2006.12.003.
R. Wolski, N. Spring, J. Hayes, The Network Weather Service: A Distributed Resource Performance Forecasting Service for Metacomputing, Journal of Future Generation Computing Systems,Volume 15, Numbers 5-6, pp. 757-768, October, 1999.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2008 Springer Science+Business Media B.V.
About this paper
Cite this paper
Samad, M.E., Hameurlain, A., Morvan, F. (2008). Resource Discovery and Selection for Large Scale Query Optimization in a Grid Environment. In: Sobh, T. (eds) Advances in Computer and Information Sciences and Engineering. Springer, Dordrecht. https://doi.org/10.1007/978-1-4020-8741-7_51
Download citation
DOI: https://doi.org/10.1007/978-1-4020-8741-7_51
Publisher Name: Springer, Dordrecht
Print ISBN: 978-1-4020-8740-0
Online ISBN: 978-1-4020-8741-7
eBook Packages: Computer ScienceComputer Science (R0)