Abstract
This paper focuses on two areas that experience in building database-oriented e-science applications has shown to be important. Firstly, methods of promoting data locality are vital due to the high cost of moving data in service-based distributed systems. Databases provide an excellent basis for achieving this due to their potential for moving computation to data. The paper also describes a new infrastructure that further promotes locality by enabling service-based computations to migrate to data. Secondly, the ability to combine information from a set of distributed databases has proved invaluable in many applications. The paper describes the design of an adaptive distributed query processing system that is able to exploit facilities offered by an underlying grid infrastructure. In addressing these two areas, the paper gives an overview of some of the generic components that have been designed to simplify the integration of databases into e-science applications.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Watson, P.: Databases and the Grid. In: Berman, F., Fox, G., Hey, A.J.G. (eds.) Grid Computing: Making the Global Infrastructure a Reality, p. 1060. Wiley, Chichester (2002)
Foster, I., Kesselman, C., Tuecke, S.: The Anatomy of the Grid: Enabling Scalable Virtual Organizations. International Journal of Supercomputer Applications 15 (2001)
Gray, J.: Distributed Computing Economics. Presented at A Tribute to Roger Needham. Springer Monographs in Computing Science (2004)
W3C. SOAP 1.1, http://www.w3.org/TR/2000/NOTE-SOAP-20000508/
Sandoz, P., Triglia, A., Pericas-Geertsen, S.: Fast Infoset. Sun Microsystems (2004), http://java.sun.com/developer/technicalArticles/xml/fastinfoset
Kuric, T.M., Catalyurek, U.V., Chang, C., Saltz, J.H.: DataCutter and A Client Interface for the Storage Resource Broker with DataCuttter Services, University of Maryland, CS-TR-4133 (2000)
OGSA-DAI. OGSA-DAI, http://www.ogsadai.org.uk/
Welch, V., Foster, I., Kesselman, C., Mulmo, O., Pearlman, L., Tuecke, S., Gawor, J., Meder, S., Siebenlist, F.: Security for Grid Services. Presented at High-Performance Distributed Computing, Seattle (2003)
OASIS. Web Services Security (WS-Security), http://www.oasis-open.org/committees/wss
Global Grid Forum. GGF, Database Access and Integration Services (DAIS-WG) (2005)
Nieto-Santisteban, M.A., Szalay, A.S., Thakar, A.R., O’Mullane, W.J., Gray, J., Annis, J.: When Database Systems Meet the Grid. Microsoft Research, MSR-TR-2004-81 (December 2004)
Watson, P., Lee, P.: The NU-Grid Persistent Object Computation Server. Presented at 1st European Grid Workshop, Poznan, Poland (2000)
Watson, P., Fowler, C.: An Architecture for the Dynamic Deployment of Web Services on a Grid or the Internet. School of Computing Science, University of Newcastle CS-TR- 890 (February 2005)
Palmer, J., Mitrani, I.: Optimal Server Allocation in Reconfigurable Clusters with Multiple Job Types. In: Laganá, A., Gavrilova, M.L., Kumar, V., Mun, Y., Tan, C.J.K., Gervasi, O. (eds.) ICCSA 2004. LNCS, vol. 3044, pp. 76–86. Springer, Heidelberg (2004)
Kubicek, C., Fisher, M., McKee, P., Smith, R.: Dynamic Allocation of Servers to Jobs in a Grid Hosting Environment. BT Technology Journal 22, 251–260 (2004)
OASIS. OASIS Web Services Business Process Execution Language, http://www.oasis-open.org/committees/wsbpel
Stevens, R., McEntire, R., Goble, C.A., Greenwood, M., Zhao, J., Wipat, A., Li, P.: My- Grid and the Drug Discovery Process. BIOSILICO 2, 140–148 (2004)
Alpdemir, M.N., Mukherjee, A., Paton, N.W., Watson, P., Fernandes, A.A.A., Gounaris, A., Smith, J.: Service Based Distributed Querying on the Grid.Presented at First International Conference on Service Oriented Computing, Trento, Italy (2003)
Tannenbaum, T., Wright, D., Miller, K., Livny, M.: Condor A Distributed Job Scheduler. In: Sterling, T. (ed.) Beowulf Cluster Computing with Linux, The MIT Press, Cambridge (2002)
Foster, I., Kesselman, C.: Globus: A Metacomputing Infrastructure Toolkit. International Journal of Supercomputing 11, 115–128 (1997)
Graefe, G.: Encapsulation of Parallelism in the Volcano Query Processing System. Presented at SIGMOD Conference, Atlantic City, NJ, USA (1990)
Smith, J., Watson, P.: Fault-Tolerance in Distributed Query Processing School of Computing Science, University of Newcastle CS-TR-893 (February 2005)
Gounaris, A., Paton, N.W., Fernandes, A.A.A., Sakellariou, R.: Self-monitoring Query Execution for Adaptive Query Processing. Data and Knowledge Engineering 51, 325–348 (2004)
Walton, N.A., Lawrence, A., Linde, T.: AstroGrid: Initial Deployment of the UK’s Virtual Observatory. Presented at Astronomical Data Analysis Software and Systems XIII, Strasbourg (2003)
Plale, B., Alameda, J., Wilhelmson, B., Gannon, D., Hampton, S., Rossi, A., Droegemeier, K.: User-oriented Active Management of Scientific Data with myLEAD. IEEE Internet Computing 9, 27–34 (2005)
Berners-Lee, T., Hendler, J., Lassila, O.: The Semantic Web Scientific American (2001)
Roure, D.D., Jennings, N.R., Shadbolt, N.R.: The Semantic Grid: Past, Present and Future. Proceedings of the IEEE 93, 669–681 (2005)
ORACLE. RFID and Sensor-Based Services (2005), www.oracle.com/technologies/rfid
Fox, G., Pallickara, S.: The Narada Event Brokering System: Overview and Extensions. Presented at International Conference on Parallel and Distributed Processing Techniques and Applications (2002)
Bacon, J., Bates, J., Hayton, R., Moody, K.: Using Events to Build Distributed Applications. Presented at 2nd International Workshop on Services in Distributed and Networked Environments (1995)
Microsoft, WinFS (2005), msdn.microsoft.com/data/winfs/
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Watson, P. (2005). Databases in Grid Applications: Locality and Distribution. In: Jackson, M., Nelson, D., Stirk, S. (eds) Database: Enterprise, Skills and Innovation. BNCOD 2005. Lecture Notes in Computer Science, vol 3567. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11511854_1
Download citation
DOI: https://doi.org/10.1007/11511854_1
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-26973-1
Online ISBN: 978-3-540-31677-0
eBook Packages: Computer ScienceComputer Science (R0)