Abstract
OGSA–DAI provides a framework for sharing and managing distributed data. OGSA–DAI is highly customizable and can be used to manage, share and process distributed data (e.g. relational, XML, files and RDF triples). It does this by executing workflows that can encapsulate complex distributed data management scenarios in which data from one or more sources can be accessed, updated, combined and transformed. Moreover, the data processing capabilities provided by OGSA–DAI are further augmented by a powerful distributed query processor and relational views component that allow distributed data sources to be viewed and queried as if they were a single resource. OGSA–DAI allows researchers and business users to move away from logistical and technical concerns such as data locations, data models, data transfers and optimization strategies for data integration and instead focus on application-specific data analysis and processing.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Dobrzelecki, B., Krause, A., Hume, A., Grant, A., Antonioletti, M., Alemu, Y., Atkinson, M., Jackson, M., Theocharopoulos, E.: Integrating distributed data sources with OGSA–DAI DQP and Views. Phil. Trans. R. Soc. A 368(1926), 4133–4145 (2010). doi: http://dx.doi.org/10.1098/rsta.2010.0166
Lynden, S., Pahlevi, S., Kojima, I.: Service-based data integration using OGSA-DQP and OGSA-WebDB. In: Proceedings of the 2008 9th IEEE/ACM International Conference on Grid Computing, 29 Sept–01 Oct 2008. IEEE Computer Society, Washington, DC, pp. 160–167 (2008). doi:10.1109/GRID.2008.4662795
Lynden, S., Mukherjee, A., Hume, A., Fernandes, A., Paton, N., Sakellariou, R., Watson, P.: The design and implementation of OGSA-DQP: a service-based distributed query processor. Future Gen. Comput. Syst. 25, 224–236 (2009). doi:10.1016/j.future.2008.08.003
Xiang, H.X.: Experiences running OGSA-DQP queries against a heterogeneous distributed scientific database. In: Proceedings of the 2009 15th International Conference on Parallel and Distributed Systems, pp. 706–710 (2009)
Tanimura, Y., Yamamoto, N., Tanaka, Y., Iwao, K., Kojima, I., Nakamura, R., Tsuchida, S., Sekiguchi, S.: Evaluation of large-scale storage systems for satellite data in GEO GRID. In: The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XXXVII, Part B4. pp. 1567–1574. Beijing (2008)
Groeper, R., Kunz, C., Grimm, C.: Connecting OGC web services and the Grid using Globus Toolkit 4 and OGSA–DAI. Conference on Grid Computing. In: 10th IEEE/ACM International, pp. 66–73, October 2009. doi: 10.1109/GRID.2009.5353080
Higgins, C., Koutroumpas, M., Sinnott, R.O., Watt, J., Doherty, T., Hume, A.C., Turner, A.G., Rawnsley, D.: Spatial data e-infrastructure, GLAS-PPE/2009-23 Preprint, 2009. http://ppewww.physics.gla.ac.uk/preprints/2009/23/2009--23.pdf. Accessed 5 Aug 2010
Koehler, M., Ruckenbauer, M., Janciak, I., Benkner, S., Lischka, H., Gansterer, W.N.: Supporting molecular modeling workflows within a grid services cloud. Computational Science and Its Applications – ICCSA 2010, Lecture Notes in Computer Science, 2010, vol. 6019/2010, pp. 13–28. doi: 10.1007/978–3–642–12189–0_2
Swain, M., Silva, C.G., Loureiro-Ferreira, N., Ostropytskyy, V., Brito, J., Riche, O., Stahl, F., Dubitzky, W., Brito R.M.M.: P-found: Grid-enabling distributed repositories of protein folding and unfolding simulations for data mining. Future Gen. Comp. Syst. 26(3), 424–433 (2010)
Brochhausen, M., Weiler, G., Martín, L., Cocos, C., Stenzhorn, H., Graf, N., Dörr, M., Tsiknakis, M., Smith, B.: Applications of the ACGT Master Ontology on Cancer. On the Move to Meaningful Internet Systems: OTM 2008 Workshops Lecture Notes in Computer Science, vol. 5333/2010, pp. 1046–1055 (2010). doi: 10.1007/978-3-540-88875-8_132
Garcia Ruiz, M., Garcia Chaves, A., Ruiz Ibañez, C., Gutierrez Mazo, J.M., Ramirez Giraldo, J.C., Pelaez Echavarria, A., Valencia Diaz, E., Pelaez Restrepo, G., Montoya Munera, E.N., Garcia Loaiza, B., Gomez Gonzalez, S.: mantisGRID: a grid platform for DICOM medical images management in Colombia and Latin America. J. Digit. Imaging 24(2), 271–283 (2010). doi:10.1007/s10278-009-9265-x
Espino, J., Hall, K., Washington, D., White, P., Grant, A., Hume, A., Antonioletti, M., Krause, A., Jackson, M., Heinbaugh, W., Fu-Chiang, T.: Open-source collaboration in practice between the real-time outbreak and disease surveillance laboratory. Public Health Information Network (PHIN) Conference 2008, pp. 24–28, Atlanta. The National Center for Public Health Informatics Research Lab, The University of Edinburgh and Tarrant County Public Health (2008)
Tan, K.L.L., Gayle, V., Lambert, P.S., Sinnott, R.O., Turner, K.J.: GEODE – Sharing occupational data through the grid. In: Proceedings of the UK e-Science All Hands Meeting 2006 (2006)
Graham, P.J., Sloan, T.M., Carter, A.C., Gregory, I.: FirstDIG: Data investigations using OGSA–DAI. In: Proceedings of the UK e-Science All Hands Meeting 2004 (2004)
MESSAGE (Mobile Environmental Sensing System Across Grid Environments) Project. http://bioinf.ncl.ac.uk/message/ (2010). Accessed 5 Aug 2010
Antonioletti, M., Blanke, T., Bodard, G., Hedges, M., Hume, A., Jackson, M., Rajbhandari, S.: Building bridges between islands of data – an investigation into distributed data management in the humanities. In: 5th IEEE International Conference on e-Science, pp 33–39, Oxford, 7–9 Dec 2009. (2009). ISBN 978-0-7695-3877-8
OGSA–DAI open source project publications. http://sourceforge.net/apps/trac/OGSA--DAI/wiki/Publications (2010). Accessed 7 Oct 2010
OGSA–DAI open source project. http://sourceforge.net/projects/OGSA--DAI (2010). Accessed 7 Oct 2010
KML. http://code.google.com/apis/kml/documentation/ (2010). Accessed 5 Aug 2010
Globus Project GridFTP. http://globus.org/toolkit/docs/3.2/gridftp/ (2010). Accessed 5 Aug 2010
Banks, T.: Web Services Resource Framework (WSRF) – Primer v1.2, OASIS, 23 May 2006. http://docs.oasis-open.org/wsrf/wsrf-primer-1.2-primer-cd-02.pdf (2006). Accessed 5 Aug 2010
Graham, S., Karmarkar, A., Mischkinsky, J., Robinson, I., Sedukhin, I.: Web Services Resource 1.2 (WS-Resource), OASIS, 1 April 2006. http://docs.oasis-open.org/wsrf/wsrf-wsresource-1.2-spec-os.pdf (2006). Accessed 5 Aug 2010
Globus Toolkit Security information. http://www.globus.org/toolkit/docs/4.0/security (2010). Accessed 12 Oct 2010
Alfieri, R., Cecchini, R., Ciaschini, V., dell’Agnello, L., Frohner, A., Gianoli, A., Lõrentey, K., Spataro, F.: VOMS, an authorization system for virtual organizations. Lecture Notes in Computer Science, vol. 2970/2004, pp. 33–40 (2004)
Aranda, C., Corcho, O.: Federating queries to RDF repositories. Monografia (Technical Report). Computer Faculty (UPM), Madrid, Spain. http://oa.upm.es/3302/ (2010). Accessed 7 Oct 2010
Antonioletti, M., Collins, B., Krause, A., Malaika, S., Magowan, J., Laws, S., Paton, N.W.: Web Services Data Access and Integration – The Relational Realization (WS-DAIR) Specification Version 1.0, Global Grid Forum (2006)
Antonioletti, M., Atkinson, M., Krause, A., Laws, S., Malaika, S., Paton, N.W., Pearson, D., Riccardi, G.: Web Services Data Access and Integration – The Core (WS-DAI) Specification, Version 1.0. http://www.ogf.org/documents/GFD.74.pdf (2006). Accessed 5 Aug 2010
Antonioletti, M., Hastings, S., Krause, A., Langella, S., Lynden, S., Laws, S., Malaika, S., Paton, N.W.: Web Services Data Access and Integration – The XML Realisation (WS-DAIX) Specification, Version 1.0. http://www.ogf.org/documents/GFD.75.pdf (2006). Accessed 5 Aug 2010
Taverna. http://www.taverna.org.uk/ (2010). Accessed 5 Aug 2010
ActiveBPEL. https://sourceforge.net/projects/activebpel/ (2010). Accessed 5 Aug 2010
Brito, M., Sato, L.: Extending OGSA–DAI Possibilities with a JDBC Driver, Computational Science and Engineering. In: 11th IEEE International Conference on Computational Science and Engineering, pp. 155–162 (2008). ISBN: 978-0-7695-3193-9. doi:http://doi.ieeecomputersociety.org/10.1109/CSE.2008.55
OGC Standards and Specifications. The Open Geospatial Consortium. http://www.opengeospatial.org/standards (2010). Accessed 5 Aug 2010
Jackson, M.J., Lloyd, A.D., Sloan, T.M.: Enabling access to federated grid databases: An OGSA–DAI ODBC driver. In: Proceedings of the UK e-Science All Hands Meeting, 2005
Google Maps API. http://code.google.com/apis/maps/index.html (2010). Accessed 5 Aug 2010
Jackson, M., Antonioletti, M., Chue Hong, N.P., Hume, A.C., Krause, A., Sugden, T., Westhead, M.: Performance analysis of the OGSA–DAI software. In: Proceedings of the UK e-Science All Hands Meeting, September 2004
Kottha, S., Abhinav, K., Muller-Pfefferkorn, R., Mix, H.: Accessing bio-databases with OGSA–DAI – A performance analysis, distributed, high-performance and grid computing in computational biology, Lecture Notes in Computer Science, vol. 4360, pp. 141–156 (2007)
Adamski, M., Kulczewski, M., Kurowski, K., Nabrzyski, J., Hume, A.: Security and performance enhancements to OGSA–DAI for Grid data virtualization: Research Articles, Selection of Best Papers of the VLDB Data Management in Grids Workshop (VLDB DMG 2006). Concurrency Comp. Pract. Ex. 19(16), 2171–2182 (2007). doi: 10.1002/cpe.1165
Alpdemir, M.N., Gounaris, A., Mukherjee, A., Fitzgerald, D., Paton, N.W., Watson, P., Sakellariou, R., Fernandes, A.A.A., Smith, J.: Experience on performance evaluation with OGSA-DQP. In: Proceedings of the UK e-Science All Hands Meeting, September 2005
Dobrzelecki, B., Antonioletti, M., Schopf, J.M., Hume, A.C., Atkinson, M., Chue Hong, N.P., Jackson, M., Karasavvas, K., Krause, A., Parsons, M., Sugden, T., Theocharopoulos, E.: Profiling OGSA–DAI performance for common use patterns. In: Proceedings of the UK e-Science All Hands Meeting, September 2006
Wang, K., Xie, Y., Li, S., Wang, X.: Performance analysis of the OGSA–DAI 3.0 Software. In: 5th International Conference on Information Technology: New Generations, pp. 15–20, April 2008. ISBN: 0-7695-3099-0. doi: 10.1109/ITNG.2008.91
Santos, N., Koblitz, B., Distributed metadata with the AMGA metadata catalog. In: Proceedings of the Workshop on Next-Generation Distributed Data Management HPDC-15, Paris, France, June 2006
Fiore, S., Negro, A., Aloisio, G.: Data virtualization in grid environments through the GRelC data access and integration service. In: Proceedings 4th ICITST, IEEE, London, UK, pp. 817–822 (2009)
Fiore, S., Negro, A., Aloisio, G., The data access layer in the GRelC system architecture, Future Generation Computer Systems (2010). doi: 10.1016/j.future.2010.07.006
Aloisio, G., Cafaro, M., Fiore, S., Mirto, M., Vadacca, S., Grelc data gather service: a step towards P2P production grids. In: SAC, pp. 561–565 (2007)
gLite. http://glite.web.cern.ch/glite/ (2010). Accessed 7 Oct 2010
Moore, R., Rajasekar, A.: White Paper: IRODS: Integrated Rule-Oriented Data System. https://www.irods.org/pubs/DICEiRODS_White_Paper-08.pdf (2008). Accessed Sept 2008
Storage Resource Broker (SRB). http://www.sdsc.edu/srb/index.php/MainPage (2010). Accessed 7 Oct 2010
Malik, T., Szalay, A.S., Budavari, T., Thakar, A.: Skyquery: a web service approach to federate databases. In: Proceedings of the First Biennial Conference on Innovative Data Systems Research (CIDR 2003) Asilomar, USA, VLDB Endowment, pp. 188–196, January 2003. http://www.cidrdb.org/cidr2003/program/p17.pdf
Hastings, S., Langella, S., Oster, S., Saltz, J.: Distributed data management and integration framework: The Mobius project. In: Proceedings of Global Grid Forum 11 (GGF11) semantic grid applications workshop, pp. 20–38 (2004)
XAware. http://www.xaware.org (2010). Accessed 7 Oct 2010
IBM Information Integration. http://www-01.ibm.com/software/data/integration (2010). Accessed 7 Oct 2010
Virtuoso Universal Server, OpenLink Software. http://virtuoso.openlinksw.com (2010). Accessed 7 Oct 2010
Acknowledgements
We acknowledge our past and present collaborators including the National eScience Centre at The University of Edinburgh, the eScience Centre of the North West of England at The University of Manchester, the North East of England eScience Centre at The University of Newcastle, IBM UK and Oracle UK. The project has been funded by the UK Department of Trade and Industry (under the Grid Core Programme I and II), the UK Engineering and Physical Sciences Research Council (under OGSA–DAI: an OMII-UK node, EP/D043956/1), by the European Union as part of the Framework Program 6 project BEinGRID (reference 034702) and by The University of Edinburgh.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Jackson, M.J., Antonioletti, M., Dobrzelecki, B., Hong, N.C. (2011). Distributed Data Management with OGSA–DAI. In: Fiore, S., Aloisio, G. (eds) Grid and Cloud Database Management. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-20045-8_4
Download citation
DOI: https://doi.org/10.1007/978-3-642-20045-8_4
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-20044-1
Online ISBN: 978-3-642-20045-8
eBook Packages: Computer ScienceComputer Science (R0)