Skip to main content
SpringerLink
Log in

Distributed Data Management with OGSA–DAI

  • Chapter
  • First Online:
Grid and Cloud Database Management

  • 1124 Accesses

Abstract

OGSA–DAI provides a framework for sharing and managing distributed data. OGSA–DAI is highly customizable and can be used to manage, share and process distributed data (e.g. relational, XML, files and RDF triples). It does this by executing workflows that can encapsulate complex distributed data management scenarios in which data from one or more sources can be accessed, updated, combined and transformed. Moreover, the data processing capabilities provided by OGSA–DAI are further augmented by a powerful distributed query processor and relational views component that allow distributed data sources to be viewed and queried as if they were a single resource. OGSA–DAI allows researchers and business users to move away from logistical and technical concerns such as data locations, data models, data transfers and optimization strategies for data integration and instead focus on application-specific data analysis and processing.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Dobrzelecki, B., Krause, A., Hume, A., Grant, A., Antonioletti, M., Alemu, Y., Atkinson, M., Jackson, M., Theocharopoulos, E.: Integrating distributed data sources with OGSA–DAI DQP and Views. Phil. Trans. R. Soc. A 368(1926), 4133–4145 (2010). doi: http://dx.doi.org/10.1098/rsta.2010.0166

    Article  Google Scholar 

  2. Lynden, S., Pahlevi, S., Kojima, I.: Service-based data integration using OGSA-DQP and OGSA-WebDB. In: Proceedings of the 2008 9th IEEE/ACM International Conference on Grid Computing, 29 Sept–01 Oct 2008. IEEE Computer Society, Washington, DC, pp. 160–167 (2008). doi:10.1109/GRID.2008.4662795

    Google Scholar 

  3. Lynden, S., Mukherjee, A., Hume, A., Fernandes, A., Paton, N., Sakellariou, R., Watson, P.: The design and implementation of OGSA-DQP: a service-based distributed query processor. Future Gen. Comput. Syst. 25, 224–236 (2009). doi:10.1016/j.future.2008.08.003

    Article  Google Scholar 

  4. Xiang, H.X.: Experiences running OGSA-DQP queries against a heterogeneous distributed scientific database. In: Proceedings of the 2009 15th International Conference on Parallel and Distributed Systems, pp. 706–710 (2009)

    Google Scholar 

  5. Tanimura, Y., Yamamoto, N., Tanaka, Y., Iwao, K., Kojima, I., Nakamura, R., Tsuchida, S., Sekiguchi, S.: Evaluation of large-scale storage systems for satellite data in GEO GRID. In: The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XXXVII, Part B4. pp. 1567–1574. Beijing (2008)

    Google Scholar 

  6. Groeper, R., Kunz, C., Grimm, C.: Connecting OGC web services and the Grid using Globus Toolkit 4 and OGSA–DAI. Conference on Grid Computing. In: 10th IEEE/ACM International, pp. 66–73, October 2009. doi: 10.1109/GRID.2009.5353080

    Google Scholar 

  7. Higgins, C., Koutroumpas, M., Sinnott, R.O., Watt, J., Doherty, T., Hume, A.C., Turner, A.G., Rawnsley, D.: Spatial data e-infrastructure, GLAS-PPE/2009-23 Preprint, 2009. http://ppewww.physics.gla.ac.uk/preprints/2009/23/2009--23.pdf. Accessed 5 Aug 2010

  8. Koehler, M., Ruckenbauer, M., Janciak, I., Benkner, S., Lischka, H., Gansterer, W.N.: Supporting molecular modeling workflows within a grid services cloud. Computational Science and Its Applications – ICCSA 2010, Lecture Notes in Computer Science, 2010, vol. 6019/2010, pp. 13–28. doi: 10.1007/978–3–642–12189–0_2

    Google Scholar 

  9. Swain, M., Silva, C.G., Loureiro-Ferreira, N., Ostropytskyy, V., Brito, J., Riche, O., Stahl, F., Dubitzky, W., Brito R.M.M.: P-found: Grid-enabling distributed repositories of protein folding and unfolding simulations for data mining. Future Gen. Comp. Syst. 26(3), 424–433 (2010)

    Article  Google Scholar 

  10. Brochhausen, M., Weiler, G., Martín, L., Cocos, C., Stenzhorn, H., Graf, N., Dörr, M., Tsiknakis, M., Smith, B.: Applications of the ACGT Master Ontology on Cancer. On the Move to Meaningful Internet Systems: OTM 2008 Workshops Lecture Notes in Computer Science, vol. 5333/2010, pp. 1046–1055 (2010). doi: 10.1007/978-3-540-88875-8_132

  11. Garcia Ruiz, M., Garcia Chaves, A., Ruiz Ibañez, C., Gutierrez Mazo, J.M., Ramirez Giraldo, J.C., Pelaez Echavarria, A., Valencia Diaz, E., Pelaez Restrepo, G., Montoya Munera, E.N., Garcia Loaiza, B., Gomez Gonzalez, S.: mantisGRID: a grid platform for DICOM medical images management in Colombia and Latin America. J. Digit. Imaging 24(2), 271–283 (2010). doi:10.1007/s10278-009-9265-x

    Google Scholar 

  12. Espino, J., Hall, K., Washington, D., White, P., Grant, A., Hume, A., Antonioletti, M., Krause, A., Jackson, M., Heinbaugh, W., Fu-Chiang, T.: Open-source collaboration in practice between the real-time outbreak and disease surveillance laboratory. Public Health Information Network (PHIN) Conference 2008, pp. 24–28, Atlanta. The National Center for Public Health Informatics Research Lab, The University of Edinburgh and Tarrant County Public Health (2008)

    Google Scholar 

  13. Tan, K.L.L., Gayle, V., Lambert, P.S., Sinnott, R.O., Turner, K.J.: GEODE – Sharing occupational data through the grid. In: Proceedings of the UK e-Science All Hands Meeting 2006 (2006)

    Google Scholar 

  14. Graham, P.J., Sloan, T.M., Carter, A.C., Gregory, I.: FirstDIG: Data investigations using OGSA–DAI. In: Proceedings of the UK e-Science All Hands Meeting 2004 (2004)

    Google Scholar 

  15. MESSAGE (Mobile Environmental Sensing System Across Grid Environments) Project. http://bioinf.ncl.ac.uk/message/ (2010). Accessed 5 Aug 2010

  16. Antonioletti, M., Blanke, T., Bodard, G., Hedges, M., Hume, A., Jackson, M., Rajbhandari, S.: Building bridges between islands of data – an investigation into distributed data management in the humanities. In: 5th IEEE International Conference on e-Science, pp 33–39, Oxford, 7–9 Dec 2009. (2009). ISBN 978-0-7695-3877-8

    Google Scholar 

  17. OGSA–DAI open source project publications. http://sourceforge.net/apps/trac/OGSA--DAI/wiki/Publications (2010). Accessed 7 Oct 2010

  18. OGSA–DAI open source project. http://sourceforge.net/projects/OGSA--DAI (2010). Accessed 7 Oct 2010

  19. KML. http://code.google.com/apis/kml/documentation/ (2010). Accessed 5 Aug 2010

  20. Globus Project GridFTP. http://globus.org/toolkit/docs/3.2/gridftp/ (2010). Accessed 5 Aug 2010

  21. Banks, T.: Web Services Resource Framework (WSRF) – Primer v1.2, OASIS, 23 May 2006. http://docs.oasis-open.org/wsrf/wsrf-primer-1.2-primer-cd-02.pdf (2006). Accessed 5 Aug 2010

  22. Graham, S., Karmarkar, A., Mischkinsky, J., Robinson, I., Sedukhin, I.: Web Services Resource 1.2 (WS-Resource), OASIS, 1 April 2006. http://docs.oasis-open.org/wsrf/wsrf-wsresource-1.2-spec-os.pdf (2006). Accessed 5 Aug 2010

  23. Globus Toolkit Security information. http://www.globus.org/toolkit/docs/4.0/security (2010). Accessed 12 Oct 2010

  24. Alfieri, R., Cecchini, R., Ciaschini, V., dell’Agnello, L., Frohner, A., Gianoli, A., Lõrentey, K., Spataro, F.: VOMS, an authorization system for virtual organizations. Lecture Notes in Computer Science, vol. 2970/2004, pp. 33–40 (2004)

    Google Scholar 

  25. Aranda, C., Corcho, O.: Federating queries to RDF repositories. Monografia (Technical Report). Computer Faculty (UPM), Madrid, Spain. http://oa.upm.es/3302/ (2010). Accessed 7 Oct 2010

  26. Antonioletti, M., Collins, B., Krause, A., Malaika, S., Magowan, J., Laws, S., Paton, N.W.: Web Services Data Access and Integration – The Relational Realization (WS-DAIR) Specification Version 1.0, Global Grid Forum (2006)

    Google Scholar 

  27. Antonioletti, M., Atkinson, M., Krause, A., Laws, S., Malaika, S., Paton, N.W., Pearson, D., Riccardi, G.: Web Services Data Access and Integration – The Core (WS-DAI) Specification, Version 1.0. http://www.ogf.org/documents/GFD.74.pdf (2006). Accessed 5 Aug 2010

  28. Antonioletti, M., Hastings, S., Krause, A., Langella, S., Lynden, S., Laws, S., Malaika, S., Paton, N.W.: Web Services Data Access and Integration – The XML Realisation (WS-DAIX) Specification, Version 1.0. http://www.ogf.org/documents/GFD.75.pdf (2006). Accessed 5 Aug 2010

  29. Taverna. http://www.taverna.org.uk/ (2010). Accessed 5 Aug 2010

  30. ActiveBPEL. https://sourceforge.net/projects/activebpel/ (2010). Accessed 5 Aug 2010

  31. Brito, M., Sato, L.: Extending OGSA–DAI Possibilities with a JDBC Driver, Computational Science and Engineering. In: 11th IEEE International Conference on Computational Science and Engineering, pp. 155–162 (2008). ISBN: 978-0-7695-3193-9. doi:http://doi.ieeecomputersociety.org/10.1109/CSE.2008.55

  32. OGC Standards and Specifications. The Open Geospatial Consortium. http://www.opengeospatial.org/standards (2010). Accessed 5 Aug 2010

  33. Jackson, M.J., Lloyd, A.D., Sloan, T.M.: Enabling access to federated grid databases: An OGSA–DAI ODBC driver. In: Proceedings of the UK e-Science All Hands Meeting, 2005

    Google Scholar 

  34. Google Maps API. http://code.google.com/apis/maps/index.html (2010). Accessed 5 Aug 2010

  35. Jackson, M., Antonioletti, M., Chue Hong, N.P., Hume, A.C., Krause, A., Sugden, T., Westhead, M.: Performance analysis of the OGSA–DAI software. In: Proceedings of the UK e-Science All Hands Meeting, September 2004

    Google Scholar 

  36. Kottha, S., Abhinav, K., Muller-Pfefferkorn, R., Mix, H.: Accessing bio-databases with OGSA–DAI – A performance analysis, distributed, high-performance and grid computing in computational biology, Lecture Notes in Computer Science, vol. 4360, pp. 141–156 (2007)

    Article  Google Scholar 

  37. Adamski, M., Kulczewski, M., Kurowski, K., Nabrzyski, J., Hume, A.: Security and performance enhancements to OGSA–DAI for Grid data virtualization: Research Articles, Selection of Best Papers of the VLDB Data Management in Grids Workshop (VLDB DMG 2006). Concurrency Comp. Pract. Ex. 19(16), 2171–2182 (2007). doi: 10.1002/cpe.1165

    Article  Google Scholar 

  38. Alpdemir, M.N., Gounaris, A., Mukherjee, A., Fitzgerald, D., Paton, N.W., Watson, P., Sakellariou, R., Fernandes, A.A.A., Smith, J.: Experience on performance evaluation with OGSA-DQP. In: Proceedings of the UK e-Science All Hands Meeting, September 2005

    Google Scholar 

  39. Dobrzelecki, B., Antonioletti, M., Schopf, J.M., Hume, A.C., Atkinson, M., Chue Hong, N.P., Jackson, M., Karasavvas, K., Krause, A., Parsons, M., Sugden, T., Theocharopoulos, E.: Profiling OGSA–DAI performance for common use patterns. In: Proceedings of the UK e-Science All Hands Meeting, September 2006

    Google Scholar 

  40. Wang, K., Xie, Y., Li, S., Wang, X.: Performance analysis of the OGSA–DAI 3.0 Software. In: 5th International Conference on Information Technology: New Generations, pp. 15–20, April 2008. ISBN: 0-7695-3099-0. doi: 10.1109/ITNG.2008.91

    Google Scholar 

  41. Santos, N., Koblitz, B., Distributed metadata with the AMGA metadata catalog. In: Proceedings of the Workshop on Next-Generation Distributed Data Management HPDC-15, Paris, France, June 2006

    Google Scholar 

  42. Fiore, S., Negro, A., Aloisio, G.: Data virtualization in grid environments through the GRelC data access and integration service. In: Proceedings 4th ICITST, IEEE, London, UK, pp. 817–822 (2009)

    Google Scholar 

  43. Fiore, S., Negro, A., Aloisio, G., The data access layer in the GRelC system architecture, Future Generation Computer Systems (2010). doi: 10.1016/j.future.2010.07.006

    Article  Google Scholar 

  44. Aloisio, G., Cafaro, M., Fiore, S., Mirto, M., Vadacca, S., Grelc data gather service: a step towards P2P production grids. In: SAC, pp. 561–565 (2007)

    Google Scholar 

  45. gLite. http://glite.web.cern.ch/glite/ (2010). Accessed 7 Oct 2010

  46. Moore, R., Rajasekar, A.: White Paper: IRODS: Integrated Rule-Oriented Data System. https://www.irods.org/pubs/DICEiRODS_White_Paper-08.pdf (2008). Accessed Sept 2008

  47. Storage Resource Broker (SRB). http://www.sdsc.edu/srb/index.php/MainPage (2010). Accessed 7 Oct 2010

  48. Malik, T., Szalay, A.S., Budavari, T., Thakar, A.: Skyquery: a web service approach to federate databases. In: Proceedings of the First Biennial Conference on Innovative Data Systems Research (CIDR 2003) Asilomar, USA, VLDB Endowment, pp. 188–196, January 2003. http://www.cidrdb.org/cidr2003/program/p17.pdf

  49. Hastings, S., Langella, S., Oster, S., Saltz, J.: Distributed data management and integration framework: The Mobius project. In: Proceedings of Global Grid Forum 11 (GGF11) semantic grid applications workshop, pp. 20–38 (2004)

    Google Scholar 

  50. XAware. http://www.xaware.org (2010). Accessed 7 Oct 2010

  51. IBM Information Integration. http://www-01.ibm.com/software/data/integration (2010). Accessed 7 Oct 2010

  52. Virtuoso Universal Server, OpenLink Software. http://virtuoso.openlinksw.com (2010). Accessed 7 Oct 2010

Download references

Acknowledgements

We acknowledge our past and present collaborators including the National eScience Centre at The University of Edinburgh, the eScience Centre of the North West of England at The University of Manchester, the North East of England eScience Centre at The University of Newcastle, IBM UK and Oracle UK. The project has been funded by the UK Department of Trade and Industry (under the Grid Core Programme I and II), the UK Engineering and Physical Sciences Research Council (under OGSA–DAI: an OMII-UK node, EP/D043956/1), by the European Union as part of the Framework Program 6 project BEinGRID (reference 034702) and by The University of Edinburgh.

Author information

Authors and Affiliations

  1. EPCC, The University of Edinburgh, James Clark Maxwell Building, The King’s Buildings, Mayfield Road, Edinburgh, EH9 3JZ, UK

    Michael J. Jackson, Mario Antonioletti, Bartosz Dobrzelecki & Neil Chue Hong

Authors
  1. Michael J. Jackson
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mario Antonioletti
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Bartosz Dobrzelecki
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Neil Chue Hong
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Michael J. Jackson .

Editor information

Editors and Affiliations

  1. Faculty of Engineering, Dept. of Innovation Engineering, University of Salento, Via per Monteroni, 73100, Lecce, Italy

    Sandro Fiore Ph.D.

  2. Faculty of Engineering, Dept. of Innovation Engineering, University of Salento, Via per Monteroni, 73100, Lecce, Italy

    Giovanni Aloisio

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Jackson, M.J., Antonioletti, M., Dobrzelecki, B., Hong, N.C. (2011). Distributed Data Management with OGSA–DAI. In: Fiore, S., Aloisio, G. (eds) Grid and Cloud Database Management. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-20045-8_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-20045-8_4

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-20044-1

  • Online ISBN: 978-3-642-20045-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation